-- Logs begin at Wed 2021-11-10 03:11:39 UTC, end at Wed 2021-11-10 05:24:30 UTC. -- Nov 10 03:41:46.507630 ncdv-817176-1 systemd[1]: Starting Devstack devstack@keystone.service... Nov 10 03:41:46.515161 ncdv-817176-1 devstack@keystone.service[96272]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 10 03:41:46 2021] *** Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: nodename: ncdv-817176-1 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: machine: x86_64 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: clock source: unix Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: pcre jit disabled Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: detected number of CPU cores: 4 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: current working directory: / Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: detected binary path: /usr/bin/uwsgi-core Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: your processes number limit is 47680 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: your memory page size is 4096 bytes Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: detected max file descriptor number: 2048 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: lock engine: pthread robust mutexes Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: thunder lock: enabled Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 10 03:41:46.520162 ncdv-817176-1 devstack@keystone.service[96272]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 10 03:41:46.568157 ncdv-817176-1 devstack@keystone.service[96272]: Python main interpreter initialized at 0x56353929e9c0 Nov 10 03:41:46.568157 ncdv-817176-1 devstack@keystone.service[96272]: python threads support enabled Nov 10 03:41:46.568157 ncdv-817176-1 devstack@keystone.service[96272]: your server socket listen backlog is limited to 100 connections Nov 10 03:41:46.568157 ncdv-817176-1 devstack@keystone.service[96272]: your mercy for graceful operations on workers is 90 seconds Nov 10 03:41:46.568512 ncdv-817176-1 devstack@keystone.service[96272]: mapped 403077 bytes (393 KB) for 2 cores Nov 10 03:41:46.568575 ncdv-817176-1 devstack@keystone.service[96272]: *** Operational MODE: preforking *** Nov 10 03:41:46.569117 ncdv-817176-1 devstack@keystone.service[96272]: *** uWSGI is running in multiple interpreter mode *** Nov 10 03:41:46.569117 ncdv-817176-1 devstack@keystone.service[96272]: spawned uWSGI master process (pid: 96272) Nov 10 03:41:46.569320 ncdv-817176-1 systemd[1]: Started Devstack devstack@keystone.service. Nov 10 03:41:46.570121 ncdv-817176-1 devstack@keystone.service[96272]: spawned uWSGI worker 1 (pid: 96284, cores: 1) Nov 10 03:41:46.570224 ncdv-817176-1 devstack@keystone.service[96272]: spawned uWSGI worker 2 (pid: 96285, cores: 1) Nov 10 03:41:46.570374 ncdv-817176-1 devstack@keystone.service[96272]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 10 03:41:51.775142 ncdv-817176-1 devstack@keystone.service[96284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 03:41:51.775142 ncdv-817176-1 devstack@keystone.service[96284]: from cryptography.utils import int_from_bytes Nov 10 03:41:51.775934 ncdv-817176-1 devstack@keystone.service[96285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 03:41:51.775934 ncdv-817176-1 devstack@keystone.service[96285]: from cryptography.utils import int_from_bytes Nov 10 03:41:51.776338 ncdv-817176-1 devstack@keystone.service[96284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 03:41:51.776338 ncdv-817176-1 devstack@keystone.service[96284]: from cryptography.utils import int_from_bytes Nov 10 03:41:51.776438 ncdv-817176-1 devstack@keystone.service[96285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 03:41:51.776438 ncdv-817176-1 devstack@keystone.service[96285]: from cryptography.utils import int_from_bytes Nov 10 03:41:51.824173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 03:41:51.824353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 03:41:51.824420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 03:41:51.824670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] command line args: [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 03:41:51.824768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 03:41:51.824768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] command line args: [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 03:41:51.824890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 03:41:51.827542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ================================================================================ {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 03:41:51.827655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 03:41:51.827655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ================================================================================ {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 03:41:51.827788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] admin_token = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] admin_token = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] config_dir = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] config_source = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] debug = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.827854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] config_dir = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] config_source = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] debug = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_config_append = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.830986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_config_append = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_dir = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_file = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_dir = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_file = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.831934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.832009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.832067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.832128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.832799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.833024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.833215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.833435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.833631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.833831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.834050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.834254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.834457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.834457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.834811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.835053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.835254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] publish_errors = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.835427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.835626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.835818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.836829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.837192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.837370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] standard_threads = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.837370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.837672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.837839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] publish_errors = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] use_journal = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] use_json = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.838721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] use_stderr = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] use_syslog = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.839790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] standard_threads = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.839920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.840052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.840225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.840393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.840393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.840684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.840826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] use_journal = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.840954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.841087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] use_json = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.841214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.841339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] use_stderr = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.841339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] use_syslog = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.841585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.841711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:41:51.841846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.841980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.842107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.842238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.842364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.843562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.843788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.843925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.844875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.845918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.846049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.847261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.847503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.847703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.847892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.848115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.848322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.848522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.848794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.848983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.849174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.849403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.849403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.849754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.850051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.850469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.850638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.850830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.851157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.851329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.851788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.851965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.852127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.852568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.852750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.852918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.853047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.853185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.853311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.853438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.854152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.854837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.855922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.856891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.857891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.858946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.859913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.860885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.861874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.862927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.863975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.864931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.865959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.866866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.867994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.868928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.869997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.external = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.870960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.871870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.password = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] auth.token = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.872870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.external = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.873909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.874036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.874162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.password = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.874288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.874782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] auth.token = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.874938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.875574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.875709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.875839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.875972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.876815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.877991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.878905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.879950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.880892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.881942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.882977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.883901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.884908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.885949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.886874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.887927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.888912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.889822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.890079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.890221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.890357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.890484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.890611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.891424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.891577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.891706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.891844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.891974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.892916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.893999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.894968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.895927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.896950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.897084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.897217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.897935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.898913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.899897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.900747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.901276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.901418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.901518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.901615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.902834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.903043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.903292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.903694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.903845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.903995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.904872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.905982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.906118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.906301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.906768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.906982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.907944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.908940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.909328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.909478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.909613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.909758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.909894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.910986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.911882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] role.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.912925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] role.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.913972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.914925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] role.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] role.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.915888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.916870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.917986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.918902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.919989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.920124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.920258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.920402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.920539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.921371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.921524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.921662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.921798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.922092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.922325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.922649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.922790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.922933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.923895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.924743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.925815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.926906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.927859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.connection = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.928904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.929854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.930945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.931200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.931468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.connection = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.931615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.931752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.931887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.932031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.932190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.932437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.932581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.932960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.933929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.934621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:41:51.935753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 03:41:51.935887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.935887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.936158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.936307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.936508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.936795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.945741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.946138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.975189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.975443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.979000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:51.979233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.116259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.116552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.167382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.167611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.168021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.168255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.235981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.236936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.237063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.237146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.237277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.237490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.260765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.260898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.260995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.261980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.262055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.262128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.273281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.273423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.285925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.286993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.287084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.287203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.287283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.287414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 03:41:52.304754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.304962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 03:41:52.305125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.305296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.305378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 03:41:52.305493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 03:41:52.305645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.305759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.305840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 03:41:52.306017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.306810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.317873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.318741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.319188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.326814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.327049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.330116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.330278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.330398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.330553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.330676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.330828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.330954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.331879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.332984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.333095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.358686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.358790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.360846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.360943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.361117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.361198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.366208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.366362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.366478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.366561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.366750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.366830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.373814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.373935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.374091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.374244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.379075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.379344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.379443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.379618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.379698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.379890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.379971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.380968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.381094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.381228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.399133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.399405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.399498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.399764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.403850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.404229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.407446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.407740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.407822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.408116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.412628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.413057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.416098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.416562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.419755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.420948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.421143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.421224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.421420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.421707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.440894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.441176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.441289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.441569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.442899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.443170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.443312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.443573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.451114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.451571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.452790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.453061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.453290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.453563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.456024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.456299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.456536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.456644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.456838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.456919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.457122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.457201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.457406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.457682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.470185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.470456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.470727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.470849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.471021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.471897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.472084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.472354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.490570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.491341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.493754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.494526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.497010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.497754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.498595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.499324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.500732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.501009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.501295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.501476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.501753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.502032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.508523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.509204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.510108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.510757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.513298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.513585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.513867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.513959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.514149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.514231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.514434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.514704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.523239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.523522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.523758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.523841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.524038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.524310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.531954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.532206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 03:41:52.532289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.532479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.532559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.532775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.532894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.533932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.534997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.535173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.535480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.535576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.535712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.535965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 03:41:52.573691 ncdv-817176-1 devstack@keystone.service[96285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56353929e9c0 pid: 96285 (default app) Nov 10 03:41:52.573967 ncdv-817176-1 devstack@keystone.service[96284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56353929e9c0 pid: 96284 (default app) Nov 10 03:41:52.577072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ed1d-6bfb-4938-ba69-0302b58d92a7 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:41:52.577365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ed1d-6bfb-4938-ba69-0302b58d92a7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:41:52.577643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ed1d-6bfb-4938-ba69-0302b58d92a7 None None] PATH_INFO: `/v3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:41:52.581854 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Nov 10 03:41:52 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:00.315191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:00.315749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:00.315749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:00.321017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:00 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:00.326892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:00.327315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:00.327450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:00.357109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG oslo_db.sqlalchemy.engines [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:42:00.543534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG passlib.handlers.bcrypt [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96285) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 10 03:42:00.543948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG passlib.handlers.bcrypt [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96285) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 10 03:42:00.598642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:00.600188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:00.730577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:00.855654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:00.889126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG oslo_db.sqlalchemy.engines [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:42:01.017708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ee2a0-f553-463f-acca-3cb38a07f344 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:01.021935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:01.022588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:01.022869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:01.023147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:01.031297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:01.082006 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 10 03:42:01.082351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b44e79-9d10-499e-a3e8-832c633dd30a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:01.091405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:42:01.099076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:01.113084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e7261-d7cb-40a1-95b8-7cd22d7ac173 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:01.117401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:01.118497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:01.118779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:01.119061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:01.120556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] RBAC: Authorizing `identity:get_project(project_id=e759a896dad443d0938f7cb7473bd222)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:01.173272 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 10 03:42:01.173602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240d4a5-fda3-4b82-88de-84cef722fe5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:01.178178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:01 2021] GET /identity/v3/projects/e759a896dad443d0938f7cb7473bd222 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:03.448199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3728f-87dc-489c-90a3-0ea1fc29a0c7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:03.448794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3728f-87dc-489c-90a3-0ea1fc29a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:03.448794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3728f-87dc-489c-90a3-0ea1fc29a0c7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:03.453791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:03.461301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:03.461736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:03.461850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:03.481057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:03.482558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:03.490681 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:03.514491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3728f-87dc-489c-90a3-0ea1fc29a0c7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:03.526615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3728f-87dc-489c-90a3-0ea1fc29a0c7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:03.530765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:03.531975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:03.532246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:03.532513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:03.539863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:03.541635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49baf-d670-4be8-8d19-eba0c5c2c70f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:03.549949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:03.556149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:03.565155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad06d-204a-4282-87a9-0b460ae0c229 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:03.569679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:03.570510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:03.570786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:03.571054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:03.572423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:03.574247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6da3-a47f-4b61-9e5c-1c5c8d45cfad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:03.575779 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:03 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:05.905597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479e5c-4896-49ef-9d33-fb60b7e77eed None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:05.906137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479e5c-4896-49ef-9d33-fb60b7e77eed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:05.906228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479e5c-4896-49ef-9d33-fb60b7e77eed None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:05.907902 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:05.914999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae1b9-e7b0-4be4-b662-d4dbaf8cab68 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:05.915414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae1b9-e7b0-4be4-b662-d4dbaf8cab68 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:05.915625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae1b9-e7b0-4be4-b662-d4dbaf8cab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:05.933891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-545ae1b9-e7b0-4be4-b662-d4dbaf8cab68 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:05.935062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-545ae1b9-e7b0-4be4-b662-d4dbaf8cab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:05.943326 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:05.968758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479e5c-4896-49ef-9d33-fb60b7e77eed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:05.980394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479e5c-4896-49ef-9d33-fb60b7e77eed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:05.982675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c4ff-861a-42a4-b7a6-3221bd39bfb2 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:05.982968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c4ff-861a-42a4-b7a6-3221bd39bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:05.983248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c4ff-861a-42a4-b7a6-3221bd39bfb2 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:05.985202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:05.985814 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 7/12] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:05.986014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:05.986300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:05.986572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:05.993026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:05.993311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:05.993585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.004024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:06.010824 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:06.011166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:06.012015 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 6/13] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:06.012376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:06.018339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.019939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:06.027909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ad1c0-4ea6-488b-ae8f-90f42ac47e12 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.032187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.032824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.033109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.033383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.034125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:06.034426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.036121 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:06.036121 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:06.036121 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:06.037046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.043904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.050919 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 7/15] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:06.053442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5f02-fa1e-4d17-aa7f-25aa357ddc20 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.056720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.057897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.058520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.058794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.059062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.066379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d314a95-ab38-4abb-8544-d5cbc1843a0b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.067467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.069506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.070989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.071804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.072084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.072358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.074065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.075846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.077412 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:06.078092 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 9/17] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:42:06.082947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.084151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.092200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293cd8f-9df4-4270-a2ad-b317f6744cae admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.092449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7e04-4b0d-4884-bbb1-b17b18efc027 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.096960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.097682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.097956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.098222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.099427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.099690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.100443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.100769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.101048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.101146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.102365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.102580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:06.104036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c0fc-67ab-41b8-9ce1-aa410882e8c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.109548 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:06.109664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:06.118915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edccab-ec23-4f74-bfea-5d10812013bb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:06.123460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:06.124130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:06.124409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:06.124744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:06.125600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.domain.id=default, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:06.125906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:06.126922 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:06.126922 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:06.126922 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:06.128093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76943e-6b79-498a-bb05-ef1243ebcd00 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:06.137982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1343 bytes} [Wed Nov 10 03:42:06 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.domain.id=default&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:08.775147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fad-ba5d-442d-bd72-469663c40458 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:08.776052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fad-ba5d-442d-bd72-469663c40458 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:08.776601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fad-ba5d-442d-bd72-469663c40458 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:08.778794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:08.786573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:08.787436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:08.787932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:08.826998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG passlib.handlers.bcrypt [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96284) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 10 03:42:08.827812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG passlib.handlers.bcrypt [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96284) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 10 03:42:08.875166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:08.876846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:08.903369 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 11/22] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:08.928398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078fad-ba5d-442d-bd72-469663c40458 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:08.941530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078fad-ba5d-442d-bd72-469663c40458 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:08.946187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:08.947070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:08.947357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:08.947625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:08.961193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:08.968194 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:08.969835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 12/23] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:08.976281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:08.986468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920126-32f5-4c22-be2b-e7e209b71c0f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:08.991247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:08.992329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:08.992633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:08.992923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:08.993927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:08.994232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:08.995908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.008019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 12/24] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:09.014713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.024764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9513c-aeb7-4f3a-afdb-11f8d6f2e160 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.029636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.030447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.030766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.031041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.032366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.034281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2800c-654b-4947-aba3-de8a1986aa47 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.036421 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 13/25] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:09 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:09.042754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.048136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b1d9-d2c9-46bc-b690-376b3cf085fc None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.048729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b1d9-d2c9-46bc-b690-376b3cf085fc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.049200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b1d9-d2c9-46bc-b690-376b3cf085fc None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.051476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 14/26] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:09.053586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ede3-ecad-42b9-8001-0a4b5f49cf88 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.058336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.059337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.059766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.060176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.061932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.062737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.063023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.063296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.065277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.067436 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 13/27] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:09.074827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.084831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e39a4-3b9d-4bef-9a33-e76e6cbba4e1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.089554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.090660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.091149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.091646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] PATH_INFO: `/v3/domains/default/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.094643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=68e2062e0f2c4721be375c86224003a3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.095956 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:09.095956 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:09.095956 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:09.098476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7d85-909a-4947-a955-d0ec82486b7b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.101775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:09.102966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:09.127038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:09.170555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.188069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0bac-e79c-41b8-b9aa-ed6c793dd1a4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.231136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 14/29] 10.222.0.13 () {58 vars in 1382 bytes} [Wed Nov 10 03:42:09 2021] PUT /identity/v3/domains/default/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:42:09.282861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc282b-e606-4c89-b71f-65cca1688d11 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.283543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc282b-e606-4c89-b71f-65cca1688d11 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.284046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc282b-e606-4c89-b71f-65cca1688d11 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.285778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.286571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.286849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.287121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.290513 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:09 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:09.301148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.301787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.302269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.303111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.305038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.324037 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:09.325982 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 16/31] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:09.332846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.344719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:09.348414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:09.359457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626c64-e539-4a97-9051-004a6e4605d5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.371119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.372063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.372482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.372919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.373828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:09.374951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.377039 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:09.377039 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:09.377039 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:09.378271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.384636 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 16/32] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:09.412478 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 17/33] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:09.418678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.424988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.433283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd285b-9620-4702-8fd2-ca3d6b6250ae None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.439432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8493b-2b92-412d-a35c-fcebf040ad5b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.453496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.454204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.454486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.454585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.454813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.455241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.455527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.455883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.456170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.456771 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:09.456771 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:09.456771 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:09.456989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.458019 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:09.458019 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:09.458019 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:09.458241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722252b3-03e4-4498-9c48-5082d71761aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.458939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.535311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/projects => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:09.593084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3b1e-eb1a-4c0b-a622-852d17b560cc None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.593395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3b1e-eb1a-4c0b-a622-852d17b560cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.593829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3b1e-eb1a-4c0b-a622-852d17b560cc None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.595787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 18/35] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:09.606708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdade2-31f6-45a4-b94a-99e346dfc6c4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.607340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdade2-31f6-45a4-b94a-99e346dfc6c4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.607824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdade2-31f6-45a4-b94a-99e346dfc6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.615397 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 18/36] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/roles => generated 219 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:09.641969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fcbdade2-31f6-45a4-b94a-99e346dfc6c4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:09.643307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fcbdade2-31f6-45a4-b94a-99e346dfc6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:09.733322 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 19/37] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:09.783590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:09.799902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a2dc6-7506-44cb-bab0-5040979450a3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:09.811957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:09.813210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:09.813496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:09.813783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:09.814581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:09.816473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223751-1eb4-4a22-8dbb-85e94532d835 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:09.839813 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 19/38] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:42:09 2021] POST /identity/v3/roles => generated 225 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:10.637569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3999f6-4e91-476f-8f07-21bd8d7b14a3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.638324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3999f6-4e91-476f-8f07-21bd8d7b14a3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.638324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3999f6-4e91-476f-8f07-21bd8d7b14a3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.639953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 20/39] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:10.648193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475e86-3260-4b04-b1cb-8af848cbee3c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.648476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475e86-3260-4b04-b1cb-8af848cbee3c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.648790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475e86-3260-4b04-b1cb-8af848cbee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.666493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3e475e86-3260-4b04-b1cb-8af848cbee3c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:10.667986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e475e86-3260-4b04-b1cb-8af848cbee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:10.675726 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 20/40] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:10.701317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3999f6-4e91-476f-8f07-21bd8d7b14a3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:10.714817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3999f6-4e91-476f-8f07-21bd8d7b14a3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:10.719800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:10.720482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.720797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.721072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.721867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:10.722898 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:10.722898 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:10.722898 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:10.723831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902998-16b3-4fa6-a453-80384a134a4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:10.740261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:42:10 2021] POST /identity/v3/roles => generated 223 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:10.858012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1e79-503e-4a32-a7a2-d8fd982b961e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.858555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1e79-503e-4a32-a7a2-d8fd982b961e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.858555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1e79-503e-4a32-a7a2-d8fd982b961e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.861301 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 21/42] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:10.869384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.869691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.869951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.890219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:10.891379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:10.899445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:10.925589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad1e79-503e-4a32-a7a2-d8fd982b961e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:10.938773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad1e79-503e-4a32-a7a2-d8fd982b961e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:10.943660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:10.945502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.945502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.945502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.946482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:10.948207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b2180-35be-46fc-bf19-d3a3097ad82c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:10.950006 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 22/44] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:10.956631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:10.965696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0364f-2413-41cc-a0bd-a20904216bed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:10.971215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:10.971872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:10.972152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:10.972423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:10.973171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:10.975067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df3ba-fbb6-48e5-ad41-675cf3befc6e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:11.002683 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:42:10 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:11.899362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc628-dd65-487c-b113-4aafc90f432e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:11.899850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc628-dd65-487c-b113-4aafc90f432e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:11.899947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc628-dd65-487c-b113-4aafc90f432e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:11.901738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 23/46] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:11.909052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:11.909434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:11.909607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:11.927282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:11.928438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:11.981627 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 24/47] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:12.008173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bc628-dd65-487c-b113-4aafc90f432e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:12.020268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bc628-dd65-487c-b113-4aafc90f432e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:12.024474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:12.025268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:12.025543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:12.025812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:12.035678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:12.042358 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:12.049337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:12.050281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:12.058968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bd5b-2998-4c86-a16d-66e278e46ee1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:12.063826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:12.064668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:12.064950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:12.065228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:12.065991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:12.066295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:12.067886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:12.076222 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:12.082028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:12.091880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d43052-9099-4071-9134-698f654fd342 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:12.096804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:12.097641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:12.097920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:12.098193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:12.099429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:12.101256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:12.102810 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:12 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:12.108654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:12.118606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67365-fdc2-41b6-9fdb-8029bec452a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:12.122874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:12.123641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:12.123918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:12.124188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:12.125442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:12.127131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34536dfe-f10d-40f9-8923-64f3d68a4783 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:12.128716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 26/51] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:12.134831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:12.144561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7237b-71ad-43da-8367-ecc6a6a01cf5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:12.148962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:12.149602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:12.149885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:12.150163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:12.151008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.domain.id=default, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:12.151319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:12.152327 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:12.152327 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:12.152327 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:12.153527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e126-2152-4299-b7ef-e59bb6c4d897 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:12.161335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 26/52] 10.222.0.13 () {56 vars in 1343 bytes} [Wed Nov 10 03:42:12 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.domain.id=default&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:13.337893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df446-a63e-444d-8162-ea05c3fb27b6 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:13.338409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df446-a63e-444d-8162-ea05c3fb27b6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:13.338514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df446-a63e-444d-8162-ea05c3fb27b6 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:13.340221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 27/53] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:13.347118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:13.347487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:13.347680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:13.365410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:13.366590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:13.374038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:13.401840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df446-a63e-444d-8162-ea05c3fb27b6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:13.413873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df446-a63e-444d-8162-ea05c3fb27b6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:13.418069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:13.418827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:13.419105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:13.419376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:13.420551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:13.422774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc316a-9d45-4a60-b923-eca29a797e18 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:13.424316 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:13.430356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:13.440393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c99f3-2cc6-4f6c-8a6d-57ebe3d45db4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:13.445019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:13.445650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:13.445925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:13.446196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:13.446905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:13.447901 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:13.447901 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:13.447901 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:13.449126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353575ca-623d-4c1b-af7b-d614e0f0f21d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:13.477021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 28/56] 10.222.0.13 () {60 vars in 1161 bytes} [Wed Nov 10 03:42:13 2021] POST /identity/v3/projects => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:15.766739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34143-d132-4a39-8f35-8223c67254b3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:15.767276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34143-d132-4a39-8f35-8223c67254b3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:15.767276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34143-d132-4a39-8f35-8223c67254b3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:15.769079 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 29/57] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:15.776219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:15.776688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:15.776852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:15.794711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:15.795981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:15.852735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:15.879422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34143-d132-4a39-8f35-8223c67254b3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:15.891675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34143-d132-4a39-8f35-8223c67254b3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:15.895795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:15.896559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:15.896868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:15.897138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:15.898299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:15.899962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f23ccd-9021-4277-acc9-370ed6131b53 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:15.901547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:15.907209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:15.916013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5c5c0-5be6-45f2-b430-b2490bec14c0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:15.920386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:15.921074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:15.921355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:15.921632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:15.922350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:15.923380 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:15.923380 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:15.923380 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:15.924598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e1cd-5d21-4fab-913f-5508786ae159 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:15.951316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 30/60] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:15 2021] POST /identity/v3/users => generated 275 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:19.565493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5e96-0161-4647-a242-8ddab3b6d386 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.566486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5e96-0161-4647-a242-8ddab3b6d386 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.567059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5e96-0161-4647-a242-8ddab3b6d386 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.569331 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 31/61] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:19.584706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08ae6-66da-464f-9c98-671ed3f82484 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.585590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08ae6-66da-464f-9c98-671ed3f82484 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.586046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08ae6-66da-464f-9c98-671ed3f82484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.613603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0ac08ae6-66da-464f-9c98-671ed3f82484 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:19.615076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0ac08ae6-66da-464f-9c98-671ed3f82484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:19.623303 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:19.635760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bf63-ca4b-458d-9aa7-76c10bcc4351 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.636118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bf63-ca4b-458d-9aa7-76c10bcc4351 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.636646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bf63-ca4b-458d-9aa7-76c10bcc4351 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.638691 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:19.646364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff86e-3704-468f-bccf-f0f59ea2e9df None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.646683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff86e-3704-468f-bccf-f0f59ea2e9df None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.646925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff86e-3704-468f-bccf-f0f59ea2e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.656553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9bf63-ca4b-458d-9aa7-76c10bcc4351 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.672131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9f1ff86e-3704-468f-bccf-f0f59ea2e9df None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:19.673676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9f1ff86e-3704-468f-bccf-f0f59ea2e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:19.678136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9bf63-ca4b-458d-9aa7-76c10bcc4351 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.687491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.688476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.688657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:19.689085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.689495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.708816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:19.712978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090cd3-66f0-4f17-9178-25cf30315689 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.713495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090cd3-66f0-4f17-9178-25cf30315689 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.713960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090cd3-66f0-4f17-9178-25cf30315689 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.715786 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:19.716435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 33/65] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:19.718733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 33/66] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:19.723768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.724071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.724482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.725089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.735355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79901db-1389-4f67-8e91-2cf729325b01 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.739882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.740533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.740845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.741121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.741884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:19.742189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.743885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.751908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:19.753397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:19.758168 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 34/67] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:19.759297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.767461 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:19.768529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.772850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0db1-a722-4f70-ac75-84fe5883a62b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.777739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.778833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.779315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.779797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.781917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e80e-ff87-43e8-bcd0-6150e7302ec4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.793878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:19.796510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.797882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.798233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.798576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.802289 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:19.804057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:19.805046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.816591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170bd24-5b4f-4e71-85ef-2c143851e439 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.822318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.823225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.823655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.824008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.825967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.831521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.833866 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.835089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.839801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:19.845176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310d8e-361f-4207-aa51-e1210e1593f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.848889 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:19.850104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.855527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:19.855527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.855697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.855697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.855697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.855697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:19.855697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.855983 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:19.855983 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:19.855983 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:19.857250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.866063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691038-71b2-4f27-b323-7864fa493b06 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.871086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.871961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.872462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.872967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.879544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.880437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.883461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.885550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.891930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73358a5-99fd-4b15-9144-9f88cde4acc7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.896446 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:19.896768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.897484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.897772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.898049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.898365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.898809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:19.899134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.900855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.908756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e432f3b-8236-4ccf-867c-3969c99e79f4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.911161 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.916636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.922651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.923769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.924251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.924764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.926203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.926915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02c810-359b-442e-8b38-bf474af5f771 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.928878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.931454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.931706 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.932716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.937705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.938004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.938269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.939879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.943185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.945057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b8b0f-e019-4792-8443-87d5e25c13ac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.945562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.946345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.950936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.952770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.953285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.953785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.955354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.957740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed657d-30af-4a53-a031-6ecd946d6cad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.958584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.961368 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:19.962562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:19.975509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.976190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.976473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.976792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.988025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef10a-dccc-4268-9429-88af4fe2592a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:19.988362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:19.990166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:19.993573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:19.994842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:19.995340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:19.996394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:19.997831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:19.998370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.000800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 39/78] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:20.001124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.006866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.008567 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 40/79] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:19 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=4aa20354184f48969579623c64fd58fc => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.009632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.018062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd327f-cf21-4c8c-948d-9f758837a40a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.022526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.023025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ea12e-7900-4876-8174-56631972fb39 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.023379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.023727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.024077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.028501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.029839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.031521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.032021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.033827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.034077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.035833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.036696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.038729 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.045349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.051067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 40/81] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:20.061481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fd1a-aabd-408f-9143-2dd0f66edb0c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.066496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.067489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.067923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.068354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.071349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:20.071839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.072234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.074078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f86758-3f6f-4a75-9fb5-91caed4fdad8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.081070 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 42/82] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.097312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4d68-3de5-4629-82e5-f75ddc6e3340 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.104447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885256-5635-48eb-b88b-eb665d249bbe None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.104878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885256-5635-48eb-b88b-eb665d249bbe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.105228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885256-5635-48eb-b88b-eb665d249bbe None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.107252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 43/83] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:20.115625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52626bd-5185-4282-a609-28594c9481f9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.116203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52626bd-5185-4282-a609-28594c9481f9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.116727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52626bd-5185-4282-a609-28594c9481f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.116827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.117714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.118064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.118415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.124647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.124647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.124647 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 41/84] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.130406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.146604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b32e4-df5d-4c38-8102-2b330c0e8137 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.157698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d52626bd-5185-4282-a609-28594c9481f9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:20.158938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d52626bd-5185-4282-a609-28594c9481f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:20.160592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.161361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.161641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.161915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.162911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:20.163367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.165439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.168007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:20.169580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d195a7-8a76-4aa8-8162-c8bbb52d3445 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.169867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d195a7-8a76-4aa8-8162-c8bbb52d3445 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.170143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d195a7-8a76-4aa8-8162-c8bbb52d3445 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.171944 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 45/86] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:20.179754 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 42/87] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:20.180117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.180411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.180736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.196895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.210981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ad7d-82dc-4aa9-bd83-0a3e5aa692a1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.214836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:20.216109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:20.222997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.224303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.224600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.224903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.228449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.233240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.237180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 43/88] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:20.237382 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:20.243786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.255266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42727-ce9a-4457-85fb-e5ef1f0e0181 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.260317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.261084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.261426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.261763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.262530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.265509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.279935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.291050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296aef6-903a-4b99-96c4-66e3fd2f6d54 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.297319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.298366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.298657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.298978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.310631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 44/90] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:42:20 2021] POST /identity/v3/projects => generated 302 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:20.313939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:20.321560 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:20.322834 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 47/91] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:20.330511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.406173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787fc23-a668-4826-bc4a-d4a133b1b17c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.416883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.417951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.418433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.418903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.419947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:20.420465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.422467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.437841 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.444557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.462568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beb7d0-fc3f-4985-80dc-25dc86f3a99b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.468859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.470043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.470546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.471072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.472587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.475076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.476980 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 48/93] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.483182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.494303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb051a8-d495-4fb5-9b9a-349446db10cd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.500256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.501384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.501944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.502470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.511945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.514259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.526177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 46/94] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:42:20.532723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.543797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf1184-234c-424c-b1bd-83874698de4e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.552799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.554172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.554651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.555165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] PATH_INFO: `/v3/projects/a210aedaae3649bea6079458bde4c633` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.556696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] RBAC: Authorizing `identity:get_project(project_id=a210aedaae3649bea6079458bde4c633)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.559124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec7ec-c49f-4248-8277-a893c068205a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.562065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 49/95] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/projects/a210aedaae3649bea6079458bde4c633 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:20.568472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:20.579137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f74c5-62d8-4eb7-a225-f90cb40095a1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:20.587156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:20.588497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:20.589048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:20.589533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:20.590629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=a210aedaae3649bea6079458bde4c633, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:20.591182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:20.593335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a356ef-8c68-4664-b345-2f94b60d866b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:20.600095 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 47/96] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:20 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=a210aedaae3649bea6079458bde4c633&role.id=4aa20354184f48969579623c64fd58fc => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:22.901920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b7fd-6cbc-47f5-aff6-1edab47b3bd7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:22.902458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b7fd-6cbc-47f5-aff6-1edab47b3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:22.902458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b7fd-6cbc-47f5-aff6-1edab47b3bd7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:22.904243 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 50/97] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:22.919137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148f56-cff3-4ad3-b23d-ce3178d58dd0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:22.919614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148f56-cff3-4ad3-b23d-ce3178d58dd0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:22.919686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148f56-cff3-4ad3-b23d-ce3178d58dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:22.945179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-66148f56-cff3-4ad3-b23d-ce3178d58dd0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:22.946357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66148f56-cff3-4ad3-b23d-ce3178d58dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:22.958898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 48/98] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:22.970028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b1eb-1c38-4f09-ab04-7b166bb2b86c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:22.970314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b1eb-1c38-4f09-ab04-7b166bb2b86c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:22.970590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b1eb-1c38-4f09-ab04-7b166bb2b86c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:22.972356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 51/99] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:22.979642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:22.979933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:22.980214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.010194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:23.011381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:23.019576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5ae4-6b00-48ae-ac90-dc3c1e513bb5 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.020110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5ae4-6b00-48ae-ac90-dc3c1e513bb5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.020623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5ae4-6b00-48ae-ac90-dc3c1e513bb5 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.022067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:23.022860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.023057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 52/101] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:23.030861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929767-852f-4784-a587-fe823d0a728c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.031426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929767-852f-4784-a587-fe823d0a728c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.031936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929767-852f-4784-a587-fe823d0a728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.033006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96267ad3-3eb8-4ff7-8ecc-aa19984b1ec3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.037600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.038392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.038675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.038953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.050002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:23.056835 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:23.058038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 50/102] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:23.064877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.073685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7929767-852f-4784-a587-fe823d0a728c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:23.075027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7929767-852f-4784-a587-fe823d0a728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:23.077739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3dd2-a0e1-4194-b1a3-35849e40a81d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.083461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.084292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.084758 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 53/103] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:23.084876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.085035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.085934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929767-852f-4784-a587-fe823d0a728c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.086065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:23.086607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.088404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.098138 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 51/104] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.104645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.108216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929767-852f-4784-a587-fe823d0a728c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.115040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41b0f5-b06d-4bea-9813-cd99f8e8f52a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.118109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.119029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.119403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.119764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.120320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.121357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.121771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.122170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.123515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.125859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.127619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 52/105] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.133778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.142698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:23.149852 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:23.151050 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 54/106] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:23.151391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777ce3-fd05-4756-9720-ec533a6e8f35 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.151801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.157225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.158762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.159241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.159714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.166915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db602e-62ef-4d09-98ac-d719268969a9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.172064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.172733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:23.172913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.173198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.173471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.174673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.176742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.178707 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 55/107] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.184629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.184753 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:23.184753 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 53/108] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:23.191263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.199377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615e0b-a16c-4827-b8b0-4ac48cedb185 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.203745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fda49-6242-409c-b713-3b4e0d551eec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.205308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.206332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.206877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.207295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.208308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:23.208783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.208890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.209848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.210224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.210591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.211111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.212919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcdfb53d104b1f8c560611b4e841e7, user_id=99765343c3fa4367bcfd7aae4fb07ab0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.214146 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:23.214146 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:23.214146 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:23.215960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.221656 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 56/109] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.222646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.233910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edbddd-bc70-4590-8f1e-a1e02f713f40 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.239254 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:23 2021] PUT /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:23.243162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.333847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a4b-4a8e-4c01-a54c-685b81e2fae1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.339898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.341041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.341396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.341779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.343746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.346015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.348660 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 55/111] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.355303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.367562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087615fb-065c-46cf-93eb-d198ab5d9dc3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.373294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.374342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.374624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.374955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.376401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.379224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.381574 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 56/112] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.388698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.399814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41720-2796-45d6-9352-2d23115a62f4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.404923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.406410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.406794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.406944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.409319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcdfb53d104b1f8c560611b4e841e7, user_id=99765343c3fa4367bcfd7aae4fb07ab0, role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.412113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.413962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.414651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.414930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.415205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.416330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:23.416670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.418370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196821-0a45-4db5-b30b-baf9e789005f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.431822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 57/113] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:23 2021] PUT /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:23.439678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 57/114] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.447933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.521132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57cc75-867c-4b8a-a35a-d4cd1c672f4d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.526749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.527832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.528273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.528745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.530896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.533085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.535085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 58/115] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.541970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb4d8-471b-4bc0-b834-7dd78c8d43b4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.542251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb4d8-471b-4bc0-b834-7dd78c8d43b4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.542523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb4d8-471b-4bc0-b834-7dd78c8d43b4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.544682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 58/116] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:23.548533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.557203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b34f2-e468-495d-91fc-92c59781ecca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.557484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b34f2-e468-495d-91fc-92c59781ecca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.557766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b34f2-e468-495d-91fc-92c59781ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.560707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451995c-a23a-4ada-a81e-a2e4ecc0047e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.570507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.571707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.572170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.572670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.574167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.577605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.579673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 59/117] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:23.586332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.589789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-096b34f2-e468-495d-91fc-92c59781ecca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:23.591015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-096b34f2-e468-495d-91fc-92c59781ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:23.599123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f76b8-f650-462d-89af-786671e384f7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.606005 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 59/118] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:23.609145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.610056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.610337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.610606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.612731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcdfb53d104b1f8c560611b4e841e7, user_id=68e2062e0f2c4721be375c86224003a3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.615414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e34003-cf9b-4c6c-adf3-f2b325f5fcfd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.628895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba19a-edeb-462e-bc72-95e02771e417 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.629181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba19a-edeb-462e-bc72-95e02771e417 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.629451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba19a-edeb-462e-bc72-95e02771e417 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.631579 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 60/119] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:23.638299 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 60/120] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:23 2021] PUT /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:42:23.638502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba19a-edeb-462e-bc72-95e02771e417 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.643478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.644015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.644509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.666248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:23.667916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:23.723911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba19a-edeb-462e-bc72-95e02771e417 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.733644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.734611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.734988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.735381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.738043 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 61/121] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:23.751874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:23.760320 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:23.762041 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 61/122] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:23.769206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.777880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.781042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a992d-d541-4291-9c0f-0f4ef0bbff9e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.786028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.786983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.787419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.787840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.790241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143c25c-18a5-4951-874a-2a03d1ca780d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.790670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:23.791141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.793242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.795230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.796040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.796436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.797044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.798234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.800063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.802173 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 62/123] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.805025 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 62/124] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.811351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.815754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.825756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8766b-7308-424c-9f6f-28571e75b717 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.831469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa8bb1-6e17-46b5-aee9-5fcfb8b3d239 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.835851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.836827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.837049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.837323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.838995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.841210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.851703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 63/125] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:23.852568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.853110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.853286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.853557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.853834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.854585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.856529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.867045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761f8d-5ae2-41f9-8df9-478420af8286 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.882879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.884596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.885846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.886578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] PATH_INFO: `/v3/projects/a210aedaae3649bea6079458bde4c633` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.889501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a210aedaae3649bea6079458bde4c633)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.891849 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 63/126] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:23 2021] POST /identity/v3/users => generated 283 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:42:23.893535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8bd65-f5fd-40be-94c5-c3e0da3da5b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.895608 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 64/127] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:23 2021] GET /identity/v3/projects/a210aedaae3649bea6079458bde4c633 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:23.902653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:23.914768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67610438-74b3-4773-86a4-f37e11709691 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:23.925992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:23.926969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:23.927298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:23.927577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] PATH_INFO: `/v3/projects/a210aedaae3649bea6079458bde4c633/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:23.930830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a210aedaae3649bea6079458bde4c633, user_id=99765343c3fa4367bcfd7aae4fb07ab0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:23.933907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21299be-ae98-461b-93a2-1dfb034f308c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:23.958071 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 64/128] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:23 2021] PUT /identity/v3/projects/a210aedaae3649bea6079458bde4c633/users/99765343c3fa4367bcfd7aae4fb07ab0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:26.207367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8758d-3d90-450c-a8a4-8eea033c49fe None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.208057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8758d-3d90-450c-a8a4-8eea033c49fe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.208057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8758d-3d90-450c-a8a4-8eea033c49fe None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.209861 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 65/129] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:26.228172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb427-040d-4398-a5e0-fe5b47c798ff None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.228457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb427-040d-4398-a5e0-fe5b47c798ff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.228736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb427-040d-4398-a5e0-fe5b47c798ff None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.230497 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 66/130] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:26.230712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.231193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.231356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.238052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.238331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.238607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.272104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:26.273321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:26.276389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:26.277563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:26.383925 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 67/131] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:26.395021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 65/132] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:26.438894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.444272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.451519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea90017-77f7-4317-ab6d-b73c3ba1d8fb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.465951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19d63-2827-4149-b917-4e6d6bb0aa49 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.467928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.468748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.469027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.469298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.482637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.483467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.483741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.484012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.494455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:26.507061 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:26.508555 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 68/133] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:26.508999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:26.516580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.518445 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:26.519786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 66/134] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:26.532079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.538878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf094-e7c0-4bf4-848e-4be87f70f513 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.549046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a2bc-8ce1-4d78-9a75-86a22b41ca2e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.558381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.559113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.559397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.559668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.560437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:26.560768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.562926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.563102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.563737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.564019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.564349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.565139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:26.565439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.567033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.579477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 69/135] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:26.582555 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 67/136] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:26.588522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.590591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.603614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4faec-69b5-4663-926a-e63b37ab0ce7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.610684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f741b-5bbc-46ad-883b-fb0899d15cc9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.617989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.618873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.619152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.619423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.620569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.621455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.621636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.621788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.621991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.623623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.626033 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 70/137] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:26.626619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.628775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.630506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 68/138] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:26.636577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.637732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.653510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b855-8b13-408e-a96a-3434d9ae62c2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.656158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b4c81-ebf3-4a46-8134-9872c7f39b0b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.663055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.663696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.663977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.664245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.666134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.666760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.667034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.667303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.681300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.683074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.688346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.690150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.701131 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 71/139] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:26.704229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 69/140] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:26.710533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.715550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.725898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4b220-5dec-4033-99a8-6cee3bae2b46 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.728366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c47728-dda1-44b8-ad92-076c17ba3e53 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.736304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.737198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.737480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.737754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.738817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.739656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.739926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.740194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.741428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.743490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.748672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 72/141] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:26.750132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.752168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.756713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.762774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 70/142] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:26.769050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:26.776912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4b3d-48a3-4c1b-b61f-3d42fd94e1e1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.781949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f44f-fac0-4600-a9a5-1a7215a8160b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:26.791727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.792385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.792691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.792975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.793824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:26.794135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.796521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dad87-00b8-4a28-b359-fa9aa31392a7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.800752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:26.801415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:26.801696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:26.802023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:26.802869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:26.803179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:26.808276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceefed-5a39-4362-b1e3-c581d39e5dc3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:26.817517 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 73/143] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=4aa20354184f48969579623c64fd58fc => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:26.822514 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 71/144] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:26 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:27.446465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7486-8f61-4f23-91d7-0fbc09d6a334 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.447448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7486-8f61-4f23-91d7-0fbc09d6a334 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.447933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7486-8f61-4f23-91d7-0fbc09d6a334 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.449958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 74/145] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:27.458484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.459400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.459885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.481883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:27.483457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:27.494884 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 72/146] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:27.540240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d7486-8f61-4f23-91d7-0fbc09d6a334 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.558531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d7486-8f61-4f23-91d7-0fbc09d6a334 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.563363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.564400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.564902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.565389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.579916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:27.587185 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:27.588950 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 75/147] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:27.595787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.605299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0261f8e-85c5-490f-bb77-c18cb1c0141a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.612559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.613480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.613957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.614434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.615571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:27.616072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:27.617942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:27.635721 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 73/148] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:27.642081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.653630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa5be-741d-4d9c-93a9-933182e100c0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.660168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.661366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.661865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.662403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.664227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:27.666337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:27.668220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 76/149] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:27.674618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.685609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1a3e0-476c-4637-b56d-1b3f0fc1e3a0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.691976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.692940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.693453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.694231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.709823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:27.711936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:27.723491 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 74/150] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:27.729848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.741919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca2c74-7d48-405e-a8ca-29bfe52db71b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.747509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.748760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.749274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.749798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.753425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:27.755765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a577b5-bc1d-4974-a744-b60bcc9515b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:27.757742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:27.764915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:27.774497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c6d28-c26a-48c2-8045-7eb694140685 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:27.781655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:27.782673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:27.783162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:27.785583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:27.786665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:27.787210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:27.789416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8149-5ab8-42c0-8357-6925990535b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:27.796427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 75/152] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:27 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.070774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ac32-6de3-4974-b306-99a7d219ab70 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.071109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ac32-6de3-4974-b306-99a7d219ab70 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.071222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ac32-6de3-4974-b306-99a7d219ab70 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.073306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 78/153] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:28.087954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.088564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.089081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.112334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:28.113856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:28.127610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 76/154] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:28.174238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099ac32-6de3-4974-b306-99a7d219ab70 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.191384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099ac32-6de3-4974-b306-99a7d219ab70 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.200861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.201669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.202057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.202338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.217864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:28.224785 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:28.226003 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 79/155] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:28.232470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.246605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96dee-4954-4ce3-91f8-4752d4d3e979 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.256166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.256990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.257339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.257684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.258530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:28.258951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.260714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.273285 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.279941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.294177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506700da-620b-47ae-84eb-d238705c156b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.304886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.306115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.306575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.307036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.308530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.310919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.313496 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 80/157] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.320321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.333844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd351e-7baf-42b3-964f-3b048b72c0d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.349388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.350059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.350335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.350606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.361132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.362920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.375744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 78/158] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:28.381734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.398125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9720-16c1-4af7-b2c5-16e332409f1b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.404557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.405681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.406160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.406651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] PATH_INFO: `/v3/projects/a210aedaae3649bea6079458bde4c633` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.408072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] RBAC: Authorizing `identity:get_project(project_id=a210aedaae3649bea6079458bde4c633)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.410354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2124-f5f0-4c9d-981f-444916a6ff35 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.412546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 81/159] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/projects/a210aedaae3649bea6079458bde4c633 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.419419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.433551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47965c-430d-48c7-8c53-6c630d6b3008 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.440789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.441488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.441765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.442037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.442875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=a210aedaae3649bea6079458bde4c633, user.id=99765343c3fa4367bcfd7aae4fb07ab0) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:28.443177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.445482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.452186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a44c-7f73-4c74-8988-267ea7e67977 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.452683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a44c-7f73-4c74-8988-267ea7e67977 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.452863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a44c-7f73-4c74-8988-267ea7e67977 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.454552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 82/160] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:28.456816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 79/161] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/role_assignments?user.id=99765343c3fa4367bcfd7aae4fb07ab0&scope.project.id=a210aedaae3649bea6079458bde4c633&role.id=4aa20354184f48969579623c64fd58fc => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.463928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.464528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.465068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.485231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:28.486824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:28.494895 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 83/162] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:28.522281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.535675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2455f-eb86-407f-8b3c-eb13d0e8ea6c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.545247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.546581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.546859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.547128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.563574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:28.571031 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:28.572625 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 80/163] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:28.579371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.594811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25f6c-ba92-40c0-9eaa-ee6cc6ba49a0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.599565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.600479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.601084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.601633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.602600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:28.603090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.605146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.615232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 84/164] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.621444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.638989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2503f-cf78-43c2-a3ba-e13967c516fd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.646263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.647139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.647417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.647679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.674392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.676558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.678629 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 81/165] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.684856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.697554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8dde3-9fc4-4e5a-9b3a-dd5100f7b0a2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.702576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.703534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.704017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.704478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.720085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.722209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.732797 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 85/166] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:28.743751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.763385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b33d77-4167-4ac3-85eb-5b637751a6f8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.772895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.773778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.774055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.774323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.777644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.779722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e4527-f398-4294-8320-b2d4ef9f4192 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.782074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:28.788552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:28.801777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd8a-ef50-4d06-8ddc-25e74bee4c94 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:28.806904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:28.807959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:28.808465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:28.808946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:28.810028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=7064396c92904d19b1383fecfb8fcf55) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:28.810524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:28.813813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625efc3-bfc2-48d2-84e8-b892ce08bbc7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:28.823968 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 86/168] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:28 2021] GET /identity/v3/role_assignments?user.id=7064396c92904d19b1383fecfb8fcf55&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=4aa20354184f48969579623c64fd58fc => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.131039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe060e-b6a5-49c0-9128-5d2d8f9ee3e6 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.131370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe060e-b6a5-49c0-9128-5d2d8f9ee3e6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.131584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe060e-b6a5-49c0-9128-5d2d8f9ee3e6 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.133389 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 83/169] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:29.141285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.141859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.142323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.165921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:29.167546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:29.175877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 87/170] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:29.202872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe060e-b6a5-49c0-9128-5d2d8f9ee3e6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.215804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe060e-b6a5-49c0-9128-5d2d8f9ee3e6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.220657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.221693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.222181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.222649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.235925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:29.243716 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:29.245508 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:29.253213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.263246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3acbdf-2049-4ea9-ab5a-4f81facec7c6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.268225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.269183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.269672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.270163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.271114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:29.271601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.273623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.282813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 88/172] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.289345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.300982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9bb6-eb48-4657-8f52-f6a7efe6ae4a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.306096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.307258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.307745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.308400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.309851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.312501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.319682 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 85/173] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.321279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.333308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11f34-aecf-4971-9c8a-99550ccaa2e6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.338108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.339009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.339502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.340005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.348985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.351043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382e17f-ddae-49eb-9e08-0a6b1a00785d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.360827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 89/174] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:29.367240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.377579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c293-ba86-4573-95f5-e09d80f79b5f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.382729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.384154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.384683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.385168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.385785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50feb-9655-40ec-adbd-cca21d1c89be None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.386069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50feb-9655-40ec-adbd-cca21d1c89be None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.386333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50feb-9655-40ec-adbd-cca21d1c89be None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.387464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.388177 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 90/175] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:29.390544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.392852 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 86/176] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.398529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.398529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.398529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.400456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.412111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb180af-002e-409f-aece-abda4e6952ba admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.417127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.417491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:29.418059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.418464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.418831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.419296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:29.419980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:29.421111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.423438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.428836 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 91/177] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:29.436698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 87/178] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:29.456600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.467021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee742aa-408c-413b-9e04-9064132795d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.472401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.473482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.473905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.474316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.475732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.477619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab2271-7536-48ec-96cb-0060786e04a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.479437 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 88/179] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.487341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.497417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916952b-496c-4f9d-8cd9-48b8a073cea2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.502394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.503308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.503745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.504152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.505086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.506262 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:29.506262 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:29.506262 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:29.507775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c0088-f262-4101-9580-567928a8c577 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.538178 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 92/180] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:29 2021] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:29.546294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947395-1d38-437d-841d-fc0e1c3eef4e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.547275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947395-1d38-437d-841d-fc0e1c3eef4e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.547770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947395-1d38-437d-841d-fc0e1c3eef4e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.549932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 89/181] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:29.558013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.558304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.558567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.579473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:29.580758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:29.588932 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:29.616259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78947395-1d38-437d-841d-fc0e1c3eef4e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.630050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78947395-1d38-437d-841d-fc0e1c3eef4e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.635436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.636723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.637283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.637769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.650774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:29.659344 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:29.660991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:29.670205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.678531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb773ec-53eb-4d6f-8712-1c9434b1e23c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.683920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.684725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.684918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.685189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.685967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:29.686300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.687938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.698268 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 94/184] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.705035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.716881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faac41-3c65-470b-8b36-af569fef88c7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.722465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.723404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.723738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.724012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.725503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.727832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.729912 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 91/185] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.735902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.746542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1f57d-60f3-4b3e-b0a8-fd350ebce4ef admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.751590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.752312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.752596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.752901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.762084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.763973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.774415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 95/186] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:29.781715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.791786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bbc4a-1762-42a9-9692-16532078776c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.797150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.798004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.798287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.798544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.799751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.801859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405cfb1-2f71-40bb-8bdd-88ce3f6a7f2f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.803970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 92/187] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:29.812908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:29.822448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb126b-6801-48c1-b25a-814ed7f738b6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:29.827935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:29.828583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:29.828912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:29.829175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:29.830017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=7064396c92904d19b1383fecfb8fcf55) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:29.830324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:29.832146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d71d-55a7-4e3e-b698-c19158d56f8b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:29.838458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 96/188] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:29 2021] GET /identity/v3/role_assignments?user.id=7064396c92904d19b1383fecfb8fcf55&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:31.426338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302531-e03d-4196-b384-c50052201a84 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.426862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302531-e03d-4196-b384-c50052201a84 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.427139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302531-e03d-4196-b384-c50052201a84 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.429301 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 93/189] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:31.438787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.439300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.439521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.469935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:31.471111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:31.484807 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 97/190] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:31.518812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302531-e03d-4196-b384-c50052201a84 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:31.535353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302531-e03d-4196-b384-c50052201a84 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:31.542593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:31.543373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.543722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.543994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.558437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:31.565895 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:31.567377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 94/191] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:31.573982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:31.585463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6bdeb-6ef8-4d2c-b50a-cb469edbada3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:31.593920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:31.594584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.594856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.595128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.595885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:31.596182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:31.597793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:31.613044 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 98/192] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:31.619480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:31.633476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f717a0-32de-48b2-8f65-d23ca13f4254 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:31.641202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:31.642061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.642337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.642607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.643984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:31.646107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:31.647991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 95/193] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:31 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:31.654367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:31.669408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3149-ab76-4563-93b6-c96e31d158a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:31.674519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:31.675354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.675628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.675892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.681382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:31.683466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3215f1-662a-4a86-8d27-fa2593bdc4af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:31.685475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 99/194] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:31 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:31.692590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:31.812215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996f1e-e899-4433-98c1-6053f8599a2d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:31.816679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:31.817541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:31.817815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:31.818084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/7064396c92904d19b1383fecfb8fcf55/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:31.820290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9200e8495e40bbbba9c0636aee9423, user_id=7064396c92904d19b1383fecfb8fcf55, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:31.822848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859ebb-ad97-4f2a-be30-7dbe3768ca83 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:31.838987 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 96/195] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:31 2021] PUT /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/7064396c92904d19b1383fecfb8fcf55/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:32.306518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b74-99c0-4d21-9913-186f151862ee None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.307030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b74-99c0-4d21-9913-186f151862ee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.307444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b74-99c0-4d21-9913-186f151862ee None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.309627 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 100/196] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:32.317902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.318399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.319073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.344513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:32.345939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:32.423314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 97/197] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:32.469595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6b74-99c0-4d21-9913-186f151862ee None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.490045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6b74-99c0-4d21-9913-186f151862ee None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.496460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.501434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.502041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.502470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.519999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:32.533960 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:32.535551 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 101/198] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:32.542575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.554227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a320f-19db-4ebf-bcf8-0e3b77eeac89 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.564303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.565168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.565582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.565990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.566909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:32.567348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:32.569403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:32.578576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 98/199] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:32.585035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.602382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee03f-c57b-4f97-a44a-e9d683e8d611 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.610289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.611439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.611854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.612259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.613756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:32.615745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:32.618060 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 102/200] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:32.624478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.634844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38422749-0d0d-43a4-aed3-7f84d77547f8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.644806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.645849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.646263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.646668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.653351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:32.656089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71985afc-951b-41f7-a495-5027d1f78e24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:32.657947 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 99/201] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:32.664254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.677503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838ad4-e5c8-4a10-9cc9-7aee1627f9f6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.682725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.683834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.684249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.684681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.689511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9200e8495e40bbbba9c0636aee9423, user_id=68e2062e0f2c4721be375c86224003a3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:32.691490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717b888-4077-4595-8690-0f53be7a6251 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.691773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717b888-4077-4595-8690-0f53be7a6251 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.692042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717b888-4077-4595-8690-0f53be7a6251 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.692909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa824f-6943-4b1f-a250-c83898fade0d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:32.696731 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 100/202] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:32.703931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737172-d201-43cb-8898-48949c1765ec None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.704227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737172-d201-43cb-8898-48949c1765ec None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.704520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737172-d201-43cb-8898-48949c1765ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.723036 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:32 2021] PUT /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/68e2062e0f2c4721be375c86224003a3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:32.731294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fd737172-d201-43cb-8898-48949c1765ec None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:32.732550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fd737172-d201-43cb-8898-48949c1765ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:32.772425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbc23-a3c0-4ed6-8dc0-90e0de5ce06e None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.772764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbc23-a3c0-4ed6-8dc0-90e0de5ce06e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.772988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbc23-a3c0-4ed6-8dc0-90e0de5ce06e None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.775139 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 104/204] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:32.782947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32d50-fe8d-46ed-ac2a-e9b4e95a42cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.783275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32d50-fe8d-46ed-ac2a-e9b4e95a42cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.783484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32d50-fe8d-46ed-ac2a-e9b4e95a42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.813637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-71e32d50-fe8d-46ed-ac2a-e9b4e95a42cc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:32.814890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71e32d50-fe8d-46ed-ac2a-e9b4e95a42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:32.856936 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 101/205] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:32.916579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773760c9-d70a-4cb9-95de-a7c9cfd61a66 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.916936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773760c9-d70a-4cb9-95de-a7c9cfd61a66 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.917212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773760c9-d70a-4cb9-95de-a7c9cfd61a66 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.917492 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 105/206] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:32.919458 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 102/207] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:32.927694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.927982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.928269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.949300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773760c9-d70a-4cb9-95de-a7c9cfd61a66 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.954045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:32.955259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:32.963515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773760c9-d70a-4cb9-95de-a7c9cfd61a66 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.964351 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 106/208] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:32.966421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:32.976208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4b82-dfc8-4116-9116-0763f931e60d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:32.978157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.978964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.979237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.979502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.981893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:32.982663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:32.983506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:32.983776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:32.994470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:33.001689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:33.002523 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:33.004071 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 107/209] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:33.009123 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:33.010955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.015767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 103/210] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:33.017217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.025121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34791-3086-41f3-98ef-d75eeb2d67ab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.028563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5010-d5b7-41d4-a142-4ec6aa9e88f5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.030346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.030973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.031293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.031627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.032549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:33.032816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.033134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.033778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.034052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.034322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.034501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.035069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:33.035366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.037578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.044221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 108/211] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:33.044869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.047618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 104/212] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:33.053341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.055679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711630-32e7-4714-94a1-07ebcb94336f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.060331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.061829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.062103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.062366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.063554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.065334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.066049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18609e-ccb5-4e9f-8214-1b3f99e5dd45 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.066848 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:33.067575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.071405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.072440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.072940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.073415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] PATH_INFO: `/v3/users/519e38a89c1e42939d0071914bdd9b89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.082217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0d36c-fd57-4e52-91bc-33dd5230ad47 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.086860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.087742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.088076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.088389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.089666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.089978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=519e38a89c1e42939d0071914bdd9b89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.091978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.092925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.094306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 110/214] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:33.099636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.100517 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 105/215] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/users/519e38a89c1e42939d0071914bdd9b89 => generated 293 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:33.102540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.105963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2181-58fa-4ee6-9a82-124a53796f84 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.111832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.112557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.113030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.113435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.114318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.115613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96c05-2a10-4f87-b2b2-ccc99d68a3b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.116896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.121250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.125901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.126784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.127551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.129670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.131941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.133873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 106/216] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:33.139493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.142053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 111/217] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:33 2021] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:33.149777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:33.157449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489effbd-f299-4a66-9869-1cce8a5faaaa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.166524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.167206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.168787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.168998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.170169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, user.id=519e38a89c1e42939d0071914bdd9b89, scope.system=all) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:33.171106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.173791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623682-4839-434f-9878-61d683b3643e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:33.179567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:33.180479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:33.180779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:33.181048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/7064396c92904d19b1383fecfb8fcf55/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:33.181309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4d79-ecca-483f-9814-cf384031235e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.183338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9200e8495e40bbbba9c0636aee9423, user_id=7064396c92904d19b1383fecfb8fcf55, role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:33.186200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc71857-1143-407a-a010-62c83e2ae52d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:33.195072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 107/218] 10.222.0.13 () {56 vars in 1329 bytes} [Wed Nov 10 03:42:33 2021] GET /identity/v3/role_assignments?user.id=519e38a89c1e42939d0071914bdd9b89&scope.system=all&role.id=4aa20354184f48969579623c64fd58fc => generated 226 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:33.212882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 112/219] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:42:33 2021] PUT /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423/users/7064396c92904d19b1383fecfb8fcf55/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:34.952772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdecc2e-725f-42ea-9038-6fd98f377d97 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:34.953275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdecc2e-725f-42ea-9038-6fd98f377d97 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:34.953347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdecc2e-725f-42ea-9038-6fd98f377d97 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:34.955227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 108/220] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:34.962370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:34.962821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:34.962894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:34.985367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:34.986581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:35.058655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 113/221] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:35.101000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdecc2e-725f-42ea-9038-6fd98f377d97 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.113283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdecc2e-725f-42ea-9038-6fd98f377d97 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.120348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.121413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.121902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.122362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.141463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:35.148631 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:35.150030 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 109/222] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:35.157044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.169627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76bf7-9408-465f-a0cd-dd785dd252e5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.174286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.174950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.175225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.175502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.176262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:35.176560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.182268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.191238 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 114/223] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.197462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.213725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f499fe-d877-4bd4-a9df-b7e8fe88985a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.223015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.224177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.224943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.225408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.226888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.229271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.231390 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 110/224] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.237205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.248531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea19532-a3d8-4ee4-86fa-8a03c4a13056 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.252869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.253504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.253800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.254049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.269067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.270786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.286373 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 115/225] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:35.292127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.305540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520edb-51fd-4e09-9bdb-b27253faf8a0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.314893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.316065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.316535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.317092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.319910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.322213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca324bc-4755-4a31-8fff-e49e5207212c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.324083 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 111/226] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.331136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.346173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4917-5ecf-4972-be55-96b8316f31fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.350553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.351251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.351470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.351739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.352573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=7064396c92904d19b1383fecfb8fcf55) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:35.352902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.354699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b956d82-ae2d-4f49-b663-f33420613fe8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.365032 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 116/227] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/role_assignments?user.id=7064396c92904d19b1383fecfb8fcf55&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=4aa20354184f48969579623c64fd58fc => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.591186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a3702-f265-4017-9c79-4e93c9e267e8 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.591928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a3702-f265-4017-9c79-4e93c9e267e8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.592526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a3702-f265-4017-9c79-4e93c9e267e8 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.594649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 112/228] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:35.611385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.611657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.611849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.633924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:35.635106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:35.648231 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 117/229] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:35.693236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a3702-f265-4017-9c79-4e93c9e267e8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.711851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a3702-f265-4017-9c79-4e93c9e267e8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.716779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.718374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.718883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.719342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.735151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:35.742685 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:35.744304 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 113/230] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:35.750969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.766811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf056ee-29e4-4295-be95-2f5ec3fd53d3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.775945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.776693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.776975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.777243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.778029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:35.778328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.780591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.794848 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 118/231] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.806383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.835345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f717a-5087-4cad-85b4-e8b3569fc962 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.840466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.841644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.842694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.843178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.845784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.847848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.849825 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 114/232] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.856094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.870102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809b10-0811-4e15-9264-f396399fe1e9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.874609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.875350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.875630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.875896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.896736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.898527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.915153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:35.921084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.934016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3258-6311-413e-b793-ec792453baee admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.943051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.944465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.945035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.945514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.949348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.952241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b8d12-fb05-4abc-99f1-0f053c5d5a80 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.954275 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 115/234] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:35.960750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:35.973535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba85b8-cb5a-49e6-a5ff-ae3cb76628e4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:35.977966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:35.978614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:35.978888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:35.979154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:35.979994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=68e2062e0f2c4721be375c86224003a3) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:35.980300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:35.982132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a03c0-35e1-45bb-951d-b582fcb1bf10 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:35.993203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 120/235] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:35 2021] GET /identity/v3/role_assignments?user.id=68e2062e0f2c4721be375c86224003a3&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.496630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6a3-8193-49a1-81a1-f9c289606f64 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.496630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6a3-8193-49a1-81a1-f9c289606f64 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.496630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6a3-8193-49a1-81a1-f9c289606f64 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.497363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 116/236] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:36.509778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa24ae-3af0-4ab7-863d-848135fd6683 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.510058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa24ae-3af0-4ab7-863d-848135fd6683 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.510320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa24ae-3af0-4ab7-863d-848135fd6683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.530416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-51aa24ae-3af0-4ab7-863d-848135fd6683 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:36.531586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51aa24ae-3af0-4ab7-863d-848135fd6683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:36.546056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 121/237] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:36.569541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adbb7-feea-4ee6-b6f4-46eb8408ec48 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.570123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adbb7-feea-4ee6-b6f4-46eb8408ec48 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.570589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adbb7-feea-4ee6-b6f4-46eb8408ec48 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.572816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 117/238] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:36.580386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10074021-4d32-4144-9349-7ee78caea415 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.580685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10074021-4d32-4144-9349-7ee78caea415 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.580957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10074021-4d32-4144-9349-7ee78caea415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.582321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77adbb7-feea-4ee6-b6f4-46eb8408ec48 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.594522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77adbb7-feea-4ee6-b6f4-46eb8408ec48 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.601654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.603623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.603895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.604163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.606191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-10074021-4d32-4144-9349-7ee78caea415 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:36.609233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-10074021-4d32-4144-9349-7ee78caea415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:36.619546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:36.621598 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 122/239] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:36.632649 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:36.632649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 118/240] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:36.634716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10074021-4d32-4144-9349-7ee78caea415 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.645165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10074021-4d32-4144-9349-7ee78caea415 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.650454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.652848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.653620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.653903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.654170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.654972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:36.655272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.657135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.661132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a4b8-7067-4d2b-9cf0-d39f9d0ea1bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.671494 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 123/241] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.671682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.671682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.671682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.671682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.673264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.685754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd441-aacf-4c53-965c-926d4466a520 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.688359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:36.692029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.693205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.693705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.694410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] PATH_INFO: `/v3/users/519e38a89c1e42939d0071914bdd9b89` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.695846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] RBAC: Authorizing `identity:get_user(user_id=519e38a89c1e42939d0071914bdd9b89)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.698316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.699625 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:36.704635 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 119/243] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:36.704766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 124/243] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/users/519e38a89c1e42939d0071914bdd9b89 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.707784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.708489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.721135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d89a-c61e-4f76-b098-49bed6683edb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.721618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cfbf0-0f7b-444e-bc4a-8d3190d85416 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.727208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.727861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.729003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.729276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.729540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.729941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.730204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.730464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] PATH_INFO: `/v3/system/users/519e38a89c1e42939d0071914bdd9b89/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.731550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:36.731845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.734305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.734473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=519e38a89c1e42939d0071914bdd9b89, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.735434 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:36.735434 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:36.735434 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:36.736377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.746097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 120/244] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.751268 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 125/245] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 03:42:36 2021] PUT /identity/v3/system/users/519e38a89c1e42939d0071914bdd9b89/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:36.752672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.770782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20b9a-39a1-4d97-8bb2-ed250600769b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.775688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.776572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.777135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.777416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.778829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.781319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.783767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 121/246] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.789611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.803747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c89f-8d77-4030-b94b-f215a3e6e46f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.809338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.810048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.810380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.810657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.821162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.823056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.836299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 126/247] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:42:36.843028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.853280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536cfff-f689-4cad-99e7-a92749681e26 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.858662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.859535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.859814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.860086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.861346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.863427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda4a08-83d8-49b8-bc51-0b491b4017be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.865635 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 122/248] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:36.872145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:36.881592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef785f-59e6-421e-bd4a-6d39c923dd0f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:36.886591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:36.887241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:36.887521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:36.887812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:36.888706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=eb9200e8495e40bbbba9c0636aee9423, user.id=7064396c92904d19b1383fecfb8fcf55) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:36.889048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:36.891243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5d34-3cea-4439-b5f3-f898908e5baa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:36.898284 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 127/249] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:36 2021] GET /identity/v3/role_assignments?user.id=7064396c92904d19b1383fecfb8fcf55&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:37.112160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8ea0-f1f9-45ec-ab2f-4301e763fa31 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.112730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8ea0-f1f9-45ec-ab2f-4301e763fa31 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.112730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8ea0-f1f9-45ec-ab2f-4301e763fa31 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.114438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 123/250] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:37.122590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.123120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.123234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.144213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:37.145463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:37.153250 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 128/251] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:37.180172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8ea0-f1f9-45ec-ab2f-4301e763fa31 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.195249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8ea0-f1f9-45ec-ab2f-4301e763fa31 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.200083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.200949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.201272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.201583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.213862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:37.222456 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 03:42:37.224137 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 124/252] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:37 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:37.231258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.242639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cf1f1-4b32-4bfe-8de8-2516edc6d995 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.246898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.247547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.247823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.248326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.249626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:37.249927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:37.251498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:37.260171 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 129/253] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:37 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:37.266054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.276384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0049b0-6f3c-45d8-8959-3073d99e0432 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.280862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.281705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.282038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.282308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] PATH_INFO: `/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.296166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] RBAC: Authorizing `identity:get_user(user_id=1f18c065b2e14bbdad91b93fe0dcddf2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:37.298365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5a64-3f64-4d16-8f69-1f8774553ede admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:37.300227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 125/254] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:37 2021] GET /identity/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:37.306373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.316793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171586b-c90a-499c-8881-5afebfa0af7e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.321438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.322120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.322400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.322674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.323564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] RBAC: Adding query filter params (role.id=ad5190b4a46b4726a93871bcf5ec3760, user.id=1f18c065b2e14bbdad91b93fe0dcddf2, scope.system=all) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:37.323871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:37.325861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aa6d-5a25-41ea-bea2-4470db968ec4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:37.333078 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 130/255] 10.222.0.13 () {56 vars in 1329 bytes} [Wed Nov 10 03:42:37 2021] GET /identity/v3/role_assignments?user.id=1f18c065b2e14bbdad91b93fe0dcddf2&scope.system=all&role.id=ad5190b4a46b4726a93871bcf5ec3760 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:37.344190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6448-8cc4-4a51-8294-5a63c5930fe3 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.344682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6448-8cc4-4a51-8294-5a63c5930fe3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.345057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6448-8cc4-4a51-8294-5a63c5930fe3 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.347062 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 126/256] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:37.355272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.355596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.355811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.482150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:37.483897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:37.491778 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 131/257] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:37.516701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6448-8cc4-4a51-8294-5a63c5930fe3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.528809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6448-8cc4-4a51-8294-5a63c5930fe3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.533042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.533830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.534104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.534371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.535529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:37.537224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f4c99-6576-47e0-9cfc-e0fd6019fc03 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:37.539232 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 127/258] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:37.545849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:37.555090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0d67-010b-4972-9fd2-a20d527af307 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:37.560570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:37.561935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:37.562281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:37.562622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:37.563397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:37.564488 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:37.564488 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:37.564488 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:37.565825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30b92-061c-4cca-95aa-b80a8a815efe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:37.581822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 132/259] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 03:42:37 2021] POST /identity/v3/groups => generated 229 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:42:39.151981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed1de-c1cc-4aaa-a28a-6c39a16e844d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.152476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed1de-c1cc-4aaa-a28a-6c39a16e844d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.152550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed1de-c1cc-4aaa-a28a-6c39a16e844d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.154385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 128/260] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:39.161506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.161949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.162100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.179853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:39.181064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:39.189284 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 133/261] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:39.215373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eed1de-c1cc-4aaa-a28a-6c39a16e844d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.227409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eed1de-c1cc-4aaa-a28a-6c39a16e844d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.231601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.232374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.232706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.233013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.243016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:39.250440 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:39.251753 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 129/262] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:39.257823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.267197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810d9b-5b7f-4202-81f1-6eb7139244b4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.271434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.272086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.272367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.272809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.273569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:39.273870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.275436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.283816 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 134/263] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:39.289702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.300946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c39d5-86a5-469d-bdd5-f38322365c1a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.305352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.306204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.306482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.306758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] PATH_INFO: `/v3/users/519e38a89c1e42939d0071914bdd9b89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.307962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=519e38a89c1e42939d0071914bdd9b89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.310088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a7879-4a60-4566-86ac-6e1bfeb200a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.312525 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 130/264] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/users/519e38a89c1e42939d0071914bdd9b89 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:39.318690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.329186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e941595-ce4a-48a8-a1a4-982d37e798d4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.333459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.334187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.334535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.334879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.335777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] RBAC: Adding query filter params (role.id=4aa20354184f48969579623c64fd58fc, user.id=519e38a89c1e42939d0071914bdd9b89, scope.system=all) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:39.336151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.338072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4e352-c4ab-4155-8289-b576cc9c5121 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.352740 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 135/265] 10.222.0.13 () {56 vars in 1329 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/role_assignments?user.id=519e38a89c1e42939d0071914bdd9b89&scope.system=all&role.id=4aa20354184f48969579623c64fd58fc => generated 510 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:39.651375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08b40-e9af-4402-b94e-e7361e49ffba None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.651656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08b40-e9af-4402-b94e-e7361e49ffba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.651923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08b40-e9af-4402-b94e-e7361e49ffba None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.653723 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 131/266] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:39.660722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.661080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.661424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.679085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:39.680276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:39.688233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 136/267] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:39.712287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08b40-e9af-4402-b94e-e7361e49ffba None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.723925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08b40-e9af-4402-b94e-e7361e49ffba None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.728030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.728812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.729084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.729352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.739557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:39.746318 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 03:42:39.747429 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 132/268] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:39.754424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.763158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035faf-d8d4-4f3d-ad11-d8586089a860 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.767416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.768056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.768329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.768599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.769384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:39.769685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.771283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.780592 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 137/269] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:39.787008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.797634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57f036-1f91-49f9-a420-65bec633d048 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.802094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.803326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.803326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.803533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] PATH_INFO: `/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.804788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f18c065b2e14bbdad91b93fe0dcddf2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.806894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5d4b7-00e7-4109-8b4b-bb16677d1363 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.808539 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 133/270] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:39 2021] GET /identity/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:39.815530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:39.825343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e8c1-5cae-4f20-8111-e4af994c9e51 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:39.829672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:39.830503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.830778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.831046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] PATH_INFO: `/v3/system/users/1f18c065b2e14bbdad91b93fe0dcddf2/roles/ad5190b4a46b4726a93871bcf5ec3760` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.832522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f18c065b2e14bbdad91b93fe0dcddf2, role_id=ad5190b4a46b4726a93871bcf5ec3760)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:39.834123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f8c1a-2bc6-4f76-8672-def2a3af7994 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:39.840865 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 138/271] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 03:42:39 2021] PUT /identity/v3/system/users/1f18c065b2e14bbdad91b93fe0dcddf2/roles/ad5190b4a46b4726a93871bcf5ec3760 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:39.936316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb146a9-8486-4697-9868-11e640cd177a None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.936571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb146a9-8486-4697-9868-11e640cd177a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.936809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb146a9-8486-4697-9868-11e640cd177a None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.938654 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 134/272] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:39.946984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:39.947270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:39.947544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:39.965884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:39.967608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:39.975157 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 139/273] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:40.001218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb146a9-8486-4697-9868-11e640cd177a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:40.013502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb146a9-8486-4697-9868-11e640cd177a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:40.017745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:40.018539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:40.018816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:40.019090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:40.020269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:40.021999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79020c75-e834-4295-b002-c0b6be2ea60f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:40.023636 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 135/274] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:40.030528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:40.039912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869f15-c14e-448f-a5db-efc4fc392ad6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:40.044214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:40.044917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:40.045854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:40.046121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:40.046843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:40.048741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8bab9-293c-4794-8bd8-42b0160eb191 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:40.063362 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 140/275] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 03:42:40 2021] POST /identity/v3/groups => generated 226 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:42.990470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee51-2f29-49e6-83a5-2efbe972ac94 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:42.991003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee51-2f29-49e6-83a5-2efbe972ac94 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:42.991003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee51-2f29-49e6-83a5-2efbe972ac94 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:42.993118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 136/276] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:43.001893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.002349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.002512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.024117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:43.025347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:43.039430 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 141/277] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:43.090553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ee51-2f29-49e6-83a5-2efbe972ac94 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.104844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ee51-2f29-49e6-83a5-2efbe972ac94 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.115133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.115920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.116191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.116454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.131085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:43.138090 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:43.139388 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 137/278] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:43.146292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.156217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543282-cf9d-40bf-a680-e82f5a1573b8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.164703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.165376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.165650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.165922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.166686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.166980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.168546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890811-4611-465e-ad6d-fa88b62ae886 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.183095 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 142/279] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.189150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.204374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e20ca-f718-4088-9de6-0d7a857c4b2b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.209004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.209648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.209923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.210190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.212176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758d56-8ee4-4d3a-a5d4-2459147ebdd4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.212446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758d56-8ee4-4d3a-a5d4-2459147ebdd4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.212733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758d56-8ee4-4d3a-a5d4-2459147ebdd4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.214498 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 143/280] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:43.222195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ebe6-9843-44d1-9fc5-0c2ac4d97ad7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.222538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ebe6-9843-44d1-9fc5-0c2ac4d97ad7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.222806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ebe6-9843-44d1-9fc5-0c2ac4d97ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.241288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.242996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a994ed2-dfff-46b9-a831-d8b0aebbd1a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.253320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e177ebe6-9843-44d1-9fc5-0c2ac4d97ad7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:43.254496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e177ebe6-9843-44d1-9fc5-0c2ac4d97ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:43.260494 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 138/281] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:43.266465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6753bd-3e5d-45c9-ad8f-e1e62655ab79 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.266743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6753bd-3e5d-45c9-ad8f-e1e62655ab79 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.267015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6753bd-3e5d-45c9-ad8f-e1e62655ab79 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.268886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 139/282] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:43 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:43.272648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6753bd-3e5d-45c9-ad8f-e1e62655ab79 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.277677 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 144/283] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:43.278766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703101da-38d9-4e4e-b72d-3bc7c06e5e83 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.279044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703101da-38d9-4e4e-b72d-3bc7c06e5e83 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.279911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703101da-38d9-4e4e-b72d-3bc7c06e5e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.296814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6753bd-3e5d-45c9-ad8f-e1e62655ab79 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.301342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.302199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.302508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.302739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.303947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.306019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b055334-c8bf-44a5-8ea7-52da9e361110 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.308017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-703101da-38d9-4e4e-b72d-3bc7c06e5e83 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:43.308310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 140/284] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.309246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-703101da-38d9-4e4e-b72d-3bc7c06e5e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:43.309568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f698-2747-4f3b-ab42-767b6a3aecf2 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.309850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f698-2747-4f3b-ab42-767b6a3aecf2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.310234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f698-2747-4f3b-ab42-767b6a3aecf2 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.312232 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 141/285] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:43.315911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f698-2747-4f3b-ab42-767b6a3aecf2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.328727 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 145/286] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:43.329906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.330190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.330458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.331178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f698-2747-4f3b-ab42-767b6a3aecf2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.350621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.351400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.351670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.351937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.357100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:43.358334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:43.359568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.360769 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:43.360769 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:43.360769 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:43.362194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.364117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 142/287] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.365060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.369664 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 146/288] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:43.370333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.379605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499758d1-46b2-4f64-8f02-13951df43d07 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.380758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d67a-8d14-4d33-8d6c-04d0de9904e2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.384428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.385279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.385559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.385776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.385916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.386805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.387218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.387621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.398514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:43.403062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:43.405909 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:43.407399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:43.408714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.411689 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 03:42:43.413129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 143/290] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:43.414360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.423095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567a09-743d-4e4a-97be-a7249fca954e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.425291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023317-8252-4bd8-8e77-9aaef919ec7e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.435643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.436302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.436490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.436595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.436868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.437665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.437765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.437999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.438476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.438934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.439813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.440086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.440583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.442352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.446506 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 148/291] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=4aa20354184f48969579623c64fd58fc => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.447382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.460422 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 144/292] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.461139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.466343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1afee-ef6f-4b7b-a4cb-00fbaac0301e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.472797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.473480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.473759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.474033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.474808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.475111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.476800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.481110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679c25-a103-441a-9ab5-3ae9cb194f04 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.486493 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 149/293] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.487472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.497932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1ee0-8f67-4340-873a-9744184c344f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.501843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.502602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.502717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.503022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.503180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.503281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.503508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.503871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.512502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.515181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.526295 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 150/294] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:43.527267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.542694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:43.550359 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:43.551799 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 145/295] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:43.552395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.563293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ab21-4594-4790-b7fd-76c3ecd93736 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.567330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacdb3-8762-4bb1-93ee-b33ad56470cc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.589480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.590489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.591877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.592984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.593260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.593658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] PATH_INFO: `/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.594933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] RBAC: Authorizing `identity:get_user(user_id=1f18c065b2e14bbdad91b93fe0dcddf2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.597363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.599470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.603325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.608639 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 151/296] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/users/1f18c065b2e14bbdad91b93fe0dcddf2 => generated 293 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.608639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.609058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.609201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.612634 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 146/297] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.618877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.636647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa16d-020e-4143-ab7c-21ec73968d4e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.646641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e536046-18f1-46f5-8943-cfa9a52c0b9f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.654333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.654965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.655772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.655772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.656268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.656572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.658227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.665314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.665973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.666243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.667237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.667398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] RBAC: Adding query filter params (role.id=ad5190b4a46b4726a93871bcf5ec3760, user.id=1f18c065b2e14bbdad91b93fe0dcddf2, scope.system=all) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.667637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.669527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.689202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 152/298] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.690069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.713844 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 147/299] 10.222.0.13 () {56 vars in 1329 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/role_assignments?user.id=1f18c065b2e14bbdad91b93fe0dcddf2&scope.system=all&role.id=ad5190b4a46b4726a93871bcf5ec3760 => generated 510 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.723215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657902a-78c8-4f5a-aac4-2d4580f0dee6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.724249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.742342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.742342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.742342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.742342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.743091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 153/300] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.745985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f201-dcb9-4de7-9799-3e517aee3630 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.753442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.759350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.764767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.764767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.764767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.772663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae2e6-875b-4c52-a01c-d0e5e6c21191 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.778539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.780344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.782319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.782984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.788865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.788865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.788865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=eb9200e8495e40bbbba9c0636aee9423) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.788865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.788865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.806391 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 148/301] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:43.807547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 154/302] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=4aa20354184f48969579623c64fd58fc => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.818161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.839278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf3ea-d634-4599-87a6-1962933b5721 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.853466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.854580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.855007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.855722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.865502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.867936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.870377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 149/303] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.878652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.893854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d32c2-ddc4-43f7-9d3d-af61d2b08bfe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.905150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.906262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.906707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.907120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.908542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.910609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cfb7c-7d84-45fa-b421-fde2ad52f0ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.913169 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 155/304] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:43.919461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:43.930782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576542-d50e-4f25-8019-7a0466164fdf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:43.940640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:43.941551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:43.941971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:43.942404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:43.943392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:43.944125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:43.946123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b2bc-c7f5-4dd6-af11-6618ce415c80 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:43.952623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 150/305] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:43 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:44.623966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651b09-c694-4225-ba63-4e7cd4ca7ce9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.624840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651b09-c694-4225-ba63-4e7cd4ca7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.625276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651b09-c694-4225-ba63-4e7cd4ca7ce9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.627184 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 156/306] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:44.634694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.635472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.635890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.661837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:44.663344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:44.680667 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 151/307] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:44.725991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651b09-c694-4225-ba63-4e7cd4ca7ce9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.742240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651b09-c694-4225-ba63-4e7cd4ca7ce9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:44.752478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:44.753452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.753869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.754278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.770890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:44.777813 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:44.779443 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 157/308] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:44.786035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.802965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f01a0f-fd56-4830-b5b1-5693646ad28b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:44.810310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:44.811708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.812081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.812449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.813335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:44.813733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:44.815424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:44.831736 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 152/309] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:44.835861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.849434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c8331-4cda-4959-8048-02792c91602e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:44.858557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:44.859415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.859885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.860350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.869956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:44.871936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:44.887458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 158/310] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:44.893726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.909487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98efb4-bc59-4278-85d1-42bf53737768 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:44.917529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:44.918369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.918644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.918911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.921800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e759a896dad443d0938f7cb7473bd222)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:44.923740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:44.925518 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 153/311] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/projects/e759a896dad443d0938f7cb7473bd222 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:44.931711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.945691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d44d2e-54d3-4ea0-b19a-a8b5820d09b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:44.956485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:44.957591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:44.958060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:44.958540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] PATH_INFO: `/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:44.969251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] RBAC: Authorizing `identity:get_group(group_id=b25dd32c76ba4783ad83dc82c55b8d37)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:44.971410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39467d-b4ae-44cb-822a-10c64331f084 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:44.973665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 159/312] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37 => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:44.979817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:44.999086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53001fa-e026-4410-a88e-34b71cea12e1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.008105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.008853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.009132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.009400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.010494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] RBAC: Adding query filter params (group.id=b25dd32c76ba4783ad83dc82c55b8d37, role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=e759a896dad443d0938f7cb7473bd222) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:45.010800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.012800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575ba2-a947-4c2d-af37-c30640e962ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.021965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 154/313] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:44 2021] GET /identity/v3/role_assignments?group.id=b25dd32c76ba4783ad83dc82c55b8d37&scope.project.id=e759a896dad443d0938f7cb7473bd222&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:45.156041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5b22-59ab-451e-b65f-44d37c59bbc8 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.156678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5b22-59ab-451e-b65f-44d37c59bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.157145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5b22-59ab-451e-b65f-44d37c59bbc8 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.159437 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 160/314] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:45.178236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.178544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.178786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.199248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:45.200439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:45.215621 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 155/315] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:45.245466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5b22-59ab-451e-b65f-44d37c59bbc8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.261736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5b22-59ab-451e-b65f-44d37c59bbc8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.268482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.269706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.270202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.270668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.287191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:45.294495 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:45.296723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 161/316] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:45.303052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.312956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825658c-a687-452e-9c89-0eafa53890d0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.321125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.321809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.322088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.322360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.323132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:45.323433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.325081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.340690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 156/317] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:45.347518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.358983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62992-9e9c-49d9-90a2-80e83031c5f5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.371240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.371901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.372180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.372462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.381167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.382933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.392525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 162/318] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:45.398661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.409165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ebc87-536c-481c-88bc-e04d34a608e0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.416706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.417564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.417843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.418117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.419315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.421974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.423959 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 157/319] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:45.429864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.439096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c64a0-c0f4-4d34-b97e-6c136841d634 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.447668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.448516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.448830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.449102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.450296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.452725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a79639-9016-4e68-8a10-a10eabde33c7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.454326 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 163/320] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:45.460845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:45.473485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8dd2a-e7b5-4a4b-8dff-167def46f282 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:45.478279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:45.478921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:45.479202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:45.479478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:45.480314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=eb9200e8495e40bbbba9c0636aee9423) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:45.480644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:45.482492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fbbb-a91b-4618-9c07-6d0e582e682a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:45.491226 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 158/321] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:45 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:46.585278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb7e-9811-414e-bcf4-ec2fc6b809fe None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.586023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb7e-9811-414e-bcf4-ec2fc6b809fe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.586023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb7e-9811-414e-bcf4-ec2fc6b809fe None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.587793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 164/322] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:46.595823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.596461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.596461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.617088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:46.618286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:46.629876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 159/323] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:46.679658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bb7e-9811-414e-bcf4-ec2fc6b809fe None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.697060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bb7e-9811-414e-bcf4-ec2fc6b809fe None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.702027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.702810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.703088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.703357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.721470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:46.728272 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-b28ea692-be6d-415f-8559-0972613e675c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:46.729500 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 165/324] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:46.735830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.744852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ae8bc-1369-4cb8-b9d5-fc482063eb46 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.745138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ae8bc-1369-4cb8-b9d5-fc482063eb46 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.745418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ae8bc-1369-4cb8-b9d5-fc482063eb46 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.747196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 166/325] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:46.751224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab045-fa6a-4793-84d0-737525fee952 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.755092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.755377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.755655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.759685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.760447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.760760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.761033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.761893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:46.762198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:46.764333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:46.777682 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 160/326] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:46.781631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:46.782839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:46.786738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.796886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c888-02ba-4846-ace0-687f31b5463f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.797464 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 167/327] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:46.806655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.807503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.807774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.808041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.809255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:46.812013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:46.815634 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 161/328] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:46.822495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.842689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.843735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807e28-494a-4ee1-83f1-d4d0f0a5eece None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.854372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0785b-bcc3-4664-852c-93f964544dd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.855400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.856368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.856788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.857125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.859569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:46.860713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:46.862522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.863617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.864085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.864513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.868665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 168/329] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:46.880163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.885435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:46.894049 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:46.895607 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 162/330] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:46.899323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50f70e-43f4-47c6-92cf-26b2ba95f2c3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.909292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.917340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.918347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.918698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.919040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.921735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcdfb53d104b1f8c560611b4e841e7, group_id=7f188f47d8de4f7bb844ae16e27c655f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:46.922636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea1cc-5f9b-438b-bf1d-b95c30dcd365 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:46.925478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:46.929632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:46.930602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:46.931496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:46.932091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:46.933217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:46.933691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:46.936700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:46.947005 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 163/331] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:46.952677 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 169/332] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:42:46 2021] PUT /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:46.956792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:46.967665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaea2b-a165-44da-aaa8-60f81fecb1ca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.050559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.051444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.051723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.052050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.053282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.055190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3067dc-b683-4a07-89e4-082b4deb7956 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.057312 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 164/333] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:46 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:47.065164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.086091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e971f-088d-4e08-bb87-0c81f0f9d742 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.090531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ad11-d246-4139-87d4-36bde46987cb None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.090809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ad11-d246-4139-87d4-36bde46987cb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.091091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ad11-d246-4139-87d4-36bde46987cb None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.094106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 165/334] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:47.094647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.095513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.095792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.096065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.098473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.100557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259a48-858d-4437-95ad-197450d5dfcd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.104867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 170/335] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:47 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:47.109672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ad11-d246-4139-87d4-36bde46987cb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.116092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.116378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.117124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.140520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ad11-d246-4139-87d4-36bde46987cb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.149458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.150350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.150629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.150898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.152263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:47.153505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:47.156645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcdfb53d104b1f8c560611b4e841e7, group_id=7f188f47d8de4f7bb844ae16e27c655f, role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.159262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.176310 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 171/336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:47.187296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 166/337] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:42:47 2021] PUT /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:47.242126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.251482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f7c6-4582-41a5-9e21-4768464699ef None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.324492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.325690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.326755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.327224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.339459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:47.347213 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:47.349175 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 172/338] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:47.360204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.376263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271826d-46c1-4bdb-a4a1-10559e41240f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.386265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.386949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.387226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.387495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.388262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:47.389147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.390763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.407210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 167/339] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:47.413588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.427432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075fb6-9907-4dc9-8706-4e90f2501833 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.436543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.437743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.438160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.438571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.444601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.446957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.449235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 173/340] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:47 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:47.456990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.474043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3cf1-f553-4484-8e8a-c68a902be7c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.485005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.486018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.486395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.486786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.493478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.495690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee6dc-24ef-473f-b605-ab73ebe6146a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.497604 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 168/341] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:47 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:47.504637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:47.517984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa24b-84cb-44d1-9dfd-f5c14c1977ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:47.525195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:47.526298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:47.526736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:47.527143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:47.529468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9200e8495e40bbbba9c0636aee9423, group_id=7f188f47d8de4f7bb844ae16e27c655f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:47.532335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c452-43fb-4d44-94cd-64d43007d1f2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:47.553539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 174/342] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:42:47 2021] PUT /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:48.264539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e764-1965-47e2-bb4c-dae2d6ad6ec6 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.265076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e764-1965-47e2-bb4c-dae2d6ad6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.265151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e764-1965-47e2-bb4c-dae2d6ad6ec6 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.266890 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 169/343] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:48.274374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.275261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.275726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.299684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:48.301229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:48.367282 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 175/344] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:48.399500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8e764-1965-47e2-bb4c-dae2d6ad6ec6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:48.416372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8e764-1965-47e2-bb4c-dae2d6ad6ec6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:48.427063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:48.428150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.428673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.429140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.444447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:48.455327 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:48.457059 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 170/345] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:48.463106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:48.477623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da17d4-9e97-4652-a216-ea5dfc78b4fb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:48.484569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:48.485258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.485536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.485808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.486571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:48.486871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:48.488458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:48.500235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 176/346] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:48.506270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:48.520118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4b027-7a92-4d03-a0e4-485a6e1d1fcb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:48.528780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:48.530447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.530922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.531405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] PATH_INFO: `/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.535559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] RBAC: Authorizing `identity:get_group(group_id=b25dd32c76ba4783ad83dc82c55b8d37)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:48.537697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:48.539590 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 171/347] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:48 2021] GET /identity/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:48.546870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:48.563108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469073f0-75ee-4d3f-843e-a6e802874cdb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:48.570314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:48.571166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.571444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.571711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.573031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] RBAC: Authorizing `identity:get_project(project_id=e759a896dad443d0938f7cb7473bd222)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:48.574789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19111f-3fa9-4cdd-ada2-fbd67279c40f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:48.577330 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 177/348] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:48 2021] GET /identity/v3/projects/e759a896dad443d0938f7cb7473bd222 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:48.584179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:48.600732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2e2e-ff00-40ec-9495-9e398c9b077d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:48.606230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:48.607594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.608169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.608766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222/groups/b25dd32c76ba4783ad83dc82c55b8d37/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.612139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e759a896dad443d0938f7cb7473bd222, group_id=b25dd32c76ba4783ad83dc82c55b8d37, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:48.615105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b706-b061-4a4b-83b2-cd17dca3f8e0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:48.644954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 172/349] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:42:48 2021] PUT /identity/v3/projects/e759a896dad443d0938f7cb7473bd222/groups/b25dd32c76ba4783ad83dc82c55b8d37/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:48.870652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e39b8b-3e87-4a01-8751-082d257b1d31 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.870973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e39b8b-3e87-4a01-8751-082d257b1d31 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.871199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e39b8b-3e87-4a01-8751-082d257b1d31 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.873867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 178/350] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:48.881658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:48.882263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:48.882728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:48.906221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:48.907769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:48.991177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 173/351] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:49.022575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e39b8b-3e87-4a01-8751-082d257b1d31 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:49.042403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e39b8b-3e87-4a01-8751-082d257b1d31 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:49.048439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:49.049330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:49.049608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:49.049880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:49.065765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:49.073617 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:49.076084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 179/352] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:49.081628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:49.094373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a178bf-6c86-4436-9119-f8cc6abcbf81 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:49.100952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:49.101870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:49.102342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:49.102807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:49.103751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:49.104259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:49.106118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:49.116632 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 174/353] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:49.122939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:49.136389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3732-d4e9-4b35-8add-0a6c9efbbb0a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:49.142459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:49.143344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:49.143621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:49.143895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:49.145770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:49.147817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:49.150358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 180/354] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:49 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:49.157092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:49.167562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5eaa7-be93-447f-b922-9c6f55099f75 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:49.177507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:49.178626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:49.179096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:49.179574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:49.185401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:49.187664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84020de-76ff-414f-a497-d59af599241c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:49.189689 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 175/355] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:49 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:49.196930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:49.213963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be36b16-0372-4f4d-a936-e58d74565d25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:49.221532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:49.222461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:49.222746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:49.223018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:49.230657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9200e8495e40bbbba9c0636aee9423, group_id=7f188f47d8de4f7bb844ae16e27c655f, role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:49.233490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceef654-f7b5-481a-aced-a632e501a942 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:49.256178 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 181/356] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:42:49 2021] PUT /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423/groups/7f188f47d8de4f7bb844ae16e27c655f/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:42:50.356267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f666a4-9f80-40f5-b88c-1606bcad578a None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.357337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f666a4-9f80-40f5-b88c-1606bcad578a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.357815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f666a4-9f80-40f5-b88c-1606bcad578a None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.359952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 176/357] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:50.368671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.369524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.369986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.393182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:50.394697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:50.412298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b310d0-be66-4355-a64d-fec5cd855728 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.412903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b310d0-be66-4355-a64d-fec5cd855728 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.413371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b310d0-be66-4355-a64d-fec5cd855728 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.415337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 177/358] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:42:50.437802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.438113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.438354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.472633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:50.472633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:50.480507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 182/359] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:50.490079 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 178/360] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:50.530463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.533591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.547737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08c9b-1b61-483d-8bb3-31ffd760bf7d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.550915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f198ab-3b80-4561-bc77-6ae996e314f7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.558005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.558809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.559085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.559355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.564687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.565481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.565752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.566016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.580150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:50.586919 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:50.588106 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 183/361] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:50.595864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:50.597134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.603076 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:50.604535 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 179/362] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:50.611173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8982068-cf02-4b33-be2b-f79f3c09dde0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.611474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.623253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d16e-e6e4-4242-a98b-182ef0e902a5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.627032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.627915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.628404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.628891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.629838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:50.630331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.632374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.644585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.645586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.646054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.646513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.647484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:50.647986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.649781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.663555 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 184/363] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.666886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 180/364] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:50.671068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.677166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.683152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145675b-334f-4706-b199-36cbdee5fe6a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.691841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.692762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.693348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.694097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.699828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f26a-75e1-41f5-ad01-c86744e2b57a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.706602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.708339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b9ec6-c98e-45e9-a5b4-80219c4116cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.709694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.710345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.710738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.710893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.721567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.722368 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 185/365] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:42:50.723433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.723783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0da7-a52d-4797-a727-70cf1b22b61e None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.724066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0da7-a52d-4797-a727-70cf1b22b61e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.724335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0da7-a52d-4797-a727-70cf1b22b61e None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.726322 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 186/366] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:50.733956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.734234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.734505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.736892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 181/367] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:50.737730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.748055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa7e7-8221-4b05-abcc-89808cc0c265 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.752773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.753653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.753933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.754207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.755418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.757302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:50.757507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.758634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:50.759487 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 182/368] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.760242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.767857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 187/369] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:50.768758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.771426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af499c5e-a66b-41af-918e-27e427c82eac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.777413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.778347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.778624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.778897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.781410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.784638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.785849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e01c7-3374-4317-9f4d-db9a71020966 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.786741 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 183/370] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.792555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.798098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.798961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.799237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.799504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.800742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.802620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.804383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 188/371] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.811365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c95a3-8b5d-4695-b26b-398bce843257 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.811666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.828566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.829512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.829785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.830050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.831537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.836051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2aaa-abbc-4347-a852-bd67c9448e34 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.836172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.837971 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 184/372] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:50.838719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.851004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.851935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.852514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.852998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.854119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:50.854601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.855140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db1e-671e-48e8-a97e-260b5ada3a39 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.857076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.861743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.862630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.862992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.863364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.865509 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 189/373] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=4aa20354184f48969579623c64fd58fc => generated 611 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.866607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.877297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790b29-08ab-458d-9bf3-b69314532cee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.883256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:50.891694 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 03:42:50.894401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.895353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.895836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.896304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.897398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=fabcdfb53d104b1f8c560611b4e841e7) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:50.897995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.900116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.905838 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 185/374] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:50.914082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 190/375] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=fabcdfb53d104b1f8c560611b4e841e7&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.925687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:50.947294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5568-1a73-4b44-a148-b6386c7b0214 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:50.962166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:50.963241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:50.963724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:50.964219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:50.965289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:50.965807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:50.968191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:50.977821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 186/376] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:50.984972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.002814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f65c1-8224-479f-8889-22297f8c76af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.017614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.018312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.018597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.018877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.033176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.034993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.051822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 191/377] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:51.058156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.078430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820c74-3178-4794-bb7b-f5cdeb5381f5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.094499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.095688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.096145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.096636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.098135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.100382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.102360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 187/378] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:51.109295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.122009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e171-a645-455e-b09d-c90b2d3b48c2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.126728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.127601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.127881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.128153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.129466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.131463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31831704-b1a2-4030-a850-7320a640b82b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.134712 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 192/379] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:51.139688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.151389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd159852-03c1-4a3e-b021-aa446040da8c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.156865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.157709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.158058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.158401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.159365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=4aa20354184f48969579623c64fd58fc, scope.project.id=eb9200e8495e40bbbba9c0636aee9423) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:51.159676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.161725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6f870-dfe7-44fc-be55-b4629037004f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.168952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 188/380] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=4aa20354184f48969579623c64fd58fc => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:51.555552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25a4c-4503-478b-95d6-51e91b8b441f None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.556055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25a4c-4503-478b-95d6-51e91b8b441f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.556147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25a4c-4503-478b-95d6-51e91b8b441f None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.557877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 193/381] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:51.565391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.565874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.565961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.584723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:51.585914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:51.594585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 189/382] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:51.619438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af25a4c-4503-478b-95d6-51e91b8b441f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.633173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af25a4c-4503-478b-95d6-51e91b8b441f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.637527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.638820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.639104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.639378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.649854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:51.657124 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:42:51.658308 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 194/383] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:51.664713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.673639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc68554-8cdc-4b8f-96ad-33601361916a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.678773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.679425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.679698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.679967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.680753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:51.681058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.684245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.693197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 190/384] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:51.699787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.710744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19a5c-d25a-4a9a-9cdf-a1b406481101 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.715450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.716360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.717433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.717703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.725972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.727694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.736965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 195/385] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:51.744429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.754029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f962-6d5f-4337-8860-825e4fc7cc3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.758704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.759542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.759818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.760085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.761291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] RBAC: Authorizing `identity:get_project(project_id=e759a896dad443d0938f7cb7473bd222)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.763055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.765520 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 191/386] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/projects/e759a896dad443d0938f7cb7473bd222 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:51.771360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.781056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280772-dff9-4a77-bff1-0c02054754c0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.785608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.786533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.786813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.787083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] PATH_INFO: `/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.788253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] RBAC: Authorizing `identity:get_group(group_id=b25dd32c76ba4783ad83dc82c55b8d37)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.790162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4481-a33b-448b-a9c3-5536e441666a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.791726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 196/387] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/groups/b25dd32c76ba4783ad83dc82c55b8d37 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:51.798145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:51.808018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb4d7-1dd7-491b-85d8-f071c38ea434 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:51.813119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:51.813757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:51.814030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:51.814296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:51.815126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] RBAC: Adding query filter params (group.id=b25dd32c76ba4783ad83dc82c55b8d37, role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=e759a896dad443d0938f7cb7473bd222) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:51.815422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:51.817250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda90e8-20f7-421f-9238-36724a0c8499 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:51.824571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 192/388] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:51 2021] GET /identity/v3/role_assignments?group.id=b25dd32c76ba4783ad83dc82c55b8d37&scope.project.id=e759a896dad443d0938f7cb7473bd222&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:52.309645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd36d-96a6-459b-a90f-8ce155ee24ba None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.309921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd36d-96a6-459b-a90f-8ce155ee24ba None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.310192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd36d-96a6-459b-a90f-8ce155ee24ba None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.312522 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 197/389] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:52.319502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.319783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.320056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.337194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:52.338368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:52.345839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 193/390] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:52.371118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd36d-96a6-459b-a90f-8ce155ee24ba None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.383119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd36d-96a6-459b-a90f-8ce155ee24ba None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.387156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.387916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.388188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.388455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.398016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:52.405031 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:52.406130 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 198/391] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:52.412033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.421143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb826-1b27-4ebd-9445-b723826d5834 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.425523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.426151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.426429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.426700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.427433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:52.427737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:52.429367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:52.437649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 194/392] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:52.443103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.452330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c09f9-6f0c-4994-963c-06d26ef8a71a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.456493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.457113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.457388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.457656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.466024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:52.467724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:52.476082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 199/393] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:52.481636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.491096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d179-759e-4cf8-8d84-190fe2de7d26 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.495317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.496115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.496409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.496721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.498478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:52.500443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:52.502069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 195/394] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:52.507297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.515400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125fa6-5ba1-45ff-a705-be836390773f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.519564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.520339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.520630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.520911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] PATH_INFO: `/v3/groups/7f188f47d8de4f7bb844ae16e27c655f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.522042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] RBAC: Authorizing `identity:get_group(group_id=7f188f47d8de4f7bb844ae16e27c655f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:52.523807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa4c1-be10-4846-92c0-6347e323a10f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:52.525345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 200/395] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/groups/7f188f47d8de4f7bb844ae16e27c655f => generated 226 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:52.530978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:52.539833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db825-b259-4b7f-9db9-9d572e40f923 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:52.544080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:52.545213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:52.545489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:52.545758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:52.546558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] RBAC: Adding query filter params (group.id=7f188f47d8de4f7bb844ae16e27c655f, role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=eb9200e8495e40bbbba9c0636aee9423) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:52.546859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:52.548590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3653dd-4237-483b-ab92-9316e560f4a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:52.554095 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 196/396] 10.222.0.13 () {56 vars in 1397 bytes} [Wed Nov 10 03:42:52 2021] GET /identity/v3/role_assignments?group.id=7f188f47d8de4f7bb844ae16e27c655f&scope.project.id=eb9200e8495e40bbbba9c0636aee9423&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:55.611068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cea00e-575e-48b9-a054-f9d451870261 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.611655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cea00e-575e-48b9-a054-f9d451870261 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.611655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cea00e-575e-48b9-a054-f9d451870261 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.613827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 201/397] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:55.621409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.621902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.621992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.645789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:55.647042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:55.665084 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 197/398] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:55.716182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cea00e-575e-48b9-a054-f9d451870261 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:55.735084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cea00e-575e-48b9-a054-f9d451870261 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:55.743453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:55.744245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.744513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.744804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.760218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:55.762044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:55.783413 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:55.784634 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 202/399] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:55.790944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:55.808909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ef8c-b418-4ee9-a71f-fb636d62c1a5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:55.814125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:55.814799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.815072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.815337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.816070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:55.816367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:55.817994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afaaed-91c5-4456-8a6e-b5df7ba16250 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:55.839067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 198/400] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:55.845859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:55.862692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c14b69-1a11-4241-b626-09b21e495f41 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:55.871612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:55.872282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.872578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.872909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.873680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:55.875585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63230d1b-c6bd-49c0-8ac9-6e2a590fff1c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:55.913569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 203/401] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:55 2021] POST /identity/v3/users => generated 246 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:55.922483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052928f-2b6e-45d9-bce3-2800fd246144 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.922826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052928f-2b6e-45d9-bce3-2800fd246144 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.923010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052928f-2b6e-45d9-bce3-2800fd246144 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.925100 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 199/402] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:55.944893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c80-7008-4093-b33e-3eae481fe859 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:55.945223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c80-7008-4093-b33e-3eae481fe859 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:55.945443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c80-7008-4093-b33e-3eae481fe859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:55.973174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-85464c80-7008-4093-b33e-3eae481fe859 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:55.974388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-85464c80-7008-4093-b33e-3eae481fe859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:55.988378 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 204/403] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:56.039337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052928f-2b6e-45d9-bce3-2800fd246144 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.051419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404564d4-bbba-41cb-b2bf-c794c1c05dc6 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.051760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404564d4-bbba-41cb-b2bf-c794c1c05dc6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.051963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404564d4-bbba-41cb-b2bf-c794c1c05dc6 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.053824 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 205/404] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:56.061721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.062033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.062258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.063637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052928f-2b6e-45d9-bce3-2800fd246144 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.073556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.074920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.075407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.076445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.094737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:56.097501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:56.098569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.101689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.118102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 206/405] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:56.132134 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:56.133790 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 200/406] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:56.141072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.145262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.155670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c2673-4ebf-4fe5-8b2f-1fc7e091522f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.156676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d606a9-ae31-4ced-ac80-b23655041b54 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.163254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.163913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.164190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.164457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.165222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:56.165518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.166517 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:56.166517 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:56.166517 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:56.167377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e23b3-0672-4a93-bf16-0c0b9e113429 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.170064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.171129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.171614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.172161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.185206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.185457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 207/407] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:56.187720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.190156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73585-9a12-4ec7-8cf1-09d9c3a9149f None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.190437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73585-9a12-4ec7-8cf1-09d9c3a9149f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.190709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73585-9a12-4ec7-8cf1-09d9c3a9149f None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.192408 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 208/408] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:56.193123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e73585-9a12-4ec7-8cf1-09d9c3a9149f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.208293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e73585-9a12-4ec7-8cf1-09d9c3a9149f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.208500 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-76dcf44e-7557-4060-ac7a-bff0adc34760 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:56.209850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 201/409] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:56.213957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.213957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.213957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.214213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.214292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.214519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.214723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.214823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.217337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.238597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:56.239209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:56.245804 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 209/410] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/users => generated 248 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:56.246628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.256044 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 202/411] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:56.259398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c29bd-7a41-4b89-9344-088f8eae0df7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.264583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.265366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.265713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.266143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.266972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:56.267277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.270005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.284776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.285082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 210/412] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:56.293689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.294116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d0383-c6b0-4878-892b-0e8ccf9b5fba None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.298976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.299789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.300063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.300335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.307014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fced60-b072-49d1-9da9-bb8c10ee359c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.313327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.314780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.315422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.316164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.316761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.317224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.319131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.321471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.334301 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:56.335874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 203/413] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:56.343660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.356045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32860ca-f7e5-4dc7-aed9-2a7f9356777e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.359263 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 211/414] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/users => generated 248 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:56.375739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.376332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.376621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.376983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.377762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:56.378063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.379735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ce65c-0f2a-4d2a-a2a4-0bdd7eebbd47 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.402868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 204/415] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:56.410252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:56.425354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1a83-f94e-4327-a6ea-565d6e935459 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:56.436404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:56.437584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.438112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.438619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.439743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:56.442310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56514513-f834-4b60-aa20-1c1c73251f39 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:56.491515 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 212/416] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/users => generated 249 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:42:56.942945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a7313-8b21-47f1-a2e0-c778ec5ade82 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.943448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a7313-8b21-47f1-a2e0-c778ec5ade82 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.943553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a7313-8b21-47f1-a2e0-c778ec5ade82 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.945955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 205/417] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:56.955367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:56.955841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:56.955924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:56.977327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:56.978569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:56.990417 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 213/418] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:57.016044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a7313-8b21-47f1-a2e0-c778ec5ade82 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:57.034213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a7313-8b21-47f1-a2e0-c778ec5ade82 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:57.038771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:57.039430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:57.039706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:57.039975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:57.040765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:57.042360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:57.061888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.sql.core [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 10 03:42:57.061888 ncdv-817176-1 devstack@keystone.service[96285]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 10 03:42:57.061888 ncdv-817176-1 devstack@keystone.service[96285]: [parameters: {'id': 'b798be6cf1354d7e96f337d6d04981a6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 10 03:42:57.061888 ncdv-817176-1 devstack@keystone.service[96285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 03:42:57.076971 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 10 03:42:57.080245 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 206/419] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:42:57 2021] POST /identity/v3/roles => generated 144 bytes in 65 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:57.087144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:57.101635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145417b1-6249-4a1e-810b-ad99a65e7077 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:57.113752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:57.114607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:57.114917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:57.115199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:57.130310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:57.137649 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-0fde17f7-5394-4f8c-8436-a8c654e338a7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 03:42:57.139102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 214/420] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:42:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:57.145325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:57.155803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6a3f-589e-4617-8bf3-108c4d9907b6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:57.167936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:57.168590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:57.168937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:57.169213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:57.170526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:57.170824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:57.172409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7ad5-9264-4ff5-92b8-0867365d0295 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:57.185805 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 207/421] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:58.778533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2d5c-8fb1-455a-ae59-5ee96be357f5 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:58.779754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2d5c-8fb1-455a-ae59-5ee96be357f5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:58.779754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2d5c-8fb1-455a-ae59-5ee96be357f5 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:58.781576 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 215/422] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:58.788876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:58.789444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:58.789444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:58.817629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:58.819141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:58.829615 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 208/423] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:58.867757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2d5c-8fb1-455a-ae59-5ee96be357f5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:58.886270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2d5c-8fb1-455a-ae59-5ee96be357f5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:58.891084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:58.891898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:58.892171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:58.892441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:58.910166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:58.917237 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:42:58.918734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 216/424] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:42:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:58.926012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:58.935176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4ef0d-26a7-42b0-8b93-8f1c99e8a322 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:58.944720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:58.945370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:58.945643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:58.945906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:58.947624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:58.948169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:58.949919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:58.965586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 209/425] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:42:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:58.972642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:58.987226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc51e4f-ede5-490b-a28c-dac6cc32f145 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:58.996630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:58.997461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:58.997740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:58.998007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.009617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.011443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.037008 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-4582a0fd-20f5-4c3c-8fe2-7404da146e0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.038192 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 217/426] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.045246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.055338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee340a1-8cab-4694-add2-5ea9434a6866 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.057501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf96cd-5c0f-4829-a3c7-b13e45a9a5cc None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.057874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf96cd-5c0f-4829-a3c7-b13e45a9a5cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.058148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf96cd-5c0f-4829-a3c7-b13e45a9a5cc None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.060747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 218/427] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:59.067754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.068022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.068296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.070530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.071180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.073497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.073784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.074519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.074819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.076420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.102934 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 210/428] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.103947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:59.105173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:59.109769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.120480 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 219/429] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:42:59.127023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063817-2ca0-4d28-8ebe-1e26edd87896 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.138375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.139176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.139456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.139706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.151970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.152257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.154302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.166729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297495-1824-4f39-a75b-daf7c2f3cd2a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.176153 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:42:59.180598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.184781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 211/430] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.187114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.187392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.187663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.190823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.205447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:59.212584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc106d-e40a-47ae-b6f1-b02e0e5002c1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.218903 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:42:59.222177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.222838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.223202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.223527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.224430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.224764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.225376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 220/431] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:59.226138 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:59.226138 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:59.226138 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:59.227363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.228331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.248049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7ac5-2757-4e62-acb6-62ff9eb9dd1d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.257088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.257803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.258081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.258402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.259162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.259517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.261181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.279207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 221/432] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.285365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.299123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22619d-e68e-4097-a443-b878102cc6e0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.302369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 212/433] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:59.308713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.314890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.315699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.316571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.316874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.321150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a0588-4a7d-4a75-a282-c0dccbca6e78 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.332999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.334835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.336688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.337335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.337610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.337880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.352778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.356035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.369805 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.377003 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 222/434] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:59.378597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.381891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 213/435] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:59.389866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.398953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28a7c6-a8c5-4c8d-8680-6bd5a6e0e9e1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.405848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c419e-dc2d-4b1b-a63d-4ba43cdf9985 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.409532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.411397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.411678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.413290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.414110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.415903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.416128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.417943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.418216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.418486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.420187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.441292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.443133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.444369 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 223/436] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.467415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.475865 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.477127 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 214/437] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.479439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18229d-9c6d-4f11-b754-90f83d3c399b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.486993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.487842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.488119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.488451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.489732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.498303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.499361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995bca-adca-4b1b-b5ff-9fcd81420c9a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.500542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.514988 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 03:42:59.516496 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 224/438] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:59.517259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.517973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.518250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.518522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.519260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.519661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.521341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36e9f0-c201-408e-b7c3-4a98e03144a0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.522612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.537923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c41b-5742-4bc3-8e1d-e56feb331234 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.542939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.543660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.543934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.544277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.545777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.546081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.546647 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 215/439] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.547177 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:59.547177 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:59.547177 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:59.548342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906a1b4-e77a-4602-9bd2-e0c4e58fc091 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.548772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a9af-75a4-4d2c-9030-789e38b659e9 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.549332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a9af-75a4-4d2c-9030-789e38b659e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.549835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a9af-75a4-4d2c-9030-789e38b659e9 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.551713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 216/440] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:59.559449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a9af-75a4-4d2c-9030-789e38b659e9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.572803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a9af-75a4-4d2c-9030-789e38b659e9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.577451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.578505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.579002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.579474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.587329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.589541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.596315 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 225/441] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:42:59.598317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.598781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.599231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.604365 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-fcf58fc7-cf83-41b4-8fcb-abcbf55f376f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:42:59.605695 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 217/442] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:59.606724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5f45-11c9-4dfc-8ffc-b43d6c5f74ee None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.607558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5f45-11c9-4dfc-8ffc-b43d6c5f74ee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.607831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5f45-11c9-4dfc-8ffc-b43d6c5f74ee None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.609617 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 218/443] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:42:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:42:59.610536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5f45-11c9-4dfc-8ffc-b43d6c5f74ee None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.616931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:59.618090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:59.622855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5f45-11c9-4dfc-8ffc-b43d6c5f74ee None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.625983 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 226/444] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:59.626547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.634129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.635071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.635327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f40353-b45b-42ba-a9a2-5002817efa18 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.635811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.636522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.639795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.640403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.640717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.640991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.642019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.642344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.643340 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:59.643340 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:42:59.643340 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:42:59.645146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.648447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.650679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1964537-cd27-4b6d-8dfc-c0f4c8a2061a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.660377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 219/445] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:42:59.661702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.662128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.662408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.663198 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 227/446] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.664049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.674016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d4b5-f2c3-4b05-8ead-b66b3df30148 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.678442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.679204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.679480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.679749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.681232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:42:59.682351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:42:59.689696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:59.689866 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 220/447] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:42:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:42:59.693404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.696662 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:42:59.697818 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 228/448] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.698595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.704923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b463092-1085-4805-bdf9-c8bc1b93dcd5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.709661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b32d-2ace-4782-949d-ab49372cf374 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.710567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.711750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.712264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.712766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.714377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.714993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.715357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.715629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.717118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.717409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.719234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.724912 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 229/449] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.725050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.726180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.727003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.734873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398776-8a42-4729-8d45-69f9264162e6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.739539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.740201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.740476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.740784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.741548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.741845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.743450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.747733 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.749999 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 221/450] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.751191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.753235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 230/451] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.759017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.764837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6dacc-f3b4-49fc-8e91-2c2331e511be admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.770639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.771447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.771724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.771995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.772189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181140b-eb08-45fd-a74c-6a670eeacab3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.779827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.781040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.781415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.782204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.785125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:42:59.794061 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:42:59.795152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.795669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 222/452] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.796258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.797536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.809471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970a0bd-4de1-46f9-b2e6-9c79f1b9b901 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.813418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.814084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.814365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.814635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.815377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.815678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.817343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.819707 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.824736 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 231/453] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:42:59.828284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.834899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 223/454] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.836640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfa1af-3b55-412c-8670-7435c3150e07 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.841158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.841920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.842767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.843060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.843327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.844102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.844400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.846028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.854312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c3e9-3af9-40e3-a3bf-7472744e402b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.856039 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 232/455] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.857015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.859337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.860167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.860517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.860884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.861735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.862100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.863948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.866973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8fab-0029-47d9-a5a5-3fe3637068a8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.871456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.872246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.872561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.872872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.878716 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 224/456] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:42:59.880557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.882661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.884829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.896141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c64b7-6b87-4075-b50f-a8db77be4083 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.897498 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:42:59.899419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 233/457] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.900272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.911047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.911975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.912258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.912524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.915123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421313f-d792-438f-a64e-7d42cb1b9859 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.919706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.920507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.920829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.921103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.924642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.926646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.929550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.931616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.945524 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:42:59.946177 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 03:42:59.947171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 225/458] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.947569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 234/459] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:42:59.947757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.954864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:42:59.963842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e193e3-4261-48e6-b8a8-238ccd8021cb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.967951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7e65-7f40-40ab-8401-26206579d9dc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:42:59.969464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.970159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.970436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.970762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.971674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.971979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.973092 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:42:59.973092 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:42:59.973092 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:42:59.974414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:42:59.974936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:42:59.975822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:42:59.976564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:42:59.977085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:42:59.978159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:42:59.978662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:42:59.981285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.001617 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 226/460] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.002455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 235/461] 10.222.0.13 () {56 vars in 1160 bytes} [Wed Nov 10 03:42:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.005067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.010002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.015270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6434e0b-626a-4729-ad1e-307772e9b6b0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.020241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.020991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.021274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.021549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.022311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.022577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.024166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.028273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f1c2-e868-4b56-9d4b-54e86fdc1380 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.034856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.035753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.036251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.040897 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 227/462] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.040897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.041062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.041904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=b0e3e62850b34fe786eda1156be94f74) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.042819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.044721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.050583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 236/463] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/role_assignments?user.id=b0e3e62850b34fe786eda1156be94f74&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.051405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.054522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b4a10-9035-4c72-b394-560bda9b653d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.059388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.061102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.061594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.062066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.076666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94159469-bae9-4842-80ce-e9eed631b74d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.081565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.084292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.085987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.086798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.088538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.088852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.104663 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 228/464] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:00.105491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.108949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.110809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.127622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2122d-4a96-4023-a20f-1b622519ef58 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.133130 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 03:43:00.134714 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 237/465] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/users/cinder => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:00.139823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.140908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.142174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.142745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.143034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.160375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f7c02-a924-4cab-9df3-151237aa4c92 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.170922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.172324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.173176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.173455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.173726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.175741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.176211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.176546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.178964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.215454 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:00.216742 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 229/466] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:00.220655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 238/467] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:00.223039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.227848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.242600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24729-5817-487a-b5df-c5e5870ef9e6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.245698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c9a8-0233-455b-b15a-92ab355d3cc9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.252736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.253978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.254692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.255534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.256302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.257243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.258219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.258376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.258709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.259535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.261620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.279756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 230/468] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:00.282943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.284849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.285808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.296573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b873ad-3f10-4d67-a7d6-d57b1b1758e5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.302219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.303109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.303503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.303869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.305056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:00.311418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.311965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.313927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.328543 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:00.330184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 231/470] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:00.331235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa969e4-10a3-4c6f-8155-7dfac7011de2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.336115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.344414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.345471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.345937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.346231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340ccd8-55f3-4c1c-8706-6d6e6b7807db admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.346647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.351291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.352027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.352302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.352657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.353437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.353789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.356145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddad45-fb82-4496-a8a4-54c78ec81579 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.359629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.361705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.368974 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 232/471] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:00.370042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e1f5-39b4-48da-ab04-c38ba8d9990e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.372991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e1f5-39b4-48da-ab04-c38ba8d9990e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.373437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e1f5-39b4-48da-ab04-c38ba8d9990e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.375599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 233/472] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:00.381442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7e1f5-39b4-48da-ab04-c38ba8d9990e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.392157 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-e30423cf-a0e4-44ad-84fb-8959750ab6cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:00.393389 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 240/473] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:00.394734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.395008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.395275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.396332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7e1f5-39b4-48da-ab04-c38ba8d9990e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.401060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.401865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.402297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.402710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.403782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=5d487008cbef426790f5b2e475643ade) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.404244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.406218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.412268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 234/474] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/role_assignments?user.id=5d487008cbef426790f5b2e475643ade&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.413214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.421857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:00.423202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:00.424156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0ab9-1513-4ff4-a98d-2301ce3ac685 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.429179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.430143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.430721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.431153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.432077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.432705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.434540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.439352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 241/475] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:00.456690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 235/476] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.463225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.479583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.480875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745cd29-ce30-43e2-b39e-31442d7946cd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.485941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.486745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.487015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.487276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.500660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.500660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.501076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12875-7a3a-4602-90e1-1e1572b6a036 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.506326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.507367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.507778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.508259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.511609 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:00.513200 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 242/477] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:00.522287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.522488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.528570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.539350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe6e3-0a2a-447e-9870-766285a4ad5a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.553349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.554319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.554669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.555273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.556638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.557641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.562323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.571780 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:00.575211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 236/478] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:00.581531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.588006 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 243/479] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:00.593314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e835a-3501-4ec4-bcb5-6134f60a187d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.595031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.609057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.609957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.610889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.611895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.612774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.613076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.613619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2352f-0e33-4376-bd28-4498114da173 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.616016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.623726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.626053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.626331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.626603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.628801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=7e779dee8d114aa890e1725ef72b0ac7) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:00.629115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.633868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3408f-fb69-426c-ae80-61465cf270cf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.645176 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 237/480] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:00.645898 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 244/481] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:00 2021] GET /identity/v3/role_assignments?user.id=7e779dee8d114aa890e1725ef72b0ac7&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:00.657879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:00.668740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a06a-2a8e-4efd-a167-0ed4a2994176 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:00.677921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:00.678668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:00.678949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:00.679220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:00.680074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:00.687813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6a5e-a735-4091-bda3-e0f02cd1ece0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:00.713586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 238/482] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:43:00 2021] POST /identity/v3/users => generated 247 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:02.530243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754638be-fc90-4361-ad92-8998b31c694b None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.530759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754638be-fc90-4361-ad92-8998b31c694b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.530759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754638be-fc90-4361-ad92-8998b31c694b None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.532831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 245/483] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:02.540171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.540649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.540745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.565577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:02.566763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:02.574927 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 239/484] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:02.612580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754638be-fc90-4361-ad92-8998b31c694b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.630368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754638be-fc90-4361-ad92-8998b31c694b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.635495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.636281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.636553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.636841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.654138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:02.660842 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:02.662335 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 246/485] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:02.668598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.678612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebabd-21b1-4eb7-8d28-b96b1a93278c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.684431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.685144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.685418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.685686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.686442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:02.686739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:02.688317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:02.697393 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 240/486] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:02.704300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.715033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f869f-954b-431e-834d-a6549a62a600 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.724859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.725633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.725909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.726220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.737170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:02.738984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:02.761087 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:02.762675 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 247/487] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:02.769445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.782950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d89f9-7b0c-4406-988d-10907e81bbd1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.792088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.792780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.793055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.793326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.794061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:02.794392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:02.795988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:02.814618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 241/488] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:02.821365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.836168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053539-b178-44ce-a676-84fab70e70d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.850619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.851407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.851680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.851944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.867039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:02.869093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:02.892146 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-5b8b08e7-6b86-44b0-8033-08b9225a9905 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:02.893730 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 248/489] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:02.899852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.917577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ea0a6-6a25-42ce-aa7c-7abc0be445f6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.928935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4674-a364-4731-8b1e-38e4b111adb4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.929215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4674-a364-4731-8b1e-38e4b111adb4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.929378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.929549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4674-a364-4731-8b1e-38e4b111adb4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.929903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.930183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.930457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.931306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:02.931527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 249/490] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:02.931630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:02.933449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:02.939027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.939304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.939572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.960019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 242/491] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:02.966817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:02.971755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:02.972972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:02.978952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5bcd2-340b-44a9-bace-8dffa16f23f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:02.986821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:02.987589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:02.987861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:02.988130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:02.991882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 250/492] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:43:03.008082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.009941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.016751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.025624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c266fb-089e-40a9-9284-7b7fdd436b82 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.039818 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:03.043096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.043895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.044972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.045146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.051542 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 243/493] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.056314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:03.057934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.065584 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:03.067047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 251/494] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.070874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793aec2-e256-44c9-bbfc-27fc86fac3f5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.073630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.085362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.086025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.086301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.086571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.087353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.087659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.089279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.092460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570100e-69b9-4629-a87d-49694bdf14f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.102796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.103448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.103720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.103986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.104756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.105103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.107270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.117785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 244/495] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.119866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.129239 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 252/496] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.132470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feee6a9-e838-4567-af5a-53056ee02aa2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.133974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.146423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4f3f8-3cf0-45ad-99e4-5de9cdf09746 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.148866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.149675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.149947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.150210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.161584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.163564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.165646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.166452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.166725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.166990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.192650 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:03.193545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.194599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 245/497] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.195623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.201225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.212172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487869-5cb9-4c33-af51-5c7c2c2604b4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.217960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.218855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.219303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.219819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.220868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.221341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.221973 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:03.223548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.223671 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 253/498] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.229957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.242293 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 246/499] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:03.246838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343ca1-a14a-4119-94e5-8e4de2d5881f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.249289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.259479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.263940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2779be-8337-4fe6-9f26-127b1986737b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.265385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.265672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.265961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.266710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.267017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.268594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.270485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.271612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.272140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.272694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.291004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=d1d98a52e85d40a5b77f40d833837869, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.294072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582341a-899f-4ee8-aeba-73a2fa110f86 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.299198 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 254/500] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.305231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.312288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 247/501] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:03 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:43:03.319645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db0a-5ac1-41ca-addc-b6c3016b765c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.320965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28143d8-7730-4341-8243-d9e779a17b80 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.321245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28143d8-7730-4341-8243-d9e779a17b80 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.321512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28143d8-7730-4341-8243-d9e779a17b80 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.323511 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 248/502] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:03.331772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.332080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.332309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.358304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:03.361104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:03.447383 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 249/503] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:43:03.454497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.455315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.455598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.455871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.474033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.475583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.476215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.486875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873380-5a63-4fe4-9291-d43d055faf33 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.503376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.504171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.504491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.504784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.506610 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 03:43:03.513116 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 255/504] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.516039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.528863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:03.532272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef569-e11d-4346-b322-a3e697883cde admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.537068 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:03.538630 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 250/505] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:03.542283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.542896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.543172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.543438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.544856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.545161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.545420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.546990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.557415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c433d4-8528-4ce1-a3a6-8ccc8df9f409 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.565144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.565801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.566081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.566349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.567104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.567400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.569813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.574002 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 256/506] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:03.579994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.581307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 251/507] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:03.587342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.590258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8368-348f-4e43-a846-54846b197fdc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.597027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.597820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.598095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.599071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.602260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60604d-e676-411f-af94-0e4e9c66eed0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.608058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.608980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.609259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.609529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.613830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.615896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.620677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.623191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.637014 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8651e3e5-7675-431e-b5d4-fcb2163b594b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:03.638789 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 257/508] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:03.640210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979471e-9a51-49f2-9398-08efb05868b2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.640689 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:03.640915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979471e-9a51-49f2-9398-08efb05868b2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.641390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979471e-9a51-49f2-9398-08efb05868b2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.642155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 252/509] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:03.643411 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 258/510] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:03.649614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.650840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979471e-9a51-49f2-9398-08efb05868b2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.661373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604bd6c-c597-480c-92cd-3aa18556001e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.665673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979471e-9a51-49f2-9398-08efb05868b2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.667200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.667951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.668439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.668876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.670302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.670738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.672508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a230d1-9c10-40b1-8ee8-4e51dc5ae93e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.673270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.674068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.674710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.675120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.676533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.677019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.678716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.686552 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 253/511] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.687981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.688363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.688760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.693320 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 259/512] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.694610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.706047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc76ba-40fa-40f4-8da3-e11d8deccb09 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.708166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:03.709573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:03.711313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.712334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.712827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.713325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.718559 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 254/513] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:03.721486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.723575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.725326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.738678 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:03.740497 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 260/514] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:03.743507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c4bca-2061-4106-b632-3b2d833dd88b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.749955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.753519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.754435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.754776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.755138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.763164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.763516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a35-8183-4ef5-9e42-4cae7d14469e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.765430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.768548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.769413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.769902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.770366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.771390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.771869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.773881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.780271 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 03:43:03.781594 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 255/515] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:03.782537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.786601 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 261/516] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.793266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.795522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f919a-67c4-47d9-8b47-3e77239712e5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.805352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.806175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.806453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.806721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.812920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274237b3-6850-4105-89ed-4bf6bf8c165e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.819552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.821006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.821503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:03.821766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.822235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.823456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.823990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.829158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.831119 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:03.836650 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 256/517] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:03.836650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.850362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f617-09ca-4ef8-849d-e51451353bb1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.854986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.855982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.856360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.857319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/b0e3e62850b34fe786eda1156be94f74/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.862965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 262/518] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.864103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.872535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=b0e3e62850b34fe786eda1156be94f74, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.875459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.876292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468782-1e03-4539-a3e3-98a200d9cc8a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:03.881931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:03.882626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:03.882907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:03.883225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:03.884036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:03.884340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:03.885984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:03.893692 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 257/519] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:03 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/b0e3e62850b34fe786eda1156be94f74/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:03.894787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.904528 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 263/520] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:03.906327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:03.929825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0225e-51f3-41de-bedb-7bf24aee2b2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.011935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188918-1dde-4225-99b2-68d7fa66b392 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.016435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.017381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.017786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.018054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.018258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.019343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.019766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.020176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.033597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.033802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.035754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.035997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.056364 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-34c9e8be-a9fc-460c-a27e-791612d72f9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:04.056776 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:04.057812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 264/521] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.058306 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 258/522] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.064548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.064730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e4a0-bd91-48c9-a178-9a5062ab6bac None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.065099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e4a0-bd91-48c9-a178-9a5062ab6bac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.065496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e4a0-bd91-48c9-a178-9a5062ab6bac None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.067512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 265/523] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:04 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:04.071663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80e4a0-bd91-48c9-a178-9a5062ab6bac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.076749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226a84-8df8-4e9d-83e2-115aa0c7c32b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.082429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.083682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.084808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.086174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.086999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.087303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.089297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754a811-160d-4bab-a6b8-0d30b1a1a535 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.092532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80e4a0-bd91-48c9-a178-9a5062ab6bac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.097415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.098357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.098832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.099297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.100253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.100799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.102655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.109023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 259/524] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:04.110512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.110848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.111168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.117676 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 266/525] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:04.118773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.128846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22e2f-0c14-46b0-9886-ab696ca74a93 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.132088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:04.133293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:04.134505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.135527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.136048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.136494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.142032 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:04.142808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.144660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.146754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.158313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe87650-680a-496d-bf93-c288d0f94da3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.161420 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:04.162860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 267/527] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.168970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.169971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.171231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.171505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.171774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.179485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.180876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b5282-d594-4443-a1c0-370d95e7dff4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.181500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.186495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.187267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.187645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.188028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.188941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.189342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.191235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.195869 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 03:43:04.197230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 261/528] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.197825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.205398 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 268/529] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:04.205761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.215256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6bb0-264a-42f1-a67c-6e2deb839102 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.218484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab62f6-5f2b-4dd6-893b-b8453a1e932f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.220617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.221495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.221883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.222184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.223109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.223486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.223607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.224381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.224756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.225101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.225671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.238039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:04.244288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 269/530] 10.222.0.13 () {56 vars in 1160 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:04.245253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.249487 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:04.253580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 262/531] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.254685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.259304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38827-824a-4f12-9eea-23ffabe09d63 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.264411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.265417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.265768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.266239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/7e779dee8d114aa890e1725ef72b0ac7/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.267097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a62f5-6556-4ddf-bcb3-ff8d4da37829 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.273085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.273957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.274291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.275013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.283380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=7e779dee8d114aa890e1725ef72b0ac7, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.286244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.289041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.291579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.304376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 270/532] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:04 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/7e779dee8d114aa890e1725ef72b0ac7/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:04.310074 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:04.311983 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 263/533] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.313371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.322259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.334293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2e95-50d0-414d-9207-717314a904ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.421718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.422623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.423003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.423376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.424294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.424720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.426440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.439484 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 264/534] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:04.446324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.457604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d309e4a-4b16-4dfa-96dd-4c9ed9d92aed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.461009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487db19d-3b42-473d-8d5c-35adde1d5d69 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.462996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.463985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.464362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.464785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.465662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.466826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.467102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.467374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.468126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.468426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.470047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.474357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.477303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.478932 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 271/535] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:04.485225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.493673 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:04.495205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161918f-ef5d-4d57-ac0a-d64858a63a98 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.495371 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 265/536] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.502050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.508553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.509388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.509663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.509930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.521667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de01b5-ab93-4b78-aee3-8c0d4a93454c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.521860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.525000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.541649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.542319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.542595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.542865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.543780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.544114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.545546 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:04.546076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.547081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 272/537] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:04.553471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.570131 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 266/538] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:04.574050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c465e-ae67-4215-aee0-b0eb342c50db admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.576823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.585916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.587357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.587701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.588039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.589446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.589780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.591410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.592152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f19fa-8bc3-48ad-b617-b57910c082b3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.597354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.598466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.598936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.599436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/5d487008cbef426790f5b2e475643ade/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.605461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 273/539] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:04.611607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.616457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=5d487008cbef426790f5b2e475643ade, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.620246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.622997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0c2c-de9a-43b1-ab3e-23847e7b0607 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.628117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.629318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.629733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.630161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.639464 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 267/540] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:04 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/5d487008cbef426790f5b2e475643ade/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:04.640597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.642740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.657328 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:04.660274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 274/541] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:04.665681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.734727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bb034-63ab-4c31-ba2e-5ad84c527812 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.739813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.740710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.741087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.741456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.742450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.742915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.745075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.768185 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 268/542] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:04.774628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.784464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc365-2b84-4807-b55e-adc81800666b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.789196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.789970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.790384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.790746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.804657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.804657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.812227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 275/543] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:04.818993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.830016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6da16-5b3d-4a33-bd7b-a4522ac28738 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.841319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.842336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.842708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.843108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.862941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.865055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.896353 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:04.897789 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 269/544] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:04.904413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.913847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3871c5-2b9e-4d82-9069-a1fdc69b4319 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.918713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.920043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.920413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.920813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.921708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:04.922108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.923846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.942813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 276/545] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:04.949407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:04.961778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7160-b093-4ecd-b3e5-acf013ab75d0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:04.966857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:04.967691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:04.967967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:04.968239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:04.975924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:04.978019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:04.993779 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:04.995241 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 270/546] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:05.002412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:05.012516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac9d9-c0de-4bf4-8dfe-b22d5b2779d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:05.017421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:05.018224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:05.018677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:05.019112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:05.020100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:05.020599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:05.022655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bb2f0-f130-423a-8e34-3e85e3ad14dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:05.035864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 277/547] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:05.042562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:05.053886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457b1a-fc6e-4bb3-8883-ab0c769b42d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:05.058594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:05.059378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:05.060357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:05.060847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:05.061817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=525c6651aaa6451cbe1dd9f91e1c68ec) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:05.062281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:05.064217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0550e9-f0ee-4842-b306-156a0ddbc03f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:05.070210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 271/548] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:05 2021] GET /identity/v3/role_assignments?user.id=525c6651aaa6451cbe1dd9f91e1c68ec&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.051347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca85b-60a0-4eef-8a29-3d041b246ee4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.051854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca85b-60a0-4eef-8a29-3d041b246ee4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.051927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca85b-60a0-4eef-8a29-3d041b246ee4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.053957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 278/549] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:06.062082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.062538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.062613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.085682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:06.086788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:06.100445 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 272/550] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:06.149747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ca85b-60a0-4eef-8a29-3d041b246ee4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.166254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ca85b-60a0-4eef-8a29-3d041b246ee4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.175731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.176506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.176810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.177078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.190200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:06.197259 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:06.198755 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 279/551] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:06.209894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.221385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767613fc-bf17-44f6-b065-b441aea80199 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.228839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.229493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.229765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.230032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.230787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.231085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.233242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.248555 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 273/552] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.254579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.269774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ad89-128e-446a-8d9f-2efc7aadcf27 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.276662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.277448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.277725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.277997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.296893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.298715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.320518 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:06.322117 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 280/553] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:06.328191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.351124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d520-1108-4441-9df8-f0b96550f9bc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.358144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.358807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.359083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.359352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.360099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.360429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.361964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.382573 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 274/554] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.388747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.401938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db74ea-44a0-4d4c-b467-9cca70dda270 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.412695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.413485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.413762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.414031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.429727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.431696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.449275 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:06.451381 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 281/555] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:06.457628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.473514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800300c-2251-4a91-9ac3-306eb34fb661 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.485237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.485906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.486182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.486453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.487301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.487601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.489457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.517045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 275/556] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.523130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.537833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5217-41d7-45c4-a6af-2947ac5cfa0d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.548682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.549329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.549607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.549879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.568300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.570360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.582468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 282/557] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:06.588571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.602260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cd2d-e028-4acd-acbc-925defe64a6f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.612783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.613572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.613843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.614107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.636039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.636039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.654512 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:06.656409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 276/558] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:06.662959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.676299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7014-cbcf-4ddc-81ee-0d390bdd0e97 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.690227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.690899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.691178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.691450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.692191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.692493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.694365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.713810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 283/559] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.720423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.730543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5f5ef-a99f-4dd5-9ce3-e970d19fbe42 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.740796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.741813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.742289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.742757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.755534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.757763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.777641 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:06.787951 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 277/560] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:06.789458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.815068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aab1c-a48c-4bb8-b15d-535f893652a8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.831087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.831759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.832036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.832304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.837199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.837520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.839336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a449a6-bec4-4294-8d5f-402f9660c275 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.861713 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 284/561] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:06.868665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:06.884536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b93f-457e-4b4c-a221-6f3870cf6fd6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:06.898932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:06.899587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:06.899858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:06.900125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:06.900988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:06.901290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:06.903103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112ae9-2d90-4557-a98d-8da54d0446b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:06.913638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 278/562] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:06 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.052790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16c1f-b942-449d-b910-925dcc6b63df None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.053784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16c1f-b942-449d-b910-925dcc6b63df None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.054338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16c1f-b942-449d-b910-925dcc6b63df None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.056765 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 285/563] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:07.065139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.065705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.065705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.090776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:07.092034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:07.103667 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 279/564] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:07.147043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16c1f-b942-449d-b910-925dcc6b63df None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.163081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16c1f-b942-449d-b910-925dcc6b63df None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.170180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.171210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.171687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.172193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.185430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:07.192487 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-cc922bbb-d90e-458f-99af-9c6abd3dc3e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:07.194518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.201448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.213617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39d2a0-e04c-481e-ad9a-147320522eb9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.221992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.222659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.222939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.223210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.223999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.224276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.225879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48c22f-2de1-42ca-b88b-47cf21ac1da6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.230431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275ddf-58a7-492c-8e86-e73108e2ffee None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.230990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275ddf-58a7-492c-8e86-e73108e2ffee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.232052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275ddf-58a7-492c-8e86-e73108e2ffee None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.235153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 287/566] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:07.235667 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 280/567] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.241957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275ddf-58a7-492c-8e86-e73108e2ffee None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.242531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.242817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.243091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.261197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275ddf-58a7-492c-8e86-e73108e2ffee None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.263184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:07.264431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:07.266705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.267708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.268164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.268648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.280725 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 281/568] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:07.281246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.283364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.300563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.301251 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:07.302883 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 288/569] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.309027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.314211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31672d86-59cd-4b3d-9923-5869643596d6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.324439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.325054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4d11-d4eb-44a2-b36c-9b9a06f391b6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.325283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.325563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.325846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.331676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.332557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.333312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.334086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.335052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.335557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.336817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:07.337985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.343679 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:07.348722 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 282/570] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:07.351671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.353439 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 289/571] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:07.360962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.362134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396dcb5-13d1-45f7-8a79-053e9fd44a8b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.367563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.368213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.368519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.369339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.370099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.370403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.372882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.374009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6fa9-eb2c-45d0-93e4-ee0040431f4f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.380362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.381486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.381965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.382466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.384908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 283/572] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.388777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.391837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.394127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.400472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f49c6-4285-4697-9e96-6c160442ba38 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.406266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.407090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.407417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.407737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.411544 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 03:43:07.413261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 290/573] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:07.419896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.421422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.423364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.430297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44949-8cd9-47b5-8309-c91a24705c00 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.435947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.437219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.437689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.439303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.439303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.439616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.441872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.442054 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:07.448695 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 284/574] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:07.450747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.464274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0052a03-0805-4acd-8434-d09886f22126 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.467606 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 291/575] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.469855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.470613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.470992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.471383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.472216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.472773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.473581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.474544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.485313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb76a-c6a4-4393-ab28-426ac8a09451 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.488577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 285/576] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.494122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.497809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.502652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.503030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.503404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.508933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7550-ba8e-4eeb-ad09-9af4407f733e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.513608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.514759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.515705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.516073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.516192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.516528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.526800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.529085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.529267 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 292/577] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:43:07.535349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.546156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076bad1-475d-49da-a1f5-72c6622272a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.548568 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 03:43:07.553170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 286/578] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.555304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.555304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.555304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.556525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.557269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.569058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce415-d3c0-41f0-92fd-8cce1871376f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.571420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.573756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.574547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.575405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.576372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.576372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.577756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.578213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.580166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.593032 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:07.595514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 293/579] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.601360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1158 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.601767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.613517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.617851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784b19-739b-4b38-91d9-acc7b23a5ee0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.622727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.623605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.624030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.624486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.625446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.625885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.627636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.635015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ea23-7473-4a66-b944-da8fa6b806ee admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.642734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 294/581] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:07.649117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.649530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.649764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.650043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.650310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.660788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff18e6b-f095-4747-a105-fdedbacbf929 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.665634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.666631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.667102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.667541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.673803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.675546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.676262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.678412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.694618 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:07.700689 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 288/582] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:07.701342 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 295/583] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:07.703277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.708796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.720281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8916-40ab-4030-a4d0-131d95e76ad1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.723699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d0c0-40a3-49bb-89cf-a7ea6ea8eabe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.731330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.734383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.735232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.735575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.735996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.736405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.736875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.737842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.738918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.739545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.746708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.750470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.752477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.767937 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 296/584] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:07.774285 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:07.775911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 289/585] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.782678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.783989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.795168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327361-e289-4801-9129-c681538e7f35 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.800062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.800913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.801408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.801811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.802828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=b0e3e62850b34fe786eda1156be94f74) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.803314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.805406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e2b3d-e142-4bab-b810-6e6af58460bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.807934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e78fc2-db1a-4a5e-b053-c270e61e9de2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.813061 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 290/586] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/role_assignments?user.id=b0e3e62850b34fe786eda1156be94f74&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:07.842695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.843377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.843656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.843926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.844697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.845673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.847319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.861693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed2b-1cd8-405c-b285-e3b72f3290b6 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.862212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed2b-1cd8-405c-b285-e3b72f3290b6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.862656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed2b-1cd8-405c-b285-e3b72f3290b6 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.864934 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 291/587] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:07.872148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 297/588] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:07.873833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.874261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.874674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.889704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.900075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:07.901531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:07.913386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fcf5-9d9c-4211-9757-ab56cb7676f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.916042 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 292/589] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:07.921044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.922096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.922518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.922931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.930790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.933009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.947178 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:07.949236 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 298/590] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:07.956339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.967173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc6d3-6e3f-49b9-abc1-6af9dbe2a293 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.968379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:07.978825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.981209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.981719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.982598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:07.984309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:07.985383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:07.988410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ed0cb-8f82-403e-b215-73f8d45dbca3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:07.992462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea2ec-9a12-4e9c-912a-1fb1868afcb9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:07.997218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:07.998637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:07.998637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:07.998637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.008782 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 293/591] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.010616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b58e-12d2-441f-b5a3-55b981bb6bc7 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.010855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b58e-12d2-441f-b5a3-55b981bb6bc7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.011129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b58e-12d2-441f-b5a3-55b981bb6bc7 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.013675 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 294/592] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:08.014257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b58e-12d2-441f-b5a3-55b981bb6bc7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.026286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:08.035468 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-09a91aed-2145-40e7-a2a9-8424241b79b3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:08.037022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 299/593] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.037186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b58e-12d2-441f-b5a3-55b981bb6bc7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.038499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.038945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.039375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.046518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.046518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.046518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.046518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.046942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=7e779dee8d114aa890e1725ef72b0ac7) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.046942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.050394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.055426 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 295/594] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/role_assignments?user.id=7e779dee8d114aa890e1725ef72b0ac7&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.056257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.066686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1714a-062a-4f64-902a-0000dff87e96 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.072552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.072552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.073016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.073361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.073862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:08.074293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.074614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.076678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:08.076981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.086996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 296/595] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.088674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 300/596] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:08.097752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.108375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b001ec-9f03-499f-84e3-e438b6380ea1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.113417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.114328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.114606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.114940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.121687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.127957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.130243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.132150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85988e4a-6009-4468-9096-a0cf812a6472 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.136958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.138473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.138851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.139224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.150753 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:08.152206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:08.152768 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 297/597] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.160666 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:08.161795 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 301/598] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.162039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.168539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.179385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9d68-e342-467f-a796-835f6fed8bdd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.179793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bfff-f8d6-40bb-89b8-4c9d9115d556 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.185127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.185842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.186219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.186590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.187452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.187857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.188494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.189371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.189763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.189982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.190401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.191603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.192118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.194716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.201569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 302/599] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.208108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.210337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 298/600] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.217536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.218960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335277c0-d077-451a-9b86-82d62b445d87 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.223680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.224647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.225020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.226025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.230924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941634c-35ea-496e-b9f8-e1f72e045869 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.237439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.237763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.238601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.239023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.239461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.240070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.249366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.252057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.260197 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:08.268732 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 303/601] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.269898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.272878 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 03:43:08.274303 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 299/602] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:08.280478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb94ce-d48e-4d00-b6ac-ff3579172697 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.281033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.285454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.286262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.286635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.286988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.287826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.288222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.290187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.294671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309a10-7922-4027-9afa-0c4b36d65ad3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.304313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.305102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 304/603] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.305461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.305867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.306317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.307329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.308955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.311663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.312530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.324052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0bdf-1859-4783-a6b4-6702fd1d8848 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.330909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.332068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.332068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.332524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.336074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 300/604] 10.222.0.13 () {56 vars in 1160 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:08.342709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.348383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.350415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.353782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa947b1-4c77-4d03-93bf-3a2c481554b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.359357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.360203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.360702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.361147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.364831 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:08.366426 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 305/605] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:08.371757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.373318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.374412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.386406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a64c2b-ba19-4ae1-89ec-0c65c9ca2ea1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.389365 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 301/606] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:08.395758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.397437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.398344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.398713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.399078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.400361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.400803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.403465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.406416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766f79-e47f-4bf2-95f9-902fee3d4644 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.412071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.412871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.413142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.413411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.424988 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 306/607] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.425333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.427501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.431513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.446087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867615-7eb6-47cf-9ed2-9d8f75a7e11b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.446568 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:08.448244 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 302/608] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.454934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.458121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.459125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.459531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.459989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.465003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa605cb-0ef0-4069-b585-ab92cf9e3d5c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.470233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.470233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.470522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.470790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.471617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.471911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.473726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.478070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.480084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.486223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 303/609] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:08.496653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.502121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfd60-4021-4f7a-b5e5-e11d360e7887 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.507636 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:08.509012 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 307/610] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:08.516446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.517308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.517644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.517791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.517966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.530393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049667e-4ee7-48ee-b142-a513d063322d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.533569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.535038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.535620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.535802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.536176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.536460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.537281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.537580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.539204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.551872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 308/611] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.558121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.563400 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:08.564589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 304/612] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:08.569001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cb30-0c63-465a-ab12-e405c97a86bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.573602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.578937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.579711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.580632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.580935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.594690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a098be-9bea-4480-b476-e09d782e5688 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.596355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.598310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.603897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.604774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.605052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.605321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.606998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.607207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.612344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.632262 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 305/613] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.634048 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:08.635345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 309/614] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:08.641684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.652258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836444-e42e-49da-b00e-0402119aefd2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.655285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.658374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.659293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.659758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.660182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.661319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=5d487008cbef426790f5b2e475643ade) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.661903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.664002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.671595 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 306/615] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/role_assignments?user.id=5d487008cbef426790f5b2e475643ade&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:08.679039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c379d-167c-4785-8983-92b204ea0dea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.698079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.698765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.699043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.699315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.700136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:08.700509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.702442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176173a-30e9-4d09-adcb-9d22f26a4125 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.730415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 310/616] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:08.738072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:08.756719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf15b6a-7265-4c54-85dc-48c2cd45d3dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:08.761995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:08.763337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:08.763836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:08.764350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/525c6651aaa6451cbe1dd9f91e1c68ec/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:08.781756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=525c6651aaa6451cbe1dd9f91e1c68ec, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:08.784841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b8667-b9a6-4999-8ad3-dc8040b40dd7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:08.802187 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 307/617] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:08 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/525c6651aaa6451cbe1dd9f91e1c68ec/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:10.103036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738910-770d-4255-8139-6ceb8b07847a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.103541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738910-770d-4255-8139-6ceb8b07847a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.103541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738910-770d-4255-8139-6ceb8b07847a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.105565 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 311/618] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:10.113528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.113937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.114103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.141582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:10.142975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:10.219515 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 308/619] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:43:10.247165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738910-770d-4255-8139-6ceb8b07847a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.262443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738910-770d-4255-8139-6ceb8b07847a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.267653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.268443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.268750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.269022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.280362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:10.287145 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:10.292725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 312/620] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:10.295163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.307931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf40cae-53a6-4fbc-83be-009d48d595ab None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.312499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.313248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.313523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.313794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.314547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.314846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.316426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.330803 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 309/621] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:10.332160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.343520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc7d7-5b6d-48d9-bfa0-cbbf449d1855 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.348346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.349152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.349429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.349699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.368083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.369889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.394285 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:10.400724 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 313/622] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:10.402072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.415941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e52997-dd20-4ae1-b418-1e4ccf157860 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.420529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.421212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.421488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.421758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.422487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.422812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.424354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.442782 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 310/623] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:10.449338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.465729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317f32-0401-415e-a68a-ccfa4ec37485 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.475590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.476381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.476687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.476959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.489909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.491897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.512012 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:10.515005 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 314/624] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:10.520198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.530631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3793d-a81c-45bc-b2df-7c15d8afd221 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.535222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.535927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.536208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.536481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.537472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.537777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.539719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.560998 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 311/625] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:10.565123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.575904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3d54f-5a2b-44b5-bfa4-c2d24b34ed86 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.580630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.581338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.581613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.581932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.590559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.592344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.601719 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 315/626] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:10.607937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.617596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76584c-c44e-4f7b-a1b9-9ef5a1703449 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.622637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.623351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.623630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.623951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.634541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.636359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.654405 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:10.660823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 312/627] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:10.662180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.671155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040d702-6fd0-4ebc-820e-146f6713cb43 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.676342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.677104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.677385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.677705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.678438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.678736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.680293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.695377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 316/628] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:10.699105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.710990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5331-2798-46dc-a418-ef245bef6ff6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.717385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.718210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.718485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.718756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.729987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.732065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.744834 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:10.751713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 313/629] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:10.753078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.764804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038b1b0-83b4-496f-a16d-ac61f3cd2411 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.771805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.772543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.772900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.773230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.774065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.774377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.776360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bfe63-e3a6-4b82-89c6-5925f8ba67a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.798717 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 317/630] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:10.811323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:10.831022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae73b-3f81-4547-a12c-f30035bd984a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:10.835744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:10.836490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:10.836800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:10.837072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:10.837912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:10.838215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:10.840065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5791b8-8b4f-48f1-8c18-46ab8d451552 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:10.852768 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 314/631] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:10 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:11.010046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fb41-13c4-4fcd-93d7-04d554c34717 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.010405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fb41-13c4-4fcd-93d7-04d554c34717 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.010644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fb41-13c4-4fcd-93d7-04d554c34717 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.013303 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 318/632] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:11.021173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.021461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.021720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.045432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:11.046646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:11.058271 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 315/633] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:11.087133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3fb41-13c4-4fcd-93d7-04d554c34717 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.108017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3fb41-13c4-4fcd-93d7-04d554c34717 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.113254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.114067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.114343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.114611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.129414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.131277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.159315 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:11.160857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 319/634] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:11.167076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.179414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ed44-535d-4095-b819-5ce260472927 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.184099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.184811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.185090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.185419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.186154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:11.186504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.188093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a2fd-1a05-45a4-ae94-85de16919eec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.212222 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 316/635] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:11.219209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.237569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257c6f-16f5-48a7-a44a-9e4d33e9e669 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.253824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.254501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.254784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.255063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.255790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.257713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.271622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271afe-e18f-455c-999e-6ed0375332c6 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.271882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271afe-e18f-455c-999e-6ed0375332c6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.272101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271afe-e18f-455c-999e-6ed0375332c6 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.274277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 317/636] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:11.282178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.282465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.282748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.296637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 320/637] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:43:11 2021] POST /identity/v3/users => generated 254 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:11.313826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:11.315096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:11.324271 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 318/638] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:43:11.350266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.361183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802bafe-47c2-4a5a-8e01-8835f717ce79 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.365951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.366812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.367092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.367418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.368188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.369286 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:11.369286 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:43:11.369286 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:43:11.370229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.384275 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 03:43:11.385879 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 321/639] 10.222.0.13 () {56 vars in 1150 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:11.392869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.402623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68364734-0057-4bf1-86e5-c290511651f1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.408054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.408778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.409058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.409328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.410138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:11.410439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.411568 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:11.411568 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:11.411568 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:11.412535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557f560-cd72-4665-a884-9469deb5e9a5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.418445 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 319/640] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:11.425146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.435324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eb3-0cdb-4d4c-8cb7-99c67143e43b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.440539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.441308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.441818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.441987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.442724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:11.443070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.444359 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:11.444359 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:43:11.444359 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:43:11.445377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f9eb-dcf4-49cf-97a1-e25c3f700f33 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.452995 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 322/641] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:11.774961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e49c-6421-4270-aed4-69fce802523f None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.775258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e49c-6421-4270-aed4-69fce802523f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.775532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e49c-6421-4270-aed4-69fce802523f None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.777643 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 320/642] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:11.786440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.786727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.786988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.811077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:11.812275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:11.822257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 323/643] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:11.850901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e49c-6421-4270-aed4-69fce802523f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.864318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e49c-6421-4270-aed4-69fce802523f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.871548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.872379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.872682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.872957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.885991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:11.893492 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0168c020-4f3d-4652-8727-93a001a4e095 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:11.894984 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 321/644] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:11.901391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.911148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28557-fd6f-4f5e-beb3-d5f2503a52b0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.915900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.916729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.917106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.917479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.918337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:11.918739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.920478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.929412 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 324/645] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:11.930691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad31c7-4fb4-43a4-b22f-6a2736edf44b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.931222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad31c7-4fb4-43a4-b22f-6a2736edf44b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.931561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad31c7-4fb4-43a4-b22f-6a2736edf44b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.934950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 322/646] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:11.939133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:11.940884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.941164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.941431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.959253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c08a3-2c57-4e4c-9a7c-87df6e2f7d49 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:11.968790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:11.969885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:11.970339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:11.971235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:11.977682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:11.978880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:11.985384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:11.987492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:11.990716 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 323/647] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:12.005716 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:12.007339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 325/648] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:12.014157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.024378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a02d9-ba48-46c9-86bf-44cdce86aabb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.030540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.033070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.033751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.034030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.034303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.035042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.035344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.041038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.042801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4d84-99cb-490c-9592-085414453b2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.048784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.049792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.050354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.050820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.051695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.053541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.057528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 324/649] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:12.064835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.071861 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 03:43:12.074369 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 326/650] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:12.078730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f234-6c02-4daa-879d-a169487d7963 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.080474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.090599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.092844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.093354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.093827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.097177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31d8b-c5c4-4348-b7b0-bfc65e5e5387 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.107750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.110595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.113367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.114619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.115185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.115666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.116681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.117195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.119069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.130416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 327/651] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:12.136213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.145893 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:12.148377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 325/652] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:12.150834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7783a-e64a-4f72-81dc-f5009c190050 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.155647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.156540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.157165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.157666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.158570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.159113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.160996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.163977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.175063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95664f3a-4acb-4dab-9341-f56c17e86f59 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.178921 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 328/653] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/services?type=network => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:12.182495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.183491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.184011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.185106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.186211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.186768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.189065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.209668 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 326/654] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:12.216302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.230244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ac46-816d-4a45-9977-cca5997c8418 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.246385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.247071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.247345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.247615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.260930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.262712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.276089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 329/655] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:43:12.282657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.297167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b322-dd59-4ebe-934a-cb58e4445dd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.317529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.318352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.318630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.319163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.339172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.341607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.363112 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:12.368767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 327/656] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:12.371058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.381403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e09d-af0e-4fdf-9e92-882f0001ddbe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.387970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.388657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.388939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.389209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.389961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.390259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.391868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.408777 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 330/657] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:12.415053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.430032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17020da-4328-4c40-9d10-1f8b53443ed5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.438820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.439625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.440276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.440550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.448887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.451363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.464928 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:12.467054 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 328/658] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:12.473330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.483027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1da3-5306-4487-9d34-cbfb4e8a8451 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.487489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.488132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.488405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.488701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.489512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.489785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.491572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab05d-b8cf-4706-8a3e-804c89eceaba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.503429 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 331/659] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:12.509796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:12.521240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9fb32-4090-4410-b553-349f933f0737 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:12.525748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:12.526372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:12.526647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:12.526912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:12.527747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=525c6651aaa6451cbe1dd9f91e1c68ec) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:12.528043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:12.530417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7589c5b-6619-43c9-936b-f7f70b30fdbd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:12.536796 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 329/660] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:12 2021] GET /identity/v3/role_assignments?user.id=525c6651aaa6451cbe1dd9f91e1c68ec&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:13.560140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e03c-0366-4f4a-893c-885a7e625670 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.561169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e03c-0366-4f4a-893c-885a7e625670 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.561643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e03c-0366-4f4a-893c-885a7e625670 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.563902 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 332/661] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:13.571612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.572486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.572991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.597565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:13.599093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:13.613063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 330/662] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 03:43:13.650123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71e03c-0366-4f4a-893c-885a7e625670 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.672178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71e03c-0366-4f4a-893c-885a7e625670 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.678968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.679755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.680039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.680293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.701507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:13.708331 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:13.710853 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 333/663] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:13.716755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.734786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a953b9-bfd6-4929-89c5-6e55d85b30c6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.746372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.747445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.747948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.748408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.749386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:13.749896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:13.751646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:13.764164 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 331/664] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:13.770593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.785638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1587-8b29-40be-ab66-173279cbe547 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.790044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.790817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.791096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.791366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.817209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:13.819205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:13.845417 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:13.846607 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 334/665] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:13.853238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.865875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89d19-5b57-4619-b2c0-f5e42d1562e3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.876762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.877675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.878249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.878723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.879658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:13.880145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:13.881935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:13.898880 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 332/666] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:13.905744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.922171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ec66-c1c1-4a93-8bfa-57ff7f3f7039 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.926786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.927569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.927846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.928118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.938356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:13.940331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:13.960011 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:13.961360 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 335/667] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:13.967960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:13.977759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a850f-fea1-446a-a8a3-6750d67f3532 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:13.988384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:13.989071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:13.989351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:13.989623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:13.990466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:13.990770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:13.992574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.010155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 333/668] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:14.016807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.030142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300132-2c8b-4ca0-ae81-3415ebc81ab0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.034559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.035337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.035612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.035882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.049710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.051539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.071393 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:14.076715 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 336/669] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:14.079452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.089220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9b0ca-5d46-4510-8f5c-145158ffe8da admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.100185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.100865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.101144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.101416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.102146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:14.102451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.104023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.120925 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 334/670] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:14.127353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.137297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6ce5-44d7-4585-a644-8e4a63f16fcd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.142265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.143052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.143329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.143702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.157041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.158979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.174811 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:14.176150 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 337/671] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:14.182443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.192280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076330-31bf-49c8-87c6-421e31dcffbf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.200759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.201409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.201684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.201956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.202746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:14.203053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.204893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bb09-3e16-458d-bb23-7ef13c1a8293 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.224434 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 335/672] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:14.230647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.246379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14f6f-e2ab-4ae2-9c34-a61fe43380f9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.251049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.251954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.252231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.252520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.254644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=d1d98a52e85d40a5b77f40d833837869, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.257440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b288e-99a9-4371-8f2e-31e28ceec6e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.275587 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 338/673] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:14 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:14.398094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892446-2fde-46a0-8a27-f0d739cd1df1 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.398450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892446-2fde-46a0-8a27-f0d739cd1df1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.398645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892446-2fde-46a0-8a27-f0d739cd1df1 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.401042 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 336/674] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:14.408694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997f8d-1995-4379-9e4a-f8ffd800f8c9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.409007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997f8d-1995-4379-9e4a-f8ffd800f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.409239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997f8d-1995-4379-9e4a-f8ffd800f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.433911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d7997f8d-1995-4379-9e4a-f8ffd800f8c9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:14.435659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d7997f8d-1995-4379-9e4a-f8ffd800f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:14.529036 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 339/675] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 03:43:14.574744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20892446-2fde-46a0-8a27-f0d739cd1df1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.588634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20892446-2fde-46a0-8a27-f0d739cd1df1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.593585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.594234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.594512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.594785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.595526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.596531 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:14.596531 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:14.596531 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:14.597419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc952-2485-472e-adc9-c22e14082260 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.617248 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 337/676] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:14 2021] POST /identity/v3/services => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:14.666499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00df19-efb7-4a37-a067-735bcba960c9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.667114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00df19-efb7-4a37-a067-735bcba960c9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.667114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00df19-efb7-4a37-a067-735bcba960c9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.669413 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 340/677] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:14.677228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.677526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.677772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.701648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:14.702848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:14.722448 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 338/678] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:14 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:14.770149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00df19-efb7-4a37-a067-735bcba960c9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.794843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00df19-efb7-4a37-a067-735bcba960c9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.799572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.800387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.800688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.800959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.837807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:14.844975 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:14.846600 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 341/679] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:14.853062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.869371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89822-edab-419a-95a9-66bfc0df76ae None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.886172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.886852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.887130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.887401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.888202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:14.888501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.890139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.905115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 339/680] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:14.911499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:14.926611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465ea6d-3aa4-4378-9c05-ed9aa6b78e6e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:14.942777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:14.943671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:14.944202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:14.944469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:14.961865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:14.963686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:14.981825 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-59b4dc36-4a16-4a1a-9f3f-57b28111e799 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:14.983301 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 342/681] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:14.989268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.002439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db8a8-2327-419f-b294-9e9e1854d5e3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.013481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.014293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.014572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.014842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.015575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:15.015919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.017598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.024265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39728532-2813-46ce-addd-6151fb3d4993 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.024640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39728532-2813-46ce-addd-6151fb3d4993 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.025031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39728532-2813-46ce-addd-6151fb3d4993 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.027148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 343/682] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:15.032052 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 340/683] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:15.035268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.035651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.036025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.037685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.050897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21df25-c1ab-4aba-9399-c92c21594bfd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.056875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.057283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:15.057669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.057945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.058217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.059171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:15.066786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.069514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.071614 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 344/684] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:15 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:15.083687 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:15.085140 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 341/685] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:15.091812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.097210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.107269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bef1-f816-4229-93e8-578f260f2b3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.110101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184cbac-92f2-4a8f-837c-dc4cdc291cd0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.111925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.112562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.112904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.113172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.113897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.115473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.116183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.117090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.117603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.117973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.118919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:15.119330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.121358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.132932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 342/686] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:15 2021] POST /identity/v3/services => generated 240 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:43:15.163643 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 345/687] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:15.170408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.205734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa580-beda-4f37-8767-276f2881b3eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.217542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.218217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.218493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.218763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.233329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.235110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.251051 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 343/688] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:15.256900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.275067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b999-87c0-4be0-b001-f1c73d486d31 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.289443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.290254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.290530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.290800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.302589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.304538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.322546 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:15.324092 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 346/689] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:15.330406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.339594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba411b-b91f-42a4-ac1d-77a66f9030d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.344830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.345503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.345782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.346053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.346795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:15.347097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.348733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.363135 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 344/690] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:15.369318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.379488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be4743-1380-4f51-bc96-9f1a2a38e493 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.384057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.384873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.385151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.385420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.392687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.394619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.408665 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:15.410158 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 347/691] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:15.416443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.427042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40e90e-fc7a-4b38-83f9-1e4bd96d66e4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.431602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.432259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.432536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.432853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.433645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:15.433951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.435782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627f38-2518-413b-b98b-1b0d59376e4c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.452826 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 345/692] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:15.455996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:15.467086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed29a-0e56-4d41-b56a-2de05e4a5d46 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:15.471592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:15.472233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.472502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.472805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.473641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=c7a31642b9b94735b7a1d6614f041347) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:15.473946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:15.475744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237b08-276e-428e-b2a0-a0bca9ebc761 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:15.481861 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 348/693] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:15 2021] GET /identity/v3/role_assignments?user.id=c7a31642b9b94735b7a1d6614f041347&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:15.971021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a02-9875-4198-ac69-aec2c0421eaf None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.971525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a02-9875-4198-ac69-aec2c0421eaf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.971525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a02-9875-4198-ac69-aec2c0421eaf None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.973624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 346/694] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:15.981756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:15.982211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:15.982284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:15.999594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:16.000816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:16.008550 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 349/695] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:15 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:16.033907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0a02-9875-4198-ac69-aec2c0421eaf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.046567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0a02-9875-4198-ac69-aec2c0421eaf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.055001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.055769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.056046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.056318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.073485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:16.080206 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:16.081637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 347/696] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:16.088022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.101424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5501a15-a03c-451b-88b4-6332c83cfc1b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.110062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.110718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.110989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.111252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.112004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.112299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.113976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.127580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 350/697] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:16.133701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.149575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1282bd-1eb3-4d65-a0cf-00fd89d294bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.157206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.157980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.158258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.158552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.178577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.180385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.208765 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:16.210276 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 348/698] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:16.216878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.233388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213379e-5baf-4ac0-8168-8667134bd605 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.246107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.246785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.247065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.247332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.248066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.248362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.249956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.271858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 351/699] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:16.277905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.297525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f79c5-021d-4aac-a7cb-2512abab943f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.304686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.305467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.305743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.306013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.321724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.323711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.344431 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:16.345981 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 349/700] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:16.352315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.368325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cd551-6b29-423e-b247-d72b751375ad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.381777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.382432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.382707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.382974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.383822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.384124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.386007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.412109 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 352/701] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:16.418337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.433568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbd72d-4d4a-4490-93e0-28c98338a219 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.440687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.441527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.441693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.441845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.456238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.458049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.470818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 350/702] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:16.476784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.490028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57e6b-d0ad-4f69-9cc0-b8bfdda11029 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.500640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.501442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.501716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.501985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.520264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.522118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.541245 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:16.542698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 353/703] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:16.548840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.565731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a548-dfb4-4525-85f0-c8f1b8accd3a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.577844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.578512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.578787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.579054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.579783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.580081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.581687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.597881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 351/704] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:16.603540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.617538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de8673-8eeb-4e53-9797-0bc92a0cd081 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.629770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.630559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.630833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.631099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.641750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.643673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.659921 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:16.661398 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 354/705] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:16.667808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.681687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6936-61a2-48c1-9c4d-b99874ce2b8e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.688713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.689357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.689634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.689902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.690692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.690991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.692814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02a14-bd44-4efb-a8c8-d5dd6153f86e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.713850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 352/706] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:16.720068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:16.733438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2503-6868-4437-8cc0-7c6df20bc01e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:16.740805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:16.741454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:16.741725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:16.741993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:16.742827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=525c6651aaa6451cbe1dd9f91e1c68ec) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:16.743132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:16.744963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48163eb-4036-4984-9242-00bdf7b11b7f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:16.756996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 355/707] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:16 2021] GET /identity/v3/role_assignments?user.id=525c6651aaa6451cbe1dd9f91e1c68ec&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:17.560759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172136-4a55-462a-b9b3-fc5795a54f10 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.561462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172136-4a55-462a-b9b3-fc5795a54f10 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.561462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172136-4a55-462a-b9b3-fc5795a54f10 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.563340 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 353/708] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:17.572236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842054e5-c5c3-42fb-870e-18d81769c1eb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.572777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842054e5-c5c3-42fb-870e-18d81769c1eb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.572941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842054e5-c5c3-42fb-870e-18d81769c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.597552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-842054e5-c5c3-42fb-870e-18d81769c1eb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:17.598732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-842054e5-c5c3-42fb-870e-18d81769c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:17.606525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 356/709] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:17 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:17.650184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172136-4a55-462a-b9b3-fc5795a54f10 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.670360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172136-4a55-462a-b9b3-fc5795a54f10 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.670856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8968-ae99-4336-ae8a-c3376d805234 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.670856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8968-ae99-4336-ae8a-c3376d805234 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.670856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8968-ae99-4336-ae8a-c3376d805234 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.671382 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 357/710] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:17.674241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.675093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.675369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.675637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.680390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.680390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.682092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.693689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:17.699493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:17.700499 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:17.701182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:17.702004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 354/711] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:17.709697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.713071 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 358/712] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:17 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:17.725508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225bcd-8a2a-415a-9804-67a4e86416ec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.737223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.737880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.738158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.738429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.739502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:17.739813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.740778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.741414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.750504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086caa5b-0cd3-46e0-b0e3-dc5e60649d7f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.755051 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 355/713] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:17.755611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.756657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.757219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.757680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.758531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.760459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.760895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.778776 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 03:43:17.784037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c7b4-208c-4205-bf3e-e72a743ea867 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.793040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 359/714] 10.222.0.13 () {56 vars in 1150 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:17.794492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.795568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.796094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.796554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.801324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.817769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98f8a-3f28-44be-9f02-6e169676a1fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.821531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.824446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.830195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.831157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.833026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.833311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.834063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:17.834369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.835931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.845747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 360/715] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:17.852066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.857316 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:17.858779 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 356/716] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:17.863008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01eb82-0df9-4d7f-85c1-27f420f1ab4c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.864560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.874534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6301-d411-4b8e-b12b-0c84b0324632 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.877187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.878113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.878653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.879117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.880093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:17.880595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.882445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.889280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 361/717] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:17.896056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.897975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.900404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.900915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.901413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.904371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:17.906110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.910112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.919339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81053c9b-a908-4c3e-80ff-a96978bb1927 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.927261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.929386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.930201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.931444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.932446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] RBAC: Adding query filter params (interface=public, service_id=e5f5cc7112bf4b32888bf1f2436bf5b9, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:17.933102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.934113 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 357/718] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:17.935046 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:17.935046 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:43:17.935046 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:43:17.936226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.940204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.952719 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 362/719] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/endpoints?service_id=e5f5cc7112bf4b32888bf1f2436bf5b9&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:17.955675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:17.960706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb30d0-4077-4a8b-aa2b-8ec3764c83bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.970447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.972718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.973773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.974720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.978195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291c76-2b51-4133-be74-656225aaf37f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:17.987365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:17.989731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:17.990621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:17.991464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:17.992780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.993895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:17.998047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:17.999628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.010407 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 363/720] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/services => generated 772 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.024824 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:18.026769 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 358/721] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:18.033594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.044164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1db4-8605-4f62-938a-eb58177cadf2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.052857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.053900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.054419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.054900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.056009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.056505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.058604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.080785 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 364/722] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.087026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.097788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae464-3353-4aa4-bb81-d0ad5ff0582f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.106249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.107264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.107736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.108219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.118460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.120539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda808de-56f2-468f-be36-8f56a6f42d88 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.134549 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 359/723] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:18.141706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.152222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bc2d6-5eee-4c7b-8a44-717e6fd2c282 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.160177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.161353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.161826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.162331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.166126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69087-da1a-46ea-a306-71f404e05018 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.166714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69087-da1a-46ea-a306-71f404e05018 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.167242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69087-da1a-46ea-a306-71f404e05018 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.169339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 360/724] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:18.179651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.181921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.186657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.186951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.187215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.203972 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:18.206041 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 365/725] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:18.212283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.222161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb34a-326d-4e57-a5f1-50b13bf63171 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.226713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.227375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.227669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.227928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.228703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.229006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.229719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:18.230595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.230942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:18.242811 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 366/726] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.249616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.258392 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 361/727] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:18 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:18.266877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd422739-c1d8-4951-847c-9514834b560d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.272078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.272969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.273343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.273621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.287810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.290012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.312690 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:18.313949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 367/728] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:18.320853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.328404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.338467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74daa-a5f1-4bdf-9b24-2cff921e5aa7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.343258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516e996-d2b0-4c18-9716-9b0c371ea126 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.343432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.344231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.344551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.344901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.353283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.354596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.355096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.355563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.356942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.357059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:18.357574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.359585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.364690 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:18.365776 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 368/729] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:18.372751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.385223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 362/730] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.390740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.391973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17bac-d986-4c8f-bdac-938e0e13f501 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.396515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.398039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.398039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.398039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.398491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.398796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.400754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.406777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96caf1-13b9-4bb5-b8cf-9471a53a5bb6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.413529 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 369/731] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.417366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.417650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.419056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.419056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.420174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.420174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.421801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a85dfc-e0c5-49e8-ab02-97bd2c8ec12f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.424170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.436639 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 363/732] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.439657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0987-0ab8-4b45-92f1-432c25461d23 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.444816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf4fa-b465-433a-bf83-1e517a8e83fb None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.445237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf4fa-b465-433a-bf83-1e517a8e83fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.445680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf4fa-b465-433a-bf83-1e517a8e83fb None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.447931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.448061 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 364/733] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:18.448812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.449087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.449355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.456764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.457761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.458114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.462239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.464198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.480080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:18.481996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:18.487027 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:18.490714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 365/735] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:18 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:18.492703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 370/735] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:18.494899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.505593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07d0d-7570-46d0-ae9d-c81168cff8ad None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.510607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.511475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.511842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.512284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.513155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.513504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.515251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.522297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.532590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9ffdf-a39c-4718-9957-eaee80251dfa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.533898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 366/736] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.537423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.538276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.538550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.538819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.541510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.543168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.545524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.563536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e034112-ad00-4382-8925-66e7ee03f5f0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.573980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.574868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.575144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.575611 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 03:43:18.577359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.578179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 371/737] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:18.585516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.601760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.604430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.607953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90954-bc10-4779-b986-af93691e1826 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.620462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.621197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.621472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.622294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.626436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] RBAC: Adding query filter params (name=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.626741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.630796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.639436 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:18.640690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 367/738] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:18.649152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 372/739] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/services?name=network => generated 124 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.650212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.660732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25629-1628-44a3-baec-43915f17e0ed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.666197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.673978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.675917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.676408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.676906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.677069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1c438-8b85-426b-aeac-8c1fb6a830bf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.678149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.678719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.680732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.683116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.685590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.686035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.686383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.687331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.687781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.689845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.697686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 373/740] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.706766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.710197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 368/741] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.718776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.722988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db05a-c2f2-419f-9c65-d1d23c3e9f78 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.728745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.729618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.730088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.730563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.730676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264cdd-fbbb-4fa0-ba6d-7a0de6a2468a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.732584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] RBAC: Adding query filter params (interface=public, service_id=dc9d0f3eeb4b46c6b8bccb728d12e646, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.733112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.734866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.737833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.738492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.738812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.739083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.741843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 374/742] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/endpoints?service_id=dc9d0f3eeb4b46c6b8bccb728d12e646&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.749350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.752118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.754111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.761155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036e44-5419-4ce9-857d-2f4068ca90c3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.766922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.767778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.768278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.768807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.769693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.771431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.774439 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:18.775802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 369/743] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:18.785100 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 375/744] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.785936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.798453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8187-0497-4d71-9584-67b6f3e15cc9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.811126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.811857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.812136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.812462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.813282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.813638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.815358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.834790 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 370/745] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:18.841506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.851648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1141e1-a01e-4489-8d6a-6e83160e1f93 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.857486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.858266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.858543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.858863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.867522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.869589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.884761 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:18.886433 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 376/746] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:18.892986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.903771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a96af2-efeb-41de-904b-0b5049298e6d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.908520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.909295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.909575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.909846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.910700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:18.911006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.913006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090d0b-071f-4288-a699-77a67b846df3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.929139 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 371/747] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:18.936027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:18.946908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3c0d-4205-4402-b1f1-8249c7ed9036 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:18.953426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:18.954741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:18.955217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:18.955712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/c7a31642b9b94735b7a1d6614f041347/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:18.974098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=c7a31642b9b94735b7a1d6614f041347, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:18.977205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503e921-26a8-462c-813b-212ba7230c36 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:18.994234 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 377/748] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:18 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/c7a31642b9b94735b7a1d6614f041347/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:19.698721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71422-a001-4b22-b98e-2e47347c542d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:19.699733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71422-a001-4b22-b98e-2e47347c542d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:19.700767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71422-a001-4b22-b98e-2e47347c542d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:19.703018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 372/749] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:19.710118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:19.710918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:19.711449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:19.733098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:19.734571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:19.804723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 378/750] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:19 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:19.841915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b71422-a001-4b22-b98e-2e47347c542d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:19.861242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b71422-a001-4b22-b98e-2e47347c542d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:19.870972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:19.872516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:19.873022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:19.873482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:19.893810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:19.901147 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:19.902953 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 373/751] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:19.909154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:19.922076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be899e2c-5e4c-4643-93a3-a8d754274fb3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:19.930999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:19.931662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:19.931935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:19.932203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:19.932989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:19.933289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:19.935430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:19.948235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 379/752] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:19.955138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:19.965192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83e21-dd15-4a14-a166-891ee21e3d9a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:19.975871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:19.977002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:19.977475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:19.977985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:19.992017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:19.997681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.020633 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:20.022180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 374/753] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:20.028736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.046321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed88ae-9736-4976-af9f-c4ada392b7eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.057102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.057761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.058037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.058354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.059131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:20.060038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.061699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.081295 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 380/754] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:20.087534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.101712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54d38-bcf1-485c-965b-bc724b7a5e0c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.111033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.112095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.112567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.113061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.125331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.127654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.146563 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:20.148369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 375/755] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:20.158499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.173957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e57-3f15-4407-9348-1d94c9551ea9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.185507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.186182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.186459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.186906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.187698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:20.188075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.189937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.209965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 381/756] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:20.215685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.229856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ca7ab-e737-4752-b8c8-b6aba7716c60 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.243652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.244843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.245314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.245773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.263754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.265901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.292977 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:20.295377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 376/757] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:20.301396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.315321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ab35-df98-40fc-b182-68a3204c6411 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.322371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.323023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.323360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.323630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.324417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:20.324818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.326457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.343793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 382/758] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:20.349985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.360545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec66c-431e-4531-88ea-e90964f3a828 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.371608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.372651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.373126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.373588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.383584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.385888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.406833 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:20.408302 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 377/759] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:20.414839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.429701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad069-d941-4a82-b4c9-60cfc21aa2a0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.437512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.438227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.438509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.438785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.439658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:20.439970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.441992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48669960-2170-4210-8ee7-5b0c257a9c72 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.465152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 383/760] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:20.471996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:20.486198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0081d-6acb-4dd0-9518-a94e2ed0383a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:20.495514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:20.496675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:20.497149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:20.497610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/525c6651aaa6451cbe1dd9f91e1c68ec/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:20.506056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=525c6651aaa6451cbe1dd9f91e1c68ec, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:20.509356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9ffc-fc85-4f84-9b33-7994d490a26c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:20.536767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 378/761] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:20 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/525c6651aaa6451cbe1dd9f91e1c68ec/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:21.045194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3619d-cd17-472e-aacf-9b6cade50fbd None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.045696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3619d-cd17-472e-aacf-9b6cade50fbd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.045809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3619d-cd17-472e-aacf-9b6cade50fbd None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.047651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 384/762] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:21.062658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.063170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.063170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.084551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:21.085665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:21.157444 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 379/763] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:21 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:21.206429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3619d-cd17-472e-aacf-9b6cade50fbd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.226598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3619d-cd17-472e-aacf-9b6cade50fbd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.236660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.237469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.237748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.238024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.238693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.240261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.255995 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 03:43:21.257491 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 385/764] 10.222.0.13 () {56 vars in 1150 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:21.264119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.277499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2bf9-7eaa-42bb-bb68-d30464b849fd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.288647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.289309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.289586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.289855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.290576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:21.290870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.292425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.300843 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 380/765] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:21.306772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.321840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff06b-be66-4c9c-9347-b0ad8a69a0b9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.330834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.331570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.331849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.332124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.332898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:21.333204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.334951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271d3ea-3646-4d81-88da-c22cf22e7ea3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.345698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 386/766] 10.222.0.13 () {56 vars in 1145 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:21.352228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.365891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5df3-39b2-4998-89c2-dacb2249b044 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.376984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.377646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.377919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.378186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.378940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.379937 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:21.379937 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:21.379937 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:21.380817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa7785-b2b5-4aed-9263-b55c90f2593b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.422531 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 381/767] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:21 2021] POST /identity/v3/endpoints => generated 346 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:21.534931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cf8c-0c74-406e-92ae-300fc38e4094 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.535276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cf8c-0c74-406e-92ae-300fc38e4094 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.535481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cf8c-0c74-406e-92ae-300fc38e4094 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.537416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 387/768] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:21.545089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.545407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.545638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.569927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:21.571123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:21.598706 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 382/769] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:21 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:21.629195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6cf8c-0c74-406e-92ae-300fc38e4094 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.646641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6cf8c-0c74-406e-92ae-300fc38e4094 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.652757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.654151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.654424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.654688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.655360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.657003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.676880 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 03:43:21.683368 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 388/770] 10.222.0.13 () {56 vars in 1153 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:21.684699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.698402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58318-d4aa-4ca6-9ac0-2ccb21ec3e04 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.706622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.707279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.707554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.707826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.708545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:21.708883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.710456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd2496-3ccf-4d37-98b5-56399952217e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.720013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 383/771] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:21.726209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:21.741237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad103e80-d00c-4a5f-8106-742a34520e20 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:21.745959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:21.746643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.746924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.747211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.747919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:21.748219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:21.749842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff55733-b7d9-4893-a3e4-8ada52b8f8ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:21.755022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 389/772] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:21 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:21.936824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ff07-b5c5-4945-9a7f-0ec13a644c4c None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.937102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ff07-b5c5-4945-9a7f-0ec13a644c4c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.937372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ff07-b5c5-4945-9a7f-0ec13a644c4c None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.939407 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 384/773] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:21.947197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1e6e-4992-4764-8c42-9e11a85171f1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:21.947485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1e6e-4992-4764-8c42-9e11a85171f1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:21.947763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1e6e-4992-4764-8c42-9e11a85171f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:21.969798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dcde1e6e-4992-4764-8c42-9e11a85171f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:21.971024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcde1e6e-4992-4764-8c42-9e11a85171f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:21.984981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 390/774] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:21 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:22.021730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898ff07-b5c5-4945-9a7f-0ec13a644c4c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.036569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898ff07-b5c5-4945-9a7f-0ec13a644c4c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.042670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.044032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.044319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.044585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.053144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942980-0bd3-45cd-9c36-02c7c0ed460e None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.053774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942980-0bd3-45cd-9c36-02c7c0ed460e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.053774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942980-0bd3-45cd-9c36-02c7c0ed460e None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.055463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 391/775] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:22.059061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:22.064491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.064810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.065084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.066534 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:43:22.068014 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 385/776] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:22.075768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.085801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8e50-ba51-4d81-84b2-094f02bb7ece admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.087931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:22.089280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:22.098553 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 392/777] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:22 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:22.102019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.102687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.102963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.103229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.103984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.104280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.105906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.123135 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 386/778] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:22.124880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.129415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.134242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705423-06f8-4cde-9923-dcfaf2881068 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.138999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.139841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.140121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.140396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.141142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.141578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fba1a-a94e-4126-ae11-391aa4c5c4e8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.142877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.152324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.156629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.156629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.156629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.159138 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 03:43:22.160830 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 393/779] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:22.174817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.176739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.183004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.197380 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:22.198748 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 387/780] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:22.201097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbe10c-7d1e-468b-b3c2-8846c5dbbb11 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.207695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.208360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.208698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.208971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.209637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.209744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.210136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.211887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.220065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8841-fee3-401f-8740-2f3ae9b1acfd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.224645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.225296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.225401 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 394/781] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/services?name=network => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.225577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.225850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.226580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.226884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.228473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.250652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.252713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 388/782] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.258431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.267779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d34e-62eb-4da8-ad61-472161c10d47 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.278969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aedf5a-9ec2-4ff4-ac79-dcf5f0ecf2d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.279660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.280368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.280686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.280943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.281724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.282079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.283765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.289562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 395/783] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/services?type=network => generated 350 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.290357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.291389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.291859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.292320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.297256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.310411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.312641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.316842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078306d3-0cba-4366-be15-2f3eb33c3028 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.331467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.332159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.332443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.332738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.333555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.334591 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:22.334591 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:43:22.334591 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:43:22.335452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.342306 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:22.346259 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 389/784] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:22.349855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.362938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0faa8-d6bc-4dd5-ab1b-21367d5630e4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.368174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.369121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.369856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.370338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.373805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.378808 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 396/785] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:22 2021] POST /identity/v3/endpoints => generated 327 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:22.379178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.381237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.401686 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 390/786] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.408979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.438651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6d9f-ed23-4516-a60f-b59893b064d5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.444651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.445633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.446165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.446685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.458029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.460407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.471546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 397/787] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:22.478121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.489812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6b65-9bf2-45b5-bb0f-a23b93c430bc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.497013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.498200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.498725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.499214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.513831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.516089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.540353 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:22.542012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 391/788] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:22.548552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.558865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f759-f949-4ba9-ba77-f746542cbbad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.569589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.570270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.570549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.570824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.571570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.571878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.573499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.598428 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 398/789] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.604585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.622623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcdc22-3e54-4873-8bc6-bfaecf726773 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.638558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.639725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.640195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.640707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.651278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.653566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.667184 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:22.669066 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 392/790] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:22.676157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.693135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469f43-4b9e-4704-9134-781bdfb0fdaa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.698938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.700519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.701060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.701536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.702594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.703091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.705325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7610-6eea-4c9c-a67a-cbdf9795b5a1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.719097 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 399/791] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:22.725399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:22.737614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f166f-ebfb-4bba-a6bc-20d068508eda admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:22.742494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:22.743184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:22.743457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:22.743721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:22.744630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=c7a31642b9b94735b7a1d6614f041347) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:22.744938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:22.747401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3b41-e656-4db2-af0d-c9fc8771b775 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:22.753862 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 393/792] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:22 2021] GET /identity/v3/role_assignments?user.id=c7a31642b9b94735b7a1d6614f041347&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:23.399149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5272ee-78ab-4aa4-bd59-654ebdf25830 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.399684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5272ee-78ab-4aa4-bd59-654ebdf25830 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.399684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5272ee-78ab-4aa4-bd59-654ebdf25830 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.401858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 400/793] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:23.409711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.410105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.410269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.428007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:23.429212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:23.440709 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 394/794] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:23 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:23.463607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5272ee-78ab-4aa4-bd59-654ebdf25830 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.476222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5272ee-78ab-4aa4-bd59-654ebdf25830 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.480528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.481856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.482133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.482401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.492721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:23.499380 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:23.504783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 401/795] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:23.507073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.515858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025935d8-7303-4d6e-8dc3-ff780ba139b4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.520346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.521027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.521302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.521572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.522324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.522622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.524193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.540328 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 395/796] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:23.546859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.557194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9f688-e5e3-40fe-b565-a703a16304ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.561766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.562529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.562803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.563072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.573708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.575543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.592795 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:23.599207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 402/797] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:23.600535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.610775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb12f1-44e8-4a12-9b6d-d1fd20d95ab5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.615278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.615914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.616193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.616461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.617213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.617513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.619139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.635562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 396/798] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:23.637382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.647353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c4cb-3bfc-418e-b3a4-8238485aec76 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.651954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.653456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.653740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.654011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.661873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.663926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.678578 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 03:43:23.684731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 403/799] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:23.686965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.697622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76399b-707d-45a8-98c4-b983fe89831c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.703017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.703749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.704000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.704277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.705287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.705525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.707410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.731646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 397/800] 10.222.0.13 () {56 vars in 1156 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:23.733015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.743008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663a67-2166-47ab-9ef3-0cb583867bc2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.747805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.748494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.748807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.749135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.759307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.761175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.776125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 404/801] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:23.777527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.788215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0e29-e5cc-4702-b30e-cb98e85ae381 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.792873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.793833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.794099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.794377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.810711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.812574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.834624 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:23.834624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 398/802] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:23.841264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.850639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b74a5-6c01-400a-891a-6c6e932dcc65 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.855184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.855861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.856140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.856412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.857187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.857490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.859047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.876073 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 405/803] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:23.877404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.888009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d48e2-988a-4185-a286-b5106a61c2eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.892959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.894087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.894609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.895068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.902804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.905595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.919263 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:23.921010 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 399/804] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:23.929914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.939919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52114a-cfd0-4952-b175-0177a165edab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.944999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.945731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.946012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.946340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.947141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.947495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.949447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc0881-f63a-41d6-ab59-0346088e2bf0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:23.968763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 406/805] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:23.970345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:23.983142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf349e7f-be37-4b2c-839f-381c1bc80e53 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:23.988080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:23.988984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:23.989464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:23.989961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:23.990964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=525c6651aaa6451cbe1dd9f91e1c68ec) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:23.991492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:23.993839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847095-b39d-4287-86f1-441feca41d51 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:24.004751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 400/806] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:23 2021] GET /identity/v3/role_assignments?user.id=525c6651aaa6451cbe1dd9f91e1c68ec&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:24.324775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9f2-4604-4a49-9996-a8b121be3771 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.325422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9f2-4604-4a49-9996-a8b121be3771 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.325903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9f2-4604-4a49-9996-a8b121be3771 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.328169 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 407/807] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:24.335278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.335562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.335831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.351284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791f569-1147-4fd5-9918-c467be02babd None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.351569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791f569-1147-4fd5-9918-c467be02babd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.351924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791f569-1147-4fd5-9918-c467be02babd None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.353867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 408/808] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:24.357475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:24.358659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:24.362412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.362693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.363087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.366875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 401/809] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:24 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:24.384125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:24.385668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:24.391285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:24.394292 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 409/810] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:24 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:24.401702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38436-c75e-44e9-a92e-4339a24a8442 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:24.406680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:24.407321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.407590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.407861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.408620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:24.410169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:24.423506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:24.426655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 402/811] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:24 2021] POST /identity/v3/services => generated 269 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:24.433992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a6eac-a81c-4c02-9115-ea83a5f6cd40 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:24.450467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:24.451767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.452369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.452890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.453793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:24.455886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:24.469225 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 03:43:24.471193 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 410/812] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:24 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:24.478355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:24.489832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d00c-4445-4673-94e4-b8e1dd4e988c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:24.495157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:24.496246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.496831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.497332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.498268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:24.498822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:24.500813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7fc32-30e8-4555-a090-da83070628ea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:24.506702 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 403/813] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:24 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:24.514144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:24.525125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208928-9a76-4588-a781-0fdb4cd6db62 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:24.531119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:24.532181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:24.532697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:24.533261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:24.534240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:24.534832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:24.536769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c919427-3210-4947-83dc-b2f4f32dac7f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:24.542790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 411/814] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:24 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:25.312054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8a12-8b7a-4b71-8437-406e2bfd15c1 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.312482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8a12-8b7a-4b71-8437-406e2bfd15c1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.312593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8a12-8b7a-4b71-8437-406e2bfd15c1 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.314639 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 404/815] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:25.322136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.322408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.322686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.342446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:25.343802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:25.352024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 412/816] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:25 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:25.377610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e8a12-8b7a-4b71-8437-406e2bfd15c1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.390723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e8a12-8b7a-4b71-8437-406e2bfd15c1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.395362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.396388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.396918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.397406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.410330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:25.418398 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:25.420072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 405/817] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:25.426750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.435675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa78678-9380-44a6-ab53-ae0bd3d3120d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.441024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.441676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.441951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.442582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.443453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.444259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.446023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.456253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 413/818] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:25.462394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.473441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4f28-8eba-4d8b-b85d-b7d44fd674cf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.478168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.479158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.479643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.480149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.490760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.492855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.509978 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:25.511553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 406/819] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:25.518138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.528552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7188b7-9682-4ac2-9e42-a8bf77ff328a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.533554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.534422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.534911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.535399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.536337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.536865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.538630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.550881 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 414/820] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:25.557161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.567672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58066-66c3-4bd6-bbf8-af4e5a6bde57 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.572779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.573892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.574384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.575445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.583238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.585635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.600275 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:25.602033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 407/821] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:25.608415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.618735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ae0b-ddac-4a10-972e-f804079546c6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.624237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781747-329f-464d-9796-ab0725993cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.625226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781747-329f-464d-9796-ab0725993cac admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.625756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781747-329f-464d-9796-ab0725993cac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.626234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781747-329f-464d-9796-ab0725993cac admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.627271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781747-329f-464d-9796-ab0725993cac admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.627825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781747-329f-464d-9796-ab0725993cac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.629964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781747-329f-464d-9796-ab0725993cac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.650468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 415/822] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:25.656710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.667133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a84d8-e011-40d2-a800-bbe2d0cd6c82 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.671994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.672954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.673441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.673952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.682667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.685318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.694960 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 408/823] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:25.701942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781747-329f-464d-9796-ab0725993cac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.713905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781747-329f-464d-9796-ab0725993cac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.719065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.720179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.720695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.721205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.732118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.734227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.753126 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:25.755136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 416/824] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:25.761645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.773116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07798c4b-d5c6-4587-8b90-f975b4ca9698 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.777947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.778821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.779291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.779812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.780801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.781322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.783090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.795419 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 409/825] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:25.801938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.814181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c36-42d3-42eb-89c2-92e3c860e001 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.819479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.820503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.821065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.821539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.830650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.836643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.847251 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:25.852845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 417/826] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:25.855151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.865034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9d7c-cecf-40b0-8a0a-a6b0be2f806a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.870598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.871308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.872274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.872749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.873692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.874100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.876121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1abd7-56bf-4b7f-b861-0626262ecd56 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.891082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 410/827] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:25.897505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:25.908917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c55f25-7033-4067-b154-44df13cddf49 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:25.913436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:25.914169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:25.914443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:25.914710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:25.915588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] RBAC: Adding query filter params (role.id=4caf49d8795b466fb0a90b1b69b4047a, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=c7a31642b9b94735b7a1d6614f041347) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:25.915891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:25.917987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0618c-f110-497a-aa54-aee1f5ae718f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:25.928862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 418/828] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:25 2021] GET /identity/v3/role_assignments?user.id=c7a31642b9b94735b7a1d6614f041347&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=4caf49d8795b466fb0a90b1b69b4047a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:26.488830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5d71-a3d7-4a72-9909-10313275eea7 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.489840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5d71-a3d7-4a72-9909-10313275eea7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.490361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5d71-a3d7-4a72-9909-10313275eea7 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.492620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 411/829] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:26.500433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.500904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.501078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.518889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:26.520057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:26.531637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 419/830] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:26 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:26.552733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f5d71-a3d7-4a72-9909-10313275eea7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:26.565657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f5d71-a3d7-4a72-9909-10313275eea7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:26.570237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:26.571014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.571293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.571565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.572219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:26.573259 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:26.573259 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:26.573259 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:26.574130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:26.586420 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 03:43:26.592730 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 412/831] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:26 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:26.594718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:26.603769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0969bc-455a-4f50-9e88-b5a8a0afd6a8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:26.608403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:26.609133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.609413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.609684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.610402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:26.610699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:26.612263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b8ac4-c4d3-401f-8705-0128e87c535c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:26.620759 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 420/832] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:26 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:26.624272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:26.634047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997581dc-efcc-4733-b088-b84d8d512e3e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:26.639342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:26.639978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.640254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.640526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.641278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:26.641583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:26.643165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf775-d64f-4823-b4af-15b4b4d3e5a9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:26.652751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 413/833] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:26 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:26.862708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544867-7e2e-4598-a90c-b511d7d2db6b None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.863038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544867-7e2e-4598-a90c-b511d7d2db6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.863236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544867-7e2e-4598-a90c-b511d7d2db6b None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.865345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 421/834] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:26.873606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4780-341b-42ce-aebe-26eebff64dde None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.873901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4780-341b-42ce-aebe-26eebff64dde None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.874144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4780-341b-42ce-aebe-26eebff64dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.894187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c8ae4780-341b-42ce-aebe-26eebff64dde None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:26.895403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c8ae4780-341b-42ce-aebe-26eebff64dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:26.903944 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 414/835] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:26 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:26.929695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544867-7e2e-4598-a90c-b511d7d2db6b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:26.942566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544867-7e2e-4598-a90c-b511d7d2db6b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:26.947248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:26.948027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.948352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.948640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.949303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:26.951462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:26.963151 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 03:43:26.964652 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 422/836] 10.222.0.13 () {56 vars in 1153 bytes} [Wed Nov 10 03:43:26 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:26.970230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967250e5-c396-47ed-b2dd-d4e769e1f61d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.970512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967250e5-c396-47ed-b2dd-d4e769e1f61d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.970783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967250e5-c396-47ed-b2dd-d4e769e1f61d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.972723 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 415/837] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:26.975679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:26.980398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.980986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.981366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.986182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebb4ae-216d-4c53-9503-5a1097e322c4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:26.990880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:26.991762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:26.992174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:26.992721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:26.993584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:26.994053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:26.995803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:26.999959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:27.001396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:27.001587 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 423/838] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:26 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:27.007829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:27.013173 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 416/839] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:26 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:27.018270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd65f6-203f-44bb-8f20-94a93256e2f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:27.022933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:27.023827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:27.024354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:27.024858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:27.025801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:27.026399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:27.028856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:27.034251 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 424/840] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:27 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:27.039093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:27.040834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:27.048860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e07e8-33b3-4fab-8ecc-11c8467e0590 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:27.051049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28096-0b6b-4786-b217-b3890b14e13c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:27.053630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:27.054279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:27.054562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:27.054824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:27.055646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:27.057315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:27.057446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0b567-27ec-4357-ba58-2d2d14ed9e60 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:27.058319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:27.059358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:27.059833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:27.060914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] RBAC: Adding query filter params (interface=public, service_id=6c25574e4840490694495a57e2fa841c, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:27.061446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:27.063254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:27.069990 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 425/841] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:27 2021] GET /identity/v3/endpoints?service_id=6c25574e4840490694495a57e2fa841c&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:27.076673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:27.080788 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 417/842] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:27 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:27.092505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2bc0-5a23-4d94-81a4-8d8ce5844637 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:27.108276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:27.109152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:27.109536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:27.109954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:27.110769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:27.112686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5439037-af83-4766-8df1-8caa36f5ae13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:27.119644 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 426/843] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:27 2021] GET /identity/v3/services => generated 1268 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:43:28.325894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ab12-1dc1-41b6-bb5b-4a70596d21c7 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.326609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ab12-1dc1-41b6-bb5b-4a70596d21c7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.326609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ab12-1dc1-41b6-bb5b-4a70596d21c7 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.328636 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 418/844] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:28.336216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.336874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.336874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.354223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:28.355389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:28.368762 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 427/845] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:28 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:28.390062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ab12-1dc1-41b6-bb5b-4a70596d21c7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.402484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ab12-1dc1-41b6-bb5b-4a70596d21c7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.406948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.407739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.408014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.408284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.419327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:28.426469 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:28.432714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 419/846] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:28.435062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.444427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5aa2-ccb8-4825-87f9-3478b6d8b396 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.449221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.449901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.450177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.450449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.451207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:28.451505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.453110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.466922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 428/847] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:28.468287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.478622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b278-344d-4a2e-84dd-f2c51c4bb5b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.483734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.484510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.484827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.485104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.495556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.497954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.514790 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:28.520687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 420/848] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:28.522612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.532197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9dfa-e217-4ffd-a4a7-2318413173cd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.536743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.537401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.537678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.537951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.538688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:28.538989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.540542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.558580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 429/849] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:28.560330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.570698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0048-cdc8-40f5-bf92-7079679f9ff9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.575417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.576328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.576547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.576842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.584695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.586729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.601466 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:28.604697 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 421/850] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:28.609883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.619931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608f77-439e-4953-9f4d-ef88e51a2d5a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.624663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.625314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.625647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.625919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.626837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:28.627140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.629170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.651486 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 430/851] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:28.653453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.663130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977f6-77de-48c8-a5b1-08de39d20e56 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.667668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.669027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.669301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.669569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.679700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.681532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.698337 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:28.704767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:28.706353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.716959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e843c3-998b-4acd-845c-05b63fc7928d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.721908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.724639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.724639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.724639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.724639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:28.724639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.725605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.743030 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 431/853] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:28.744527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.754431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890dec-dfe5-4834-9061-cd911db0c207 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.759135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.759979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.760259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.760529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.768030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.770040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.783353 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:28.788726 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 423/854] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:28.791303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.807101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1203a-9d17-4fe3-b7c6-31aa4585973f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.812038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.812807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.813087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.813358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.814210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:28.814513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.816445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd7628-8503-4c8c-a1a3-d9bf42693532 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.839397 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 432/855] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:28.841323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:28.852172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15407-3b58-4fe6-aae8-1ee4a16d2c75 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:28.857921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:28.858787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:28.859066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:28.859333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/c7a31642b9b94735b7a1d6614f041347/roles/4caf49d8795b466fb0a90b1b69b4047a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:28.862052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=c7a31642b9b94735b7a1d6614f041347, role_id=4caf49d8795b466fb0a90b1b69b4047a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:28.864632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9b0b-2de1-4d50-bc4c-46cef4e85660 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:28.884784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 424/856] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:28 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/c7a31642b9b94735b7a1d6614f041347/roles/4caf49d8795b466fb0a90b1b69b4047a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:29.103099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498de04-5ebb-48a1-9d91-b0e807a72b5f None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.103699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498de04-5ebb-48a1-9d91-b0e807a72b5f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.104170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498de04-5ebb-48a1-9d91-b0e807a72b5f None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.107059 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 433/857] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:29.115013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92dab-184b-44b6-b402-ba5caad5470c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.115573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92dab-184b-44b6-b402-ba5caad5470c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.116042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92dab-184b-44b6-b402-ba5caad5470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.134971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-07a92dab-184b-44b6-b402-ba5caad5470c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:29.137696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07a92dab-184b-44b6-b402-ba5caad5470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:29.198308 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 425/858] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:29 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:29.223538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498de04-5ebb-48a1-9d91-b0e807a72b5f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.236434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498de04-5ebb-48a1-9d91-b0e807a72b5f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.240961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.241606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.241878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.242143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.242881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.244036 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:29.244036 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:43:29.244036 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:43:29.244938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564026d3-fb97-48d5-9cf0-9a743ef3a8e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.269083 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 434/859] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:29 2021] POST /identity/v3/services => generated 241 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:29.509353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f483-aadc-4568-9f9d-2bf046e0a97c None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.509876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f483-aadc-4568-9f9d-2bf046e0a97c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.509876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f483-aadc-4568-9f9d-2bf046e0a97c None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.511674 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 426/860] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:29.519143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.519567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.519744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.537847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:29.539025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:29.544874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1c6-10b0-4be9-9d90-247563606f32 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.545152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1c6-10b0-4be9-9d90-247563606f32 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.545418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1c6-10b0-4be9-9d90-247563606f32 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.547154 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 427/861] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:29.555709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.556111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.556477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.557885 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 435/862] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:29 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:29.574064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:29.575266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:29.582498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.586606 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 428/863] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:29 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:29.592146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228478d6-d5f3-446b-8a1e-fd1f9e19f5c3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.596906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.597913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.598367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.598813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.599644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.601422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.613388 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 03:43:29.613516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.615186 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 436/864] 10.222.0.13 () {56 vars in 1153 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:29.622657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2bfe6-a5cd-468f-b96c-0703bda49cb3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.623266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.627430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.628313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.628740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.629086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.629863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.631530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.634249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62658c-917f-4a98-9df4-46bbf11f88ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.639124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.639967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.640431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.640919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.641819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:29.642303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.643458 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 03:43:29.644290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.644823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 429/865] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:29.649746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 437/866] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:29.655358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.656572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.661080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e612-2ece-4695-8030-f9634877710d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.665709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.666334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.666615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.666884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.667588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:29.667885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.668891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab569b-3634-4132-902c-1ee675066976 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.670091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.674510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.675038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 430/867] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:29.675556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.676019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.676468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.677373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:29.677867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.679590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.680953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.685339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 438/868] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:29.692739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b7c-5095-4b8f-9290-4e945609be04 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.694872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.702465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.703462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.703915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.704361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.705315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13b127-bd2e-440a-9d35-ba61758767eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.705570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:29.706097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.707869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.709985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.710871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.711226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.711564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.712418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.714203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.714894 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 431/869] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:29.721765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.731649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702deb5-b446-4503-bd3e-3c003f84be82 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.736661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.737483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.737819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.738159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.739060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] RBAC: Adding query filter params (interface=public, service_id=56e6877c0c6d4814befdf979747ac9f4, region_id=RegionOne) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:29.739431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.740542 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:29.740542 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:29.740542 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:29.741614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc9085-7bc4-401d-95b5-bc8133a873e0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.749532 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 439/870] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:29 2021] POST /identity/v3/endpoints => generated 347 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:43:29.753538 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 432/871] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/endpoints?service_id=56e6877c0c6d4814befdf979747ac9f4&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:29.760271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:29.783157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7953a7-e820-4255-ae5b-03a8df035927 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:29.787888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:29.788558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:29.788866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:29.789135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:29.789829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:29.791632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162a555-d27c-4d76-beae-575a55132254 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:29.798909 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 440/872] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:29 2021] GET /identity/v3/services => generated 1497 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:43:31.327085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392127-b57f-42c2-932c-e9557bdc62a9 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.327607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392127-b57f-42c2-932c-e9557bdc62a9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.327607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392127-b57f-42c2-932c-e9557bdc62a9 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.329631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 433/873] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:31.337047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.337500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.337576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.355504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:31.356690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:31.364581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 441/874] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:31 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:31.391020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392127-b57f-42c2-932c-e9557bdc62a9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.404321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392127-b57f-42c2-932c-e9557bdc62a9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.408707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.409492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.409766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.410035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.420571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:31.427738 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:31.429227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 434/875] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:31.435689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.445189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ff6d6-38ca-49df-abed-5a6d01450f72 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.450428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.451081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.451356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.451624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.452433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.452764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.454344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.463203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 442/876] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:31.469970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.479742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6407-c297-4093-886b-1b9e10369b6b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.484273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.485065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.485342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.485611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.496480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.498325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.515987 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:31.517615 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 435/877] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:31.524106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.534909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807713-b1d4-41e5-823d-51a163c6ae5e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.539719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.540387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.540688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.540961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.541702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.542000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.543630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.557784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 443/878] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.564467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.575329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f3f9-e2f6-4b6f-b876-c47f1fda4821 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.580103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.580869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.581139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.581407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.590631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.592632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.606389 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 03:43:31.607857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 436/879] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:31.614134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.624408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2a4f-7034-4a7e-bf53-4551ff8ba6ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.629009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.629660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.629933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.630203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.631040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.631348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.633191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1d53c-ceda-4b6e-844d-bb9a486c6eaa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.652119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 444/880] 10.222.0.13 () {56 vars in 1170 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:31.658476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.667878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d95f-e3dd-4780-929d-452ea0b10554 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.668191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d95f-e3dd-4780-929d-452ea0b10554 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.668492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4733d4-9833-486f-8ebf-b5b8ee164264 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.668670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d95f-e3dd-4780-929d-452ea0b10554 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.670512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 445/881] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:31.672858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.673491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.673759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.674031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.677445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.677720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.677986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.682643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.684949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.694405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 437/882] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:31.695915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:31.697108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:31.701072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.706120 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 446/883] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:31 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:31.709730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d407b-4eaf-4dc5-95f7-b41c03304f8e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.714810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.715600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.715873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.716140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.727639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.729473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.732987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.742099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42faff-4ccb-4476-96d8-b6d00a325d3d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.745890 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:31.747530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.747886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 438/884] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:31.748436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.748870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.749207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.749934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.751657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.753886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.763969 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 03:43:31.764166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4ae6f-e7bf-4b30-9d45-8fa8d5f4523d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.765458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 447/885] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:31.768865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.769496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.769769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.770036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.770757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.771053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.772192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.772706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.785086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 439/886] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.785651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fe484-2e46-4282-8cb3-f8b46e842cf6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.790397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.790998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.791194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.791430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.791781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.792719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.793059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.794671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.800049 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 448/887] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.800912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c641-080f-4ed2-8ed6-12601eec354d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.805689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.806462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.806734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.807000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.810294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.815349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.817899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.821808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93491ef-2a31-48a0-bb3d-24243f7b3fa7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.827505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.828366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.828856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.829316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.830253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.830737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.832228 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:31.832698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.833500 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 440/888] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:31.844631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 449/889] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.844797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.849956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.856307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea652a2-a64d-4606-9e1e-33eb7f2724cf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.861033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.861734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.861841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693aaa-00ef-4156-9e25-8001bcf76f75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.862025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.862276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.863214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.863519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.865559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.867767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.869063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.869540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.870006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.871007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] RBAC: Adding query filter params (interface=public, service_id=c44284f61fac4888850f9761708a4acf, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.871651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.873974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.878406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 441/890] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:31.880670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 450/891] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/endpoints?service_id=c44284f61fac4888850f9761708a4acf&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.885358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.887199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:31.895403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c13f0-d9df-48a0-aa1b-32c65486a002 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.898025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb9935-aa3e-4bcd-b5f7-3ab14f766f47 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:31.900184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.900901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.901176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.901444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.902332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] RBAC: Adding query filter params (role.id=4caf49d8795b466fb0a90b1b69b4047a, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=c7a31642b9b94735b7a1d6614f041347) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:31.903286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.904707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:31.905369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d342e-9853-4769-b369-216cb8dd35c2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.905756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:31.906232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:31.906690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:31.907779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:31.910332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c7c7-4cc5-4e58-8543-4a7137c3e346 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:31.911782 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 442/892] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/role_assignments?user.id=c7a31642b9b94735b7a1d6614f041347&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=4caf49d8795b466fb0a90b1b69b4047a => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:31.917279 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 451/893] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:31 2021] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:43:32.206605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c1c2-4a07-4f09-9059-5331607dbb95 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.206964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c1c2-4a07-4f09-9059-5331607dbb95 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.207157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c1c2-4a07-4f09-9059-5331607dbb95 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.209230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 443/894] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:32.217446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a25363-b8b8-43d4-817d-e0acfa2a12ca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.218034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a25363-b8b8-43d4-817d-e0acfa2a12ca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.218513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a25363-b8b8-43d4-817d-e0acfa2a12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.236566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7a25363-b8b8-43d4-817d-e0acfa2a12ca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:32.238082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7a25363-b8b8-43d4-817d-e0acfa2a12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:32.246406 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 452/895] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:32 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:32.270687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22c1c2-4a07-4f09-9059-5331607dbb95 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.283507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22c1c2-4a07-4f09-9059-5331607dbb95 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.288398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.289232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.289509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.289780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.289896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedb5a-ccab-489a-9fb4-4cfba23dff5c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.290156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedb5a-ccab-489a-9fb4-4cfba23dff5c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.290431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedb5a-ccab-489a-9fb4-4cfba23dff5c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.290526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.292000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.292445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 453/896] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:32.299647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.299919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.300196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.303467 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 03:43:32.309220 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 444/897] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:32.311921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.319472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:32.321003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:32.321714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829721-0eed-4ecc-9a9b-0b820a5511c4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.326916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.327555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.328088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.328088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.328806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:32.329106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.330670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.331757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 454/898] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:32 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:32.336636 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 445/899] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:32.342072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.351327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e422b-aa0f-4125-a5e9-28c280d0a10b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.355765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.356406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.359041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.359041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.359041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:32.359041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.359518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.364375 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 455/900] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:32.364601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.375386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b0c79-34d7-4cec-9c71-f2bb393cf36d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.380146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.381022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.381302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.381575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.382254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.383882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.396545 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 03:43:32.397873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 446/901] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:32.405049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.415635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965b43-9d7c-4157-aaaa-c90fa15da662 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.420742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.421479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.421759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.422094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.422831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:32.423147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.424893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.430762 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 456/902] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:32.437969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.450728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe1b23-2b6c-43d3-bd35-f6b7d55a7b8f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.455770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.456486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.456859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.457129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.457856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:32.458208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.459884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f26b-cb56-49b4-bb99-46e81d8a2e1a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.471046 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 447/903] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 10 03:43:32 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:32.472410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:32.482957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69699-67af-4403-99e6-58592f162a91 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:32.487906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:32.488648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:32.488942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:32.489265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:32.490054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:32.491782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccf8de-c49d-4500-9bea-7ea4b3ed25f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:32.524845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 457/904] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:32 2021] POST /identity/v3/endpoints => generated 346 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:34.353240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117ac6-d51b-4f86-9fae-fd697d77275c None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.353753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117ac6-d51b-4f86-9fae-fd697d77275c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.353753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117ac6-d51b-4f86-9fae-fd697d77275c None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.355823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 448/905] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:34.363573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34fea-0b3f-471c-85bb-aeaa393c6226 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.364019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34fea-0b3f-471c-85bb-aeaa393c6226 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.364127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34fea-0b3f-471c-85bb-aeaa393c6226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.381920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-78e34fea-0b3f-471c-85bb-aeaa393c6226 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:34.383096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-78e34fea-0b3f-471c-85bb-aeaa393c6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:34.400147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 458/906] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:34.408983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51a7e-62c9-4da8-8416-91e01ae21b12 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.409553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51a7e-62c9-4da8-8416-91e01ae21b12 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.410018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51a7e-62c9-4da8-8416-91e01ae21b12 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.412236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 449/907] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:34.419766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.420054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.420333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.429283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc51a7e-62c9-4da8-8416-91e01ae21b12 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.438663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:34.439792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:34.442954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc51a7e-62c9-4da8-8416-91e01ae21b12 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.448963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.452726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 459/908] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:34.453782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.454227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.454660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.455506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.457343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.469864 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 03:43:34.471587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 450/909] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:34.477694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.481515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.486679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecd5da-02d0-4ee3-b5b7-8806daecfcd1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.491287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.492064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.492284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6bcc-77a4-4b32-a3d4-24c4f58e6cf3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.492404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.492589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.493290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.495073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.498077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.498791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.499137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.499469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.500249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:34.500646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.502267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.507465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 451/910] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:34.508037 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 03:43:34.509678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 460/911] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:34.516844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.517715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.527129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb590d2-2819-47f2-9e80-c00efa2f0f86 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.529007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803866f-2df1-40cd-a711-bff1acabc4e5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.533035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.533895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.534000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.534464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.534760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.535108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.535280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.535479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.536262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:34.536522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:34.536697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.537172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.538374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.539084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.544207 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 452/912] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:34.546172 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 461/913] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:34.554008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.555054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.565243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a02ec-4582-46e7-8136-fc8787f1fbc6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.565939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae46fd7-0988-4dfa-8f46-49f0dfa8d1d8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.570418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.571244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.571587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.571931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.572102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.572810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] RBAC: Adding query filter params (type=image) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:34.573154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.573256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.573684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.574148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.575530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ae6da-82f4-4998-a5e2-89dc499c47ed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.575785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.577538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a975ba-c391-4c05-9431-828d2fb32a8c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.581658 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 453/914] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:34 2021] GET /identity/v3/services?type=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:34.604910 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 462/915] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/endpoints => generated 349 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:34.751483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ee30-5ff4-4757-8943-975e0c6f0d47 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.751822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ee30-5ff4-4757-8943-975e0c6f0d47 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.752036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ee30-5ff4-4757-8943-975e0c6f0d47 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.754311 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 454/916] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:34.763364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66a1f-0320-44fc-be40-4229e323938f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.763995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66a1f-0320-44fc-be40-4229e323938f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.764518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66a1f-0320-44fc-be40-4229e323938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.792417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dae66a1f-0320-44fc-be40-4229e323938f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:34.794494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dae66a1f-0320-44fc-be40-4229e323938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:34.820523 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 463/917] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:34.846216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ee30-5ff4-4757-8943-975e0c6f0d47 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:34.860690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ee30-5ff4-4757-8943-975e0c6f0d47 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:34.866291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:34.866940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.867253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.867523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.868250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:34.869904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161dfd-0d96-477d-843e-d5d406a02985 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:34.887284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 455/918] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:34.955970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78283-1a65-47ca-9fe7-a2eedd5f537f None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.956257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78283-1a65-47ca-9fe7-a2eedd5f537f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.956508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78283-1a65-47ca-9fe7-a2eedd5f537f None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.958739 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 464/919] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:34.967552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:34.967857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:34.968156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:34.993148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:34.994874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:35.014978 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 456/920] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:35.041212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78283-1a65-47ca-9fe7-a2eedd5f537f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:35.054097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78283-1a65-47ca-9fe7-a2eedd5f537f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:35.058975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:35.059661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:35.059939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:35.060272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:35.061085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:35.063063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:35.064720 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.common [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 10 03:43:35.085924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.sql.core [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 10 03:43:35.085924 ncdv-817176-1 devstack@keystone.service[96284]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 10 03:43:35.085924 ncdv-817176-1 devstack@keystone.service[96284]: [parameters: {'id': 'dea0062d56d84e1488fae3802f8a950b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 10 03:43:35.085924 ncdv-817176-1 devstack@keystone.service[96284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 03:43:35.102789 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dea0062d56d84e1488fae3802f8a950b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dea0062d56d84e1488fae3802f8a950b. Nov 10 03:43:35.104803 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 465/921] 10.222.0.13 () {60 vars in 1161 bytes} [Wed Nov 10 03:43:35 2021] POST /identity/v3/projects => generated 262 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:35.116013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:35.125407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249ab2-b86f-44ad-af86-d99032a2e7bf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:35.130034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:35.130966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:35.131249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:35.131523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:35.139049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:35.145245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:35.166031 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-09e20af1-8111-4011-a525-b88b16174c53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:35.167896 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 457/922] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:35.175053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:35.186760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc117a-9db5-44d9-9890-9825ff1d22d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:35.191271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:35.191909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:35.192188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:35.192452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:35.193242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:35.193539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:35.195845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434802b2-31c6-4d5a-8972-e45d219bbe2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:35.216983 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 466/923] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:35 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:37.096402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b686c-4282-430b-b211-4995c3663e0b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.096996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b686c-4282-430b-b211-4995c3663e0b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.096996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b686c-4282-430b-b211-4995c3663e0b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.098923 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 458/924] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:37.107174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.107663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.107750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.126407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:37.127902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:37.138703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23e3cb-1b8d-4560-8f27-5a541f8c8eec None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.138994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23e3cb-1b8d-4560-8f27-5a541f8c8eec None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.139249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23e3cb-1b8d-4560-8f27-5a541f8c8eec None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.141218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 459/925] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:37.144223 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 467/926] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:37.152695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.152695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.152695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.170622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.179438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756245c-db2d-4c54-9c63-effbd9204db8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.184186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.184342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:37.185076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.185465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.185832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.186578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:37.186746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.188397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.203895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 460/927] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:37.210798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 468/928] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:43:37.230027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.246509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695e3d-f6e5-4503-b773-2bd1e378165c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.271597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.274241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.274241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.274241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.274241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.276207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.288826 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 03:43:37.290793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 461/929] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:37.297614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.308196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f22e-0735-4dba-be8e-67eb9c6af3f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.312939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.313606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.313883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.314151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.314881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.315181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.316829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.322907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 469/930] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:37.329912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.341287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36190d-5c40-4c92-b2e4-87a915c50bf1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.346321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.347063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.347281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.347556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.348305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.348632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.350412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.357042 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 462/931] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:37.363740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.374545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f7d4-017f-49e8-820e-326b77face85 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.379867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.380969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.381459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.381937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.383004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] RBAC: Adding query filter params (interface=admin, service_id=c44284f61fac4888850f9761708a4acf, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.383586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.385524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580264a2-dc67-4ad1-a8de-84ed8fe95f17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.392706 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 470/932] 10.222.0.13 () {56 vars in 1270 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/endpoints?service_id=c44284f61fac4888850f9761708a4acf&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:37.399407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.410396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab1d30-471a-4ae4-868a-db1954afe551 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.415523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.416518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.417038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.417530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.418985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.420831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810db10e-b360-4859-bdf1-a2f7e3e473bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.428571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 463/933] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:43:37.526894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b99-51d4-4570-a364-5dbc379f71d8 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.527376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b99-51d4-4570-a364-5dbc379f71d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.527481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b99-51d4-4570-a364-5dbc379f71d8 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.529731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 471/934] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:37.542260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.542563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.543343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.563347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:37.564581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:37.573472 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 464/935] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:37.600381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7b99-51d4-4570-a364-5dbc379f71d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.614268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7b99-51d4-4570-a364-5dbc379f71d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.619161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.619986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.620259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.620533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.621303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.622957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.634899 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 03:43:37.636142 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 472/936] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:37.643126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.653398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecfeaf-afe8-4bd3-9acc-66bf275317bd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.659870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.660528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.660844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.661117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.661903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.662202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.663832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.670243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 465/937] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:37.676506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.686836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ad33c-0c73-40d9-8d23-7e10d7cdf3cb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.691901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.692555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.692927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.693205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.694187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.694489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.696049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.701500 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 473/938] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:37.709110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.719569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c83c-62d0-45b6-9de6-5f2aace5b9a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.724312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.725054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.725334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.725611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.726478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] RBAC: Adding query filter params (interface=public, service_id=c18312905fed4cdc82d1ffbf8fdc5f95, region_id=RegionOne) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.726785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.728420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7e333-32a2-4772-a26f-3e213f7e099f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.734709 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 466/939] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/endpoints?service_id=c18312905fed4cdc82d1ffbf8fdc5f95&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:37.740837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.751013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9e5b-e871-49a9-956d-e78a7f8cc1e3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.755941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.756659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.756948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.757223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.757974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.759655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c7e9f-241a-4df8-a1b7-af8181ea1ae6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.763946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a456-1937-4c19-b3a7-3cd4a670a89a None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.764251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a456-1937-4c19-b3a7-3cd4a670a89a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.764506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a456-1937-4c19-b3a7-3cd4a670a89a None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.767119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 474/941] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:43:37.767254 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 467/941] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:43:37.774443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.774744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.775000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.797653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:37.799273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:37.812930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 475/942] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:37.838802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6a456-1937-4c19-b3a7-3cd4a670a89a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.852998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6a456-1937-4c19-b3a7-3cd4a670a89a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.860399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.861509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.862033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.862509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.863476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.867565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.869331 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.common [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 10 03:43:37.884766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.sql.core [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 10 03:43:37.884766 ncdv-817176-1 devstack@keystone.service[96285]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 10 03:43:37.884766 ncdv-817176-1 devstack@keystone.service[96285]: [parameters: {'user_id': '5f3c33f3e19c4bd4a0462c010e2c12bc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 10 03:43:37.884766 ncdv-817176-1 devstack@keystone.service[96285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 03:43:37.891693 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 10 03:43:37.893436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 468/943] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:43:37 2021] POST /identity/v3/users => generated 160 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:37.900511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.910728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7373c-c2e6-405e-bd47-1d17ddf49611 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.915701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.916799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.917257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.917700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.926480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.928834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:37.945366 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d2097fbe-8233-4de4-8f3f-305860d7f559 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 03:43:37.953129 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 476/944] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:37.955709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:37.968488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10943-2da6-4b7a-bf47-5057f75ea8db admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:37.973682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:37.974617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:37.975069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:37.975510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:37.976548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:37.977044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:37.979484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8939-8606-4355-ac7b-17cb6632e8d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:38.022142 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 469/945] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 10 03:43:37 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:39.610319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb923b-a80d-4027-918e-8f95e1163daa None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.610834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb923b-a80d-4027-918e-8f95e1163daa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.610908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb923b-a80d-4027-918e-8f95e1163daa None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.612833 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 477/946] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:39.620168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.620638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.620786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.639045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:39.640548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:39.648630 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 470/947] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:39 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:39.673871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb923b-a80d-4027-918e-8f95e1163daa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.685901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb923b-a80d-4027-918e-8f95e1163daa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.690226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.690990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.691267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.691538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.692221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.694080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:39.705048 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 03:43:39.706329 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 478/948] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:39.712950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.722417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b3c2-ce6d-4741-a935-e5a645365b2e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.726858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.727568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.727909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.728242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.729047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:39.729408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.731079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:39.736869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 471/949] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:39.743758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.753774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f625e-2fe6-4905-9d67-5d208bd019f9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.758426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.759096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.759374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.759641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.760367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:39.760705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.762835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:39.768482 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 479/950] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:39.775186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.785463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7eb7-be86-4cb6-b1ae-1a2fd972cc72 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.789942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.790645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.790925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.791194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.791984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] RBAC: Adding query filter params (interface=public, service_id=bcf9520e5e674511a63967084bd0da13, region_id=RegionOne) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:39.792290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.794058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02917e-ca81-463d-922b-41b108479816 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:39.799248 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 472/951] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/endpoints?service_id=bcf9520e5e674511a63967084bd0da13&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:39.808997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.818943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89107b-2510-4d0d-8c2a-170f0de2d544 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.823740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.825006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.827991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.828266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.828995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.830585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aefce-39ef-4e7a-9163-7992642cb5f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:39.837602 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 480/952] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:43:39.900210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33d41-9581-40d8-8364-dd00a4717512 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.900535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33d41-9581-40d8-8364-dd00a4717512 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.900811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33d41-9581-40d8-8364-dd00a4717512 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.902914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 473/953] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:39.910818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.911113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.911377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.931613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:39.932874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:39.941513 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 481/954] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:39 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:39.967635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c33d41-9581-40d8-8364-dd00a4717512 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:39.980329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c33d41-9581-40d8-8364-dd00a4717512 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:39.990041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:39.990041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:39.990041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:39.990041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:39.990486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:39.991257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.004294 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 03:43:40.005776 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 474/955] 10.222.0.13 () {56 vars in 1147 bytes} [Wed Nov 10 03:43:39 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:40.013365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.023171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071de2-3115-4d22-9810-8f7973046107 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.028034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.028868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.029218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.029562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.030378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:40.030744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.032416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.038115 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 482/956] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:40 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:40.044746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.054587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0b69-5c7e-45be-b8e5-89a97ad932fc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.060071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.060842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.061122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.061396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.062103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:40.062409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.063974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8b4c-7890-48c4-9084-b4f5a77d55f0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.069764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 475/957] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 10 03:43:40 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:40.077127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.087045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92e8d5-8ee2-45c9-9dea-92445cf0933d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.091515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.092155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.092429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.092742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.093507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.095071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32651c8-e529-4ea9-8f31-5b4a0afabf3b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.110026 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 483/958] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:40 2021] POST /identity/v3/endpoints => generated 325 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:40.155420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5af2-1aaa-4cf0-af90-cd3b2942c605 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.155605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5af2-1aaa-4cf0-af90-cd3b2942c605 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.156032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5af2-1aaa-4cf0-af90-cd3b2942c605 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.158132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 476/959] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:40.166147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.166465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.166705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.186762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:40.187971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:40.207081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 484/960] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:40 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:40.232747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5af2-1aaa-4cf0-af90-cd3b2942c605 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.245610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5af2-1aaa-4cf0-af90-cd3b2942c605 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.250184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.250982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.251260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.251573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.252276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.253923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.265977 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 03:43:40.267439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 477/961] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:40 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:40.274014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.283978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa287-be6e-4220-a83e-c6ba1fce413f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.288953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.289711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.290061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.290402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.291209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:40.291518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.293141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.303794 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 485/962] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:40 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:40.305109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.316747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbf625-d829-42ef-a4a2-7bcacbb436bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.321595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.322237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.322512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.322781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.323494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:40.323797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.325911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1a6d5-c299-4ef4-aba8-cd53056a7388 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.331539 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 478/963] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 10 03:43:40 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:40.338271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:40.348749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c657-92d5-4a88-ab17-43b176166d25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:40.353524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:40.354159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:40.354435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:40.354703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:40.355473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:40.357111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201dc06-0726-435e-854e-bfc68afa6343 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:40.375552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 486/964] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:40 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:42.203235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4da2a-0db1-4ca0-b5a8-60edbc2cf4e4 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.203745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4da2a-0db1-4ca0-b5a8-60edbc2cf4e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.203745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4da2a-0db1-4ca0-b5a8-60edbc2cf4e4 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.205750 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 479/965] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:42.212857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.213288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.213466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.231956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:42.233186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:42.249531 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 487/966] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:42 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:43:42.274961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4da2a-0db1-4ca0-b5a8-60edbc2cf4e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.287344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4da2a-0db1-4ca0-b5a8-60edbc2cf4e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.291678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.292440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.293401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.293677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] PATH_INFO: `/v3/services/image` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.294337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.295911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.306642 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 03:43:42.308041 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 480/967] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:42.315071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.324913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77035b4-1198-433e-8a7b-78b3e9930c3e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.329586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.330272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.330551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.330825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.331565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:42.331870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.333581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.339323 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 488/968] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:42.346359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.357051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f969-91e8-4c17-81ba-2cdea9be990f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.361537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.362310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.362585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.362851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.363561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] RBAC: Adding query filter params (type=image) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:42.363858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.365454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29fa81-c5ce-4727-9f20-c4162746512a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.371267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 481/969] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:42.376900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.386556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf74e-74ec-4a53-bc2b-80515dbe3c00 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.391065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.391777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.392132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.392475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.393345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.394988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1033f0e-a0b3-4a75-99a1-4315437865ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.413705 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 489/970] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:43:42 2021] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:42.473243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ffe-fee7-417d-aa87-b82a7995fe98 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.473418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ffe-fee7-417d-aa87-b82a7995fe98 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.473689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ffe-fee7-417d-aa87-b82a7995fe98 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.475804 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 482/971] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:42.484635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.484934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.485273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.504017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:42.505303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:42.523573 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 490/972] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:42.549788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252ffe-fee7-417d-aa87-b82a7995fe98 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.563247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252ffe-fee7-417d-aa87-b82a7995fe98 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.567894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.568976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.569259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.569528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.570723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.572404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f80e1b-85b0-4c92-8fc0-477d8bc0c927 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.574254 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 483/973] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:42.580799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.590026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26588a96-dd9e-418e-b12c-d13363dd7e79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.594606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.595275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.595549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.595821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.596568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:42.598493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a1bf6-1fb9-4ce7-99ca-842bca73acc2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:42.629189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 491/974] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:43:42 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:42.821223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d561f4-26ea-4386-b248-7d0349826ffa None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.821405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d561f4-26ea-4386-b248-7d0349826ffa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.821672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d561f4-26ea-4386-b248-7d0349826ffa None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.823466 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 484/975] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:42.831849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.832298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.832577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.852109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:42.853443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:42.912224 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 492/976] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:42.938951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d561f4-26ea-4386-b248-7d0349826ffa None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.951268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d561f4-26ea-4386-b248-7d0349826ffa None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.955684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.956580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.956954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.957232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.968081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:42.975234 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:42.976558 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 485/977] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:42.983738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:42.992827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4533ade-b142-4777-b608-06290eb8c969 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:42.997415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:42.998172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:42.998561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:42.998916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:42.999787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.000193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.002213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.011192 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 493/978] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:42 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:43.017948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.032454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778e2a-7d56-4d91-9cc6-f9ed4c6afa83 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.037200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.038078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.038460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.038848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.049863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.051832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.068303 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:43.070055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 486/979] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:43.076210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.085647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef103ba-853d-4f9f-866c-36b35d6e2a63 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.090582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.091220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.091502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.091777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.092497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.092839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.094395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.106644 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 494/980] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:43.116694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.130124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726b3e-7136-476b-842f-6945bd5a7c30 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.137476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.138360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.138736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.139104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.146485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.148538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.162450 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:43.163920 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 487/981] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:43.171112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.180692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5cec-945d-4a37-a8cb-f387eee2d396 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.185264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.186010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.186389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.186757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.187705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.188110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.190033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.207662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 495/982] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:43.213934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.224157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62297b6-c291-4d4b-aa5f-9780d9f3fc5a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.228820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.229517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.229867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.230207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.237894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.239683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.248450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 488/983] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:43:43.254738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.265101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fcbd-9738-4c29-b0ff-41c149aa0de4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.269730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.270576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.270925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.271273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.281989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.283832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.299895 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:43.301261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 496/984] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:43.307409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.316263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efde1-5b66-4500-bbaa-bdd8ef6fe673 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.321120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.321828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.322176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.322522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.323306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.323684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.325850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.337357 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 489/985] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:43:43.344389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.354055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db1987-f2ef-4117-bf80-a53402527f14 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.358609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.359375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.359653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.359920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.366656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.368583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.381376 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:43.387138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 497/986] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:43.390908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.403316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f261-486a-4cd1-8ef5-d5ee9940d271 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.408378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.409284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.409784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.410273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.411309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.411811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.413878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe29fe-063f-435a-9bfd-f4acae821d24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.429332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 490/987] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:43.436769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:43.451011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb3c3-17bb-410b-b73c-1f4bb801f9b6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:43.456187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:43.457099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:43.457523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:43.458002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:43.459036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] RBAC: Adding query filter params (role.id=4caf49d8795b466fb0a90b1b69b4047a, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:43.459491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:43.461541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556be4-dbe0-4879-87bf-39a0929f0ce0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:43.473042 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 498/988] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:43 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=4caf49d8795b466fb0a90b1b69b4047a => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:44.821424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880b61c-0517-49ac-ae43-c36448b3618d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:44.821941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880b61c-0517-49ac-ae43-c36448b3618d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:44.821941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880b61c-0517-49ac-ae43-c36448b3618d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:44.824251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 491/989] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:44.831806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:44.832177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:44.832342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:44.850176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:44.851340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:44.859317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 499/990] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:44.884019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880b61c-0517-49ac-ae43-c36448b3618d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:44.897842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880b61c-0517-49ac-ae43-c36448b3618d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:44.902678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:44.903302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:44.903575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:44.903838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:44.911335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:44.913087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62737abe-3a12-4d1b-a204-52b84f50e6d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:44.921713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 492/991] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:44.928006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:44.936668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d255a-2336-4614-8ff5-d5587cedc30d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:44.941010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:44.941770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:44.942042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:44.942309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:44.943460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:44.945397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e49285-447c-4994-ab39-90674fd7f824 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:44.947065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 500/992] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:45.016042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4970-1395-4e29-8314-c24276aa708e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.016339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4970-1395-4e29-8314-c24276aa708e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.016781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4970-1395-4e29-8314-c24276aa708e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.018772 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 493/993] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:45.026822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.027707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.027944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.046284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:45.047491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:45.055455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 501/994] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:45.083726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e4970-1395-4e29-8314-c24276aa708e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.096435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e4970-1395-4e29-8314-c24276aa708e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:45.101088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:45.101874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.102147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.102413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.103596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:45.105405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af5a2b-570f-465a-af81-38a502818929 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:45.107259 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 494/995] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:45.113613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.123322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cedb3-4fe4-4d69-9323-ee911a590de0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:45.127944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb74348-6caf-4911-895e-38432853604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:45.128627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74348-6caf-4911-895e-38432853604b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.128937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74348-6caf-4911-895e-38432853604b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.129205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74348-6caf-4911-895e-38432853604b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.129936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb74348-6caf-4911-895e-38432853604b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:45.131826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb74348-6caf-4911-895e-38432853604b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:45.154579 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 502/996] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:43:45 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:45.796877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82caba-9f9c-4108-b092-a2286057752b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.797155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82caba-9f9c-4108-b092-a2286057752b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.797423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82caba-9f9c-4108-b092-a2286057752b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.799197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 495/997] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:45.806256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.806538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.806808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.825711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:45.826881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:45.834581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 503/998] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:45.860074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82caba-9f9c-4108-b092-a2286057752b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.871967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82caba-9f9c-4108-b092-a2286057752b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:45.876668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:45.877518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.877800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.878199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.888590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:45.895701 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:45.896871 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 496/999] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:45.904034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.912790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114bca7-da20-4523-b9cb-8e36e144cf6b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:45.917255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:45.918579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.918852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.919122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.919881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:45.920181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:45.921767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:45.929752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 504/1000] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:45.936701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.946981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69c05-f373-4d50-ba9f-c3a6579b079f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:45.951466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:45.952215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:45.952493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:45.952809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:45.962796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:45.965127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:45.981855 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:45.982995 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 497/1001] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:45.989426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:45.998971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2dda-fe4e-4390-bdd4-6ca350c7d107 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.003463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.004174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.004537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.004913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.005705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:46.006074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.007677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.024072 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 505/1002] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:46.025509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.035473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f305aa-f6bc-42b9-b35f-8c7415a084ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.039905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.040693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.040972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.041242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.049059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.050968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.064203 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:46.065357 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 498/1003] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:46.071967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.081419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d08dc-61d7-42f0-860c-d68c3598db75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.085802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.086447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.086725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.086995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.087832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:46.088132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.090517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.107667 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 506/1004] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:46.113647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.123180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359115-f8d2-49e4-b08d-ee2cbb2962b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.127663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.128416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.128724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.128997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.138798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.140595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.157039 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:46.158179 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 499/1005] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:46.164381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.174449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985998a0-7cd8-4b7c-a662-8d38d60ac8ae admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.178876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.179511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.179786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.180052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.180811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:46.181107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.182655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.193951 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 507/1006] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:46.200330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.209723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcc989-0ccc-4aa8-b097-6d676acf2aac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.214164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.215466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.215736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.216000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.222588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.224502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.236932 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:46.238028 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 500/1007] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:46.244517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.253916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e775-89d5-4695-b593-496bd181bc2f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.258337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.258968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.259244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.259512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.260303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:46.260598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.262981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f2ec-d072-43d5-b2ef-00eeb31a1e13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.274593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 508/1008] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:46.281588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:46.291608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645f66-c75b-4d49-9b2e-10f61b9ecc73 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:46.296068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:46.296949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:46.297224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:46.297494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/4caf49d8795b466fb0a90b1b69b4047a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:46.299700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=d1d98a52e85d40a5b77f40d833837869, role_id=4caf49d8795b466fb0a90b1b69b4047a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:46.302270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100400cc-302b-4c13-acb4-08cac167bc10 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:46.316524 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 501/1009] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:46 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/d1d98a52e85d40a5b77f40d833837869/roles/4caf49d8795b466fb0a90b1b69b4047a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:47.515088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276889-9062-482f-9af9-6109eaef550d None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.515691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276889-9062-482f-9af9-6109eaef550d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.515691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276889-9062-482f-9af9-6109eaef550d None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.517434 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 509/1010] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:47.524867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.525389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.525389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.544303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:47.545526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:47.599801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 502/1011] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:47.625527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276889-9062-482f-9af9-6109eaef550d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.637388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276889-9062-482f-9af9-6109eaef550d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.641978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.642744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.643016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.643283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.653807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:47.660418 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:47.661603 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 510/1012] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:47.669176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.677991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9ec1-7ae6-47c3-8456-4a7fa8b1771c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.682414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.683084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.683359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.683631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.684379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:47.684709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:47.686294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:47.694794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 503/1013] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:47.701509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.711875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e447f-b199-4e0a-b587-85200f887a8b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.717136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.717975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.718254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.718527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] PATH_INFO: `/v3/users/017b9bbfc89c40cd8b28ababf500ad07` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.732278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] RBAC: Authorizing `identity:get_user(user_id=017b9bbfc89c40cd8b28ababf500ad07)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:47.734399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:47.740629 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 511/1014] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/users/017b9bbfc89c40cd8b28ababf500ad07 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:47.742457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.751801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156216b3-523f-4779-b159-d15760f27f98 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.756189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.756832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.757107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.757374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.765526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:47.767156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:47.775677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 504/1015] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:47.782224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.791469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee71e5-487d-404b-aebf-464a5a493236 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.796013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.796890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.797159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.797462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.798630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:47.800678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8b387-fdf6-4118-a8aa-5fb4643cfc40 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:47.802459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 512/1016] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:47.808950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:47.817740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d60b8-7917-4660-a5dd-b3edc47dde52 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:47.822491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:47.823116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:47.823394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:47.824153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:47.827305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=f65d2d49eda34ae4bf39409b4225c986, user.id=017b9bbfc89c40cd8b28ababf500ad07) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:47.827305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:47.827604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cadc3-46fd-4f58-b397-3c863df83caf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:47.833076 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 505/1017] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:47 2021] GET /identity/v3/role_assignments?user.id=017b9bbfc89c40cd8b28ababf500ad07&scope.project.id=f65d2d49eda34ae4bf39409b4225c986&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:48.619726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2629-8a57-4204-8447-5e93f8054deb None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.620251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2629-8a57-4204-8447-5e93f8054deb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.620251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2629-8a57-4204-8447-5e93f8054deb None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.622064 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 513/1018] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:48.629409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.629817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.629947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.648415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:48.649593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:48.657672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 506/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:48.682785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2629-8a57-4204-8447-5e93f8054deb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.695005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2629-8a57-4204-8447-5e93f8054deb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.699919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.700726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.701003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.701272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.711092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:48.718935 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 03:43:48.720084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 514/1020] 10.222.0.13 () {56 vars in 1141 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:48.726924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.735718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df72b1-0041-4d13-9fa0-b4998ae9100f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.740153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.740823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.741099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.741366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.742118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:48.742460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.747439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.754576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 507/1021] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:48.760817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.771328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51601791-8d32-4997-9067-10aae7ce3102 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.775732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.776479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.777447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.777711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.787382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.789196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.805195 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:48.806512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 515/1022] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:48.813301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.823158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4f25-143e-4bbd-bb55-02024fce955b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.828340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.829178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.829383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.829660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.830386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:48.830689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.832256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.844064 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 508/1023] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:48.850293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.859628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59204f4c-38fe-42e0-bce0-f3c12f9ae8f0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.864026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.864806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.865081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.865348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.872888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.874774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.888314 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 03:43:48.889466 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 516/1024] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:43:48.895695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.905198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0693bd-0214-410b-ae37-0e914bcb6f46 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.910488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.911221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.914591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.914591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.914591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:48.914591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.914898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.931687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 509/1025] 10.222.0.13 () {56 vars in 1154 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:48.938651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.948223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51d0d-77ef-49a4-beb9-601d74b3882a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.953328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.953949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.954220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.954486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:48.962007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:48.963720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:48.972385 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 517/1026] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:48.979023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:48.988521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4e7b-e773-47db-9c20-f20bea12bb34 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:48.993036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:48.993972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:48.994257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:48.994529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:49.005176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:49.006975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:49.027143 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:43:49.028312 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 510/1027] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:49.034626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:49.043437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b483-469e-4633-86d6-ceb5a1a67cd0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:49.048117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:49.048823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:49.049101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:49.049373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:49.050119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:49.050424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:49.052028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:49.064773 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 518/1028] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:43:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:49.071464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:49.081583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d95c7-e15b-4d52-b5ed-cb6d60d03967 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:49.086018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:49.086778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:49.087056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:49.087329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:49.093930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:49.095865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:49.108283 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:43:49.109411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 511/1029] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:43:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:49.115681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:49.125714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b55ed-b60e-4f97-8ada-98c7c585d2c5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:49.130107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:49.130836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:49.131176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:49.131580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:49.132431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:49.132839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:49.134686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b9f7-1629-4ba4-872c-ee14a5033e89 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:49.146971 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 519/1030] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:43:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:49.153716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:49.163863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee871-cbfa-436d-9728-b63b3bad5d9c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:49.168884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:49.169491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:49.169769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:49.170042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:49.170875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] RBAC: Adding query filter params (role.id=4caf49d8795b466fb0a90b1b69b4047a, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=d1d98a52e85d40a5b77f40d833837869) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:49.171183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:49.173009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f871-0467-4294-9315-652e4bcff1a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:49.178708 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 512/1031] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:49 2021] GET /identity/v3/role_assignments?user.id=d1d98a52e85d40a5b77f40d833837869&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=4caf49d8795b466fb0a90b1b69b4047a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:50.148167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bb056-e1b3-45b5-81f5-85b666b8d5a0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.148697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bb056-e1b3-45b5-81f5-85b666b8d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.148793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bb056-e1b3-45b5-81f5-85b666b8d5a0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.150499 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 520/1032] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:50.158081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.158500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.158623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.175311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:50.176481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:50.183949 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 513/1033] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:50.209090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bb056-e1b3-45b5-81f5-85b666b8d5a0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:50.221348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bb056-e1b3-45b5-81f5-85b666b8d5a0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:50.225583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:50.226333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.226604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.226871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.236462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:50.243048 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:50.244148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 521/1034] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:50.250499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:50.259097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099ac8-1e5c-47d3-ba77-9e6ae0596dd3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:50.264020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:50.264679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.264957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.265239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.265992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:50.266346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:50.267910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:50.275779 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 514/1035] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:50.282235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:50.291758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0254226-abeb-441d-a275-f7c1c442f227 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:50.296089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:50.296915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.297186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.297450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] PATH_INFO: `/v3/users/017b9bbfc89c40cd8b28ababf500ad07` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.298615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=017b9bbfc89c40cd8b28ababf500ad07)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:50.300687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:50.302206 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 522/1036] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:43:50 2021] GET /identity/v3/users/017b9bbfc89c40cd8b28ababf500ad07 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:50.308462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:50.317443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c37c4-af80-4ed8-b1ae-7bd16feee4d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:50.322118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:50.322921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.323203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.323474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.325288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:50.327235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7728-e5fc-49f3-b5d4-cc91cc981673 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:50.328855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 515/1037] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:43:50 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:50.334669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:50.343664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f9b-1ee6-425a-8ecb-53a756357bf9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:50.348786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:50.349609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:50.349877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:50.350141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986/users/017b9bbfc89c40cd8b28ababf500ad07/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:50.352047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65d2d49eda34ae4bf39409b4225c986, user_id=017b9bbfc89c40cd8b28ababf500ad07, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:50.354559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071759bb-2224-4fde-bd28-c43c4aa08e63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:50.367022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 523/1038] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:43:50 2021] PUT /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986/users/017b9bbfc89c40cd8b28ababf500ad07/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:43:52.625086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81916ae1-7afe-4e4e-a05f-1ba63922db7b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.625621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81916ae1-7afe-4e4e-a05f-1ba63922db7b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.625621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81916ae1-7afe-4e4e-a05f-1ba63922db7b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.627385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 516/1039] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:52.634259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.634656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.634800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.652391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:52.653596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:52.708552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 524/1040] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:52 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:52.734851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81916ae1-7afe-4e4e-a05f-1ba63922db7b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.746825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81916ae1-7afe-4e4e-a05f-1ba63922db7b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.751175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.751967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.752246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.752518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.762872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:43:52.769556 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:43:52.770662 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 517/1041] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:43:52.777299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.785910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb537094-ffb0-40ac-9359-53a99267fcb5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.790367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.791007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.791310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.791582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.792971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:52.793276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:52.794842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:52.802754 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 525/1042] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:52.809112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.818369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fffd9-481b-4e4b-bf8a-e7240200b62b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.823008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.823824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.824096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.824363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] PATH_INFO: `/v3/users/017b9bbfc89c40cd8b28ababf500ad07` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.825600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] RBAC: Authorizing `identity:get_user(user_id=017b9bbfc89c40cd8b28ababf500ad07)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:52.827700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:52.829563 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 518/1043] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/users/017b9bbfc89c40cd8b28ababf500ad07 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:52.835189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.844999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314f42-818c-4a6d-9a2c-5f3e5e3eaaa7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.849374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.849990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.850268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.850541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.858634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:52.860338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:52.868808 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 526/1044] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:52.874770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.884016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272e5f-aee0-4417-8e71-222fee701232 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.888484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.889347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.889631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.889860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.891006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:52.893001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f4dd-331e-4e08-ae14-dbc29f05d2b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:52.894594 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 519/1045] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:52.900805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:52.909716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ae91-93e0-48b9-8a05-04f5b10ca652 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:52.914156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:52.914762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:52.915041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:52.915315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:52.916120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=f65d2d49eda34ae4bf39409b4225c986, user.id=017b9bbfc89c40cd8b28ababf500ad07) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:52.916426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:52.918841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9ccd8-dff2-4abf-852d-5cca68179c41 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:52.924283 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 527/1046] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:52 2021] GET /identity/v3/role_assignments?user.id=017b9bbfc89c40cd8b28ababf500ad07&scope.project.id=f65d2d49eda34ae4bf39409b4225c986&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:55.252875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad34-da9c-461e-b0cc-c780148d63e4 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:55.253401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad34-da9c-461e-b0cc-c780148d63e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:55.253401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad34-da9c-461e-b0cc-c780148d63e4 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:55.255193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 520/1047] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:55.262705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:55.263106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:55.263249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:55.281749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:55.282922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:55.290379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 528/1048] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:55.317312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccad34-da9c-461e-b0cc-c780148d63e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:55.329985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccad34-da9c-461e-b0cc-c780148d63e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:55.334280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:55.335032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:55.335317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:55.335590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:55.336835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:55.338493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d5e9-0135-476b-9c65-0ca378f7e90f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:55.340692 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 521/1049] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:43:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:55.346438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:55.355019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d5317-b7a2-4e9a-9a48-9751b0a96bd8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:55.359359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:55.359990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:55.360267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:55.360539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:55.361279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:55.363128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143b6c6-7705-49ad-80db-516a8c0db3c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:55.382028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 529/1050] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:43:55 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:43:57.703064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab3dc-0ecf-452d-ac2b-1fe641cab1d3 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.703665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab3dc-0ecf-452d-ac2b-1fe641cab1d3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.703665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab3dc-0ecf-452d-ac2b-1fe641cab1d3 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.705430 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 522/1051] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:43:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:43:57.712427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.712899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.713010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.730471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:43:57.731638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:43:57.739147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 530/1052] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:43:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:43:57.764891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab3dc-0ecf-452d-ac2b-1fe641cab1d3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:57.777309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab3dc-0ecf-452d-ac2b-1fe641cab1d3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:57.781589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:57.782411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.782687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.782959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] PATH_INFO: `/v3/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.784426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] RBAC: Authorizing `identity:get_role(role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:57.785467 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:43:57.785467 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:43:57.785467 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:43:57.786318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:57.787608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 523/1053] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:43:57 2021] GET /identity/v3/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:57.793674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:57.802433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8f15-8606-478e-93e8-e2d17d72aa47 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:57.806901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:57.808232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.808502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.808800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] PATH_INFO: `/v3/users/6c49a731c22844ea8a4c513a8bee9f2b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.821864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] RBAC: Authorizing `identity:get_user(user_id=6c49a731c22844ea8a4c513a8bee9f2b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:57.824539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:57.826183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 531/1054] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:43:57 2021] GET /identity/v3/users/6c49a731c22844ea8a4c513a8bee9f2b => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:57.832740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:57.842218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afed17-977f-4d89-8e92-781247c80903 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:57.846712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:57.847330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.847605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.847877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.855349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:57.857089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:57.865727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 524/1055] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:43:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:43:57.872461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:57.881826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0d2b-e82d-4193-9351-0c34563dab8f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:57.886843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:57.887660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.887936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.888206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.889395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:57.891368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59224f-e381-474d-b2fb-213f6167239f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:57.893019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 532/1056] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:43:57 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:43:57.899214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:43:57.907634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f472-fbaf-4136-89c2-416ecbeba031 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:43:57.912094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:43:57.912735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:43:57.913014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:43:57.913287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:43:57.914094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=f65d2d49eda34ae4bf39409b4225c986, user.id=6c49a731c22844ea8a4c513a8bee9f2b) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:43:57.914396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:43:57.916134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eef9-dcf2-4f13-b2a3-97bf6620edb7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:43:57.921402 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 525/1057] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:43:57 2021] GET /identity/v3/role_assignments?user.id=6c49a731c22844ea8a4c513a8bee9f2b&scope.project.id=f65d2d49eda34ae4bf39409b4225c986&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:00.187784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845f8e-6b13-49ad-b5fe-e84dba8329c6 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.188325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845f8e-6b13-49ad-b5fe-e84dba8329c6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.188325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845f8e-6b13-49ad-b5fe-e84dba8329c6 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.190160 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 533/1058] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:00.197248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.197670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.197772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.215452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:00.216622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:00.224047 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 526/1059] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:00.248595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33845f8e-6b13-49ad-b5fe-e84dba8329c6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:00.260314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33845f8e-6b13-49ad-b5fe-e84dba8329c6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:00.265153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:00.265959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.266236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.266508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] PATH_INFO: `/v3/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.267949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] RBAC: Authorizing `identity:get_role(role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:00.268972 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:44:00.268972 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:44:00.268972 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:44:00.269828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:00.271117 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 534/1060] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:00 2021] GET /identity/v3/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:00.276958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:00.285414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc966-b2db-41c7-a369-f83b3542496e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:00.289756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:00.290575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.290848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.291117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] PATH_INFO: `/v3/users/6c49a731c22844ea8a4c513a8bee9f2b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.292275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c49a731c22844ea8a4c513a8bee9f2b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:00.294365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:00.295886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 527/1061] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:00 2021] GET /identity/v3/users/6c49a731c22844ea8a4c513a8bee9f2b => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:00.301522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:00.311044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039f14-df97-4c5d-83ed-8d1115e07087 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:00.315363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:00.316137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.316409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.316712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.317843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:00.320154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481920ee-04b7-4003-9a7e-13069491aa01 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:00.321771 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 535/1062] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:00 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:00.328270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:00.337333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0e3a-14fe-4792-bdf5-919766d7f802 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:00.341750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:00.342562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:00.342836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:00.343107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986/users/6c49a731c22844ea8a4c513a8bee9f2b/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:00.345285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65d2d49eda34ae4bf39409b4225c986, user_id=6c49a731c22844ea8a4c513a8bee9f2b, role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:00.347796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9fe32-c70d-455d-9cb7-2c4378a37b27 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:00.359922 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 528/1063] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:44:00 2021] PUT /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986/users/6c49a731c22844ea8a4c513a8bee9f2b/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:44:02.627752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2f78-b448-4f5c-999e-91f0d9e6300c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.628307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2f78-b448-4f5c-999e-91f0d9e6300c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.628307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2f78-b448-4f5c-999e-91f0d9e6300c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.630066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 536/1064] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:02.637305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.637712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.637848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.655495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:02.656698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:02.710685 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 529/1065] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:02.736375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2f78-b448-4f5c-999e-91f0d9e6300c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:02.748121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2f78-b448-4f5c-999e-91f0d9e6300c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:02.752320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:02.753165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.753439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.753703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] PATH_INFO: `/v3/roles/cb7556a03b794f2b81595a51fca3ad01` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.755126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] RBAC: Authorizing `identity:get_role(role_id=cb7556a03b794f2b81595a51fca3ad01)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:02.756724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:02.758012 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 537/1066] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:02 2021] GET /identity/v3/roles/cb7556a03b794f2b81595a51fca3ad01 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:02.764497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:02.773032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5b128-5254-4ef7-9595-7e64fea5989b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:02.778033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:02.778860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.779137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.779407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] PATH_INFO: `/v3/users/6c49a731c22844ea8a4c513a8bee9f2b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.780592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] RBAC: Authorizing `identity:get_user(user_id=6c49a731c22844ea8a4c513a8bee9f2b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:02.782678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:02.784218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 530/1067] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:02 2021] GET /identity/v3/users/6c49a731c22844ea8a4c513a8bee9f2b => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:02.789990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:02.798964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a390b-3422-4b98-90d7-28a327a1482f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:02.803413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:02.804015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.804288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.804556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.812158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:02.813867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:02.822534 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 538/1068] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:02 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:02.829412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:02.838707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ca21-497b-4193-97d8-3ef9b79cce5a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:02.843747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:02.844557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.844873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.845145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.846290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:02.848267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a50f2-7c21-4166-aa26-93743841b96f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:02.849918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 531/1069] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:02 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:02.856140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:02.864475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e072b-193f-449d-9b3d-3e53107e703d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:02.868911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:02.869517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:02.869788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:02.870053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:02.870887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] RBAC: Adding query filter params (role.id=cb7556a03b794f2b81595a51fca3ad01, scope.project.id=f65d2d49eda34ae4bf39409b4225c986, user.id=6c49a731c22844ea8a4c513a8bee9f2b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:02.871190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:02.872985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a5bc-5ba8-461a-8e56-57ca5bbbb33e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:02.878405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 539/1070] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:44:02 2021] GET /identity/v3/role_assignments?user.id=6c49a731c22844ea8a4c513a8bee9f2b&scope.project.id=f65d2d49eda34ae4bf39409b4225c986&role.id=cb7556a03b794f2b81595a51fca3ad01 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:05.173998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8650-cfba-425a-bb47-f2591c982c63 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:05.174532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8650-cfba-425a-bb47-f2591c982c63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:05.174532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8650-cfba-425a-bb47-f2591c982c63 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:05.176307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 532/1071] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:05.183387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:05.183774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:05.183928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:05.201943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:05.203107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:05.210640 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 540/1072] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:05.236267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8650-cfba-425a-bb47-f2591c982c63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:05.248247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8650-cfba-425a-bb47-f2591c982c63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:05.252493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:05.253279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:05.253554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:05.253823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:05.254968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:05.256601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254f4d-355c-4fe5-8981-25cb92248c05 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:05.258157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 533/1073] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:44:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:05.264678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:05.273460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e35e7f-e184-4413-817a-944f420728f3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:05.278524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:05.279150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:05.279431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:05.279704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:05.280422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:05.282303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78b4ec-d514-4d20-896f-469249ad6298 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:05.305976 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 541/1074] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:44:05 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:44:07.623048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c3bc-93d1-4ee0-a117-928cf624b7f0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:07.623578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c3bc-93d1-4ee0-a117-928cf624b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:07.623578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c3bc-93d1-4ee0-a117-928cf624b7f0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:07.625401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 534/1075] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:07.632486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:07.632946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:07.633051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:07.650199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:07.651370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:07.705153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 542/1076] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:07.732759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513c3bc-93d1-4ee0-a117-928cf624b7f0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:07.744490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513c3bc-93d1-4ee0-a117-928cf624b7f0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:07.748796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:07.749544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:07.749818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:07.750085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:07.751226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:07.752899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a153d0-c9da-4c01-8cb1-60853b8c3fc1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:07.754413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 535/1077] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:44:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:07.760241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:07.768737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5b52-582a-4817-a0c6-96212ee475c0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:07.773083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:07.773714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:07.773987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:07.774255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:07.774969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:07.776827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420892-e23e-4b21-bfd2-574dcf8d3168 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:07.795864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 543/1078] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:44:07 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:44:10.128020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051f58d-f1a0-46df-b4ea-41ba771ef75f None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.128544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051f58d-f1a0-46df-b4ea-41ba771ef75f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.128544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051f58d-f1a0-46df-b4ea-41ba771ef75f None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.130272 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 536/1079] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:10.137910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.138350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.138455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.155364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:10.156531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:10.163962 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 544/1080] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:10.189943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051f58d-f1a0-46df-b4ea-41ba771ef75f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.202029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051f58d-f1a0-46df-b4ea-41ba771ef75f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.206294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.207068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.207340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.207607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.217478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:10.224150 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:10.225265 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 537/1081] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:10.231891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.240427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31806-3e22-45e8-9d30-1d9516b10ca3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.244803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.245434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.245708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.245977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.247305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:10.247604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:10.249199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:10.257076 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 545/1082] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:10.262935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.272661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb546-f9d7-47fb-8019-2f71b4cdb5e0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.277091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.277890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.278167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.278439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] PATH_INFO: `/v3/users/9c2be4fd922242e1a93a8ca2d8314928` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.290917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] RBAC: Authorizing `identity:get_user(user_id=9c2be4fd922242e1a93a8ca2d8314928)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:10.293528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:10.295087 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 538/1083] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/users/9c2be4fd922242e1a93a8ca2d8314928 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:10.300971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.310713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048e90-d95d-4c61-b68d-c82a8a92f716 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.315114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.315726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.316004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.316274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.323930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:10.325637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:10.334089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 546/1084] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:10.339816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.348831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05388a-f36a-4f5d-8edc-0062377c6cfb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.353205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.353993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.354269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.354539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] PATH_INFO: `/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.356200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] RBAC: Authorizing `identity:get_project(project_id=54d0dbcc34cd41e7842b0425cd547f9b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:10.358170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612e73-3781-4d54-b454-336627a4c053 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:10.359756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 539/1085] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:10.365646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:10.374420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e376cde-bad9-4af3-8797-fe6bafa09f5e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:10.379116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:10.379659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:10.379931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:10.380198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:10.381037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b, user.id=9c2be4fd922242e1a93a8ca2d8314928) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:10.381341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:10.383071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51aa0f-2dfb-421c-887a-f70bc3e5269f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:10.388206 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 547/1086] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:44:10 2021] GET /identity/v3/role_assignments?user.id=9c2be4fd922242e1a93a8ca2d8314928&scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:12.638363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7934-df5e-40f8-a14c-d6b2578d24b0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.638919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7934-df5e-40f8-a14c-d6b2578d24b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.638919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7934-df5e-40f8-a14c-d6b2578d24b0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.640698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 540/1087] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:12.647594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.648004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.648111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.665605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:12.666760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:12.674232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 548/1088] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:12.698256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7934-df5e-40f8-a14c-d6b2578d24b0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:12.710574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7934-df5e-40f8-a14c-d6b2578d24b0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:12.715772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:12.716535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.716863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.717132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.727080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:12.733709 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:12.734822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 541/1089] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:12.741230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:12.749765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdce16f-518b-4201-b4c3-53a69fbce918 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:12.754166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:12.754790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.755063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.755332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.756069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:12.756406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:12.757992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:12.766275 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 549/1090] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:12.772218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:12.782555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddba7-e0f3-43a6-9553-540bbd5d62ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:12.786902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:12.787705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.787980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.788251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] PATH_INFO: `/v3/users/9c2be4fd922242e1a93a8ca2d8314928` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.789446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c2be4fd922242e1a93a8ca2d8314928)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:12.791514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:12.793085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 542/1091] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:12 2021] GET /identity/v3/users/9c2be4fd922242e1a93a8ca2d8314928 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:12.798727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:12.807893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8734b-5dad-4d94-91f0-310ca85f0f69 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:12.812923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:12.813739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.814016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.814287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] PATH_INFO: `/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.815446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] RBAC: Authorizing `identity:get_project(project_id=54d0dbcc34cd41e7842b0425cd547f9b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:12.817475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34dd4a-e0e3-4b31-9d4c-6a6b29e1a240 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:12.819352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 550/1092] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:12 2021] GET /identity/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:12.826038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:12.835326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2263dc-102e-48d7-ac51-36187c1a7568 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:12.839703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:12.840545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:12.840851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:12.841120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] PATH_INFO: `/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b/users/9c2be4fd922242e1a93a8ca2d8314928/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:12.843036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d0dbcc34cd41e7842b0425cd547f9b, user_id=9c2be4fd922242e1a93a8ca2d8314928, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:12.845621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44fe3-90f6-403b-8672-d000df2eef17 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:12.858171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 543/1093] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:44:12 2021] PUT /identity/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b/users/9c2be4fd922242e1a93a8ca2d8314928/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:44:15.146355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de341-918a-4978-823b-63d0d1309b1a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.146842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de341-918a-4978-823b-63d0d1309b1a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.146966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de341-918a-4978-823b-63d0d1309b1a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.148661 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 551/1094] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:15.156330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.156789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.156918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.174484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:15.175653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:15.231316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 544/1095] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:15.256700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de341-918a-4978-823b-63d0d1309b1a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.268516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de341-918a-4978-823b-63d0d1309b1a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.273100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.273868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.274148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.274420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.284808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:15.291387 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:15.292511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 552/1096] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:15.299376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.308060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecc88-e274-44de-910e-ec05b8149150 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.312583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.313262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.313540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.313809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.314557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:15.314884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:15.316458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:15.324817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 545/1097] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:15.330655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.340881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef6245-8f1a-430e-a946-38c1c03141b6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.345316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.346118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.346392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.346661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] PATH_INFO: `/v3/users/9c2be4fd922242e1a93a8ca2d8314928` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.347853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c2be4fd922242e1a93a8ca2d8314928)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:15.349962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:15.351617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 553/1098] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/users/9c2be4fd922242e1a93a8ca2d8314928 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:15.357780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.366829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a059ad-21f9-4294-aa99-bab865b27666 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.371628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.372222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.372500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.372806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.380304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:15.382022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:15.391525 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 546/1099] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:15.397223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.406820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833e161-c03b-4cf0-bad8-638d7c145a04 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.411211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.411989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.412268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.412537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] PATH_INFO: `/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.413717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=54d0dbcc34cd41e7842b0425cd547f9b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:15.415651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e921f-99a4-4664-a2c5-4715dcca93f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:15.417276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 554/1100] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:15.423349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:15.431537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d194b-8107-480f-97b0-a5b632e22e15 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:15.436095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:15.436713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:15.436993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:15.437265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:15.438068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b, user.id=9c2be4fd922242e1a93a8ca2d8314928) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:15.438372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:15.440106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ee0f3-28cf-4b0e-8256-3cf05d4375e3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:15.445857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 547/1101] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:44:15 2021] GET /identity/v3/role_assignments?user.id=9c2be4fd922242e1a93a8ca2d8314928&scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:44:17.767233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca18a7-0316-437e-a9dc-2a0c695ea5f0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:17.767798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca18a7-0316-437e-a9dc-2a0c695ea5f0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:17.767798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca18a7-0316-437e-a9dc-2a0c695ea5f0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:17.769709 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 555/1102] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:17.776703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:17.777140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:17.777233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:17.794920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:17.796075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:17.803782 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 548/1103] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:44:17.828782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca18a7-0316-437e-a9dc-2a0c695ea5f0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:17.840663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca18a7-0316-437e-a9dc-2a0c695ea5f0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:17.845138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:17.845771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:17.846052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:17.846325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:17.853922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:17.856194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:17.864798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 556/1104] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:17.871780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:17.880548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93a0f-fa92-438d-b287-5947ca29baf8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:17.885029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:17.885794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:17.886070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:17.886340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:17.893519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:17.896320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:17.910440 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-44681d29-b964-41a2-bedb-cd26ee457afc admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 10 03:44:17.911575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 549/1105] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:44:17 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:17.918611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:17.927179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a40e8-8ddc-4fa2-a453-313b16558ffb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:17.931641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:17.932263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:17.932535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:17.932834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:17.934134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:17.934434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:17.935965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ac12e-5d13-45ed-8a9f-2a34fff914d2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:17.942830 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 557/1106] 10.222.0.13 () {56 vars in 1136 bytes} [Wed Nov 10 03:44:17 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:20.253178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc028d-a31e-4d66-90ee-c0a691d2d85b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:20.253708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc028d-a31e-4d66-90ee-c0a691d2d85b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:20.253708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc028d-a31e-4d66-90ee-c0a691d2d85b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:20.255506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 550/1107] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:20.262673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85bf1-b3b9-4be6-a2eb-ff6f87a7493a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:20.263040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85bf1-b3b9-4be6-a2eb-ff6f87a7493a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:20.263224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85bf1-b3b9-4be6-a2eb-ff6f87a7493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:20.280852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3de85bf1-b3b9-4be6-a2eb-ff6f87a7493a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:20.282022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3de85bf1-b3b9-4be6-a2eb-ff6f87a7493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:20.289540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 558/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:20.314733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc028d-a31e-4d66-90ee-c0a691d2d85b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:20.327493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc028d-a31e-4d66-90ee-c0a691d2d85b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:20.331816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:20.332438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:20.332753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:20.333031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:20.333771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:20.334772 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:44:20.334772 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:44:20.334772 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:44:20.335634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406fdec-a338-48ef-b24c-f7cc810098b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:20.350679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 551/1109] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Nov 10 03:44:20 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:44:22.673334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd327b-b15e-4d4d-8b43-0dc246fb58ca None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:22.673859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd327b-b15e-4d4d-8b43-0dc246fb58ca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:22.673859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd327b-b15e-4d4d-8b43-0dc246fb58ca None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:22.675617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 559/1110] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:22.682621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:22.683055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:22.683682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:22.701455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:22.702618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:22.756406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 552/1111] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:22.782488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd327b-b15e-4d4d-8b43-0dc246fb58ca None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:22.794085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd327b-b15e-4d4d-8b43-0dc246fb58ca None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:22.798289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:22.799169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:22.799442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:22.799714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] PATH_INFO: `/v3/domains/73a580d3ae2c43e3856c1f7b907e5078` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:22.810224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=73a580d3ae2c43e3856c1f7b907e5078)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:22.812114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41ec4d-1260-486a-bf21-3cca3c7ea653 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:22.813739 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 560/1112] 10.222.0.13 () {56 vars in 1204 bytes} [Wed Nov 10 03:44:22 2021] GET /identity/v3/domains/73a580d3ae2c43e3856c1f7b907e5078 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:22.820211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:22.829674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca01086-23b9-4cac-846b-bc5ed56ed71e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:22.834022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:22.834649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:22.834921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:22.835188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:22.835904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:22.837806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cc98-0991-4c6c-9425-fc6d28172d2e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:22.861564 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 553/1113] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:44:22 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:44:25.177226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc86c-2ab5-41a6-a0d8-3c8f5f594c39 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:25.177745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc86c-2ab5-41a6-a0d8-3c8f5f594c39 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:25.177745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc86c-2ab5-41a6-a0d8-3c8f5f594c39 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:25.179562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 561/1114] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:25.186694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:25.187089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:25.187241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:25.205093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:25.206246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:25.259085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:25.287250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc86c-2ab5-41a6-a0d8-3c8f5f594c39 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:25.298990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc86c-2ab5-41a6-a0d8-3c8f5f594c39 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:25.303241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:25.304051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:25.304325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:25.304590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] PATH_INFO: `/v3/domains/73a580d3ae2c43e3856c1f7b907e5078` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:25.305849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=73a580d3ae2c43e3856c1f7b907e5078)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:25.307750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ffc43-289e-4db0-b251-fed8450a667b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:25.309526 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 562/1116] 10.222.0.13 () {56 vars in 1204 bytes} [Wed Nov 10 03:44:25 2021] GET /identity/v3/domains/73a580d3ae2c43e3856c1f7b907e5078 => generated 267 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:25.315169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:25.324402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46358be9-13dc-4fd9-8012-4bce94705a53 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:25.328805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:25.329433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:25.329707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:25.329976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:25.330672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:25.332509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476889-aae2-4b40-9e33-966f8e17ae91 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:25.352410 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 555/1117] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:44:25 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:44:27.665824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d2a9-0d8e-4c6d-b05a-88b6058c2479 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.666414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d2a9-0d8e-4c6d-b05a-88b6058c2479 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.666414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d2a9-0d8e-4c6d-b05a-88b6058c2479 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.668619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 563/1118] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:27.675540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.675941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.676083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.693877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:27.695034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:27.702468 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 556/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:27.727193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2d2a9-0d8e-4c6d-b05a-88b6058c2479 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.739276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2d2a9-0d8e-4c6d-b05a-88b6058c2479 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.743584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.744325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.744595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.744889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.755432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:27.762056 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:27.763188 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 564/1120] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:44:27.769268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.778317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83058a7-7619-42ed-8721-92e1bb29483e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.782732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.783358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.783630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.783895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.784663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:27.784962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:27.786512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:27.794844 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 557/1121] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:27.801143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.810549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09add276-ba8d-447b-85e7-7613f600555c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.815004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.815829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.816108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.816379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] PATH_INFO: `/v3/users/3e9f7cf1745a417f8db88279a5c289fb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.829979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] RBAC: Authorizing `identity:get_user(user_id=3e9f7cf1745a417f8db88279a5c289fb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:27.832075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:27.833749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 565/1122] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/users/3e9f7cf1745a417f8db88279a5c289fb => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:27.840458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.849906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aca-ef9c-4d49-81ec-3e8ade328098 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.854355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.855634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.855909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.856177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.863667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:27.865430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:27.874023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:27.880122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.889208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f84ec-0834-4b9d-b6f8-18b8235ac62e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.893602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.894412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.894684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.894951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] PATH_INFO: `/v3/projects/f19eadbdc460491091ca3c38231c2873` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.896348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] RBAC: Authorizing `identity:get_project(project_id=f19eadbdc460491091ca3c38231c2873)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:27.898478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f7c19-17fa-48b9-bc8a-38582d7c5689 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:27.900170 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 566/1124] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/projects/f19eadbdc460491091ca3c38231c2873 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:27.906972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:27.915612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1273d-7196-41d3-871f-faa8ebd0206c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:27.920833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:27.921398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:27.921674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:27.921945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:27.922763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=f19eadbdc460491091ca3c38231c2873, user.id=3e9f7cf1745a417f8db88279a5c289fb) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:27.923073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:27.924876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66551c-e0ba-491b-ada1-d62efef69ed7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:27.930055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 559/1125] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:44:27 2021] GET /identity/v3/role_assignments?user.id=3e9f7cf1745a417f8db88279a5c289fb&scope.project.id=f19eadbdc460491091ca3c38231c2873&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:30.181364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c94c-cd73-471a-b4a7-fd2c31aa60bf None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.181892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c94c-cd73-471a-b4a7-fd2c31aa60bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.181892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c94c-cd73-471a-b4a7-fd2c31aa60bf None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.183658 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 567/1126] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:30.190829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.191221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.191385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.208834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:30.210009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:30.218199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 560/1127] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:30.243063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725c94c-cd73-471a-b4a7-fd2c31aa60bf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:30.255259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725c94c-cd73-471a-b4a7-fd2c31aa60bf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:30.259500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:30.260256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.260530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.260826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.270522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:30.277624 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:30.282776 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 568/1128] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:30.289491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:30.298935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ece98-00f2-487b-a172-236cd6f74e63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:30.303423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:30.304063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.304344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.304643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.305396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:30.305699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:30.307269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:30.315284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 561/1129] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:30.321467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:30.332130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6084-8723-4889-bd76-756a61150102 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:30.336548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:30.337410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.337683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.337949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] PATH_INFO: `/v3/users/3e9f7cf1745a417f8db88279a5c289fb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.339615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] RBAC: Authorizing `identity:get_user(user_id=3e9f7cf1745a417f8db88279a5c289fb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:30.341714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:30.343254 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 569/1130] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:30 2021] GET /identity/v3/users/3e9f7cf1745a417f8db88279a5c289fb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:30.349065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:30.358862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9800c-d09f-4f69-ad4b-b10c538c4b90 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:30.363419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:30.364233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.364513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.364818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] PATH_INFO: `/v3/projects/f19eadbdc460491091ca3c38231c2873` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.365986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] RBAC: Authorizing `identity:get_project(project_id=f19eadbdc460491091ca3c38231c2873)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:30.367962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998047e-f6bf-44b0-8cdf-a37481804007 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:30.369604 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 562/1131] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:30 2021] GET /identity/v3/projects/f19eadbdc460491091ca3c38231c2873 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:30.375428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:30.384334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e801d-230c-4a18-90d1-7e80245320ef admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:30.389259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:30.390082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:30.390353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:30.390619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] PATH_INFO: `/v3/projects/f19eadbdc460491091ca3c38231c2873/users/3e9f7cf1745a417f8db88279a5c289fb/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:30.392501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19eadbdc460491091ca3c38231c2873, user_id=3e9f7cf1745a417f8db88279a5c289fb, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:30.395039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35e47-3c4b-46a4-82d2-73e21dff1ce5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:30.407752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 570/1132] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:44:30 2021] PUT /identity/v3/projects/f19eadbdc460491091ca3c38231c2873/users/3e9f7cf1745a417f8db88279a5c289fb/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:44:32.656699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc225-c3e3-4b75-9645-193bafe68025 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.657250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc225-c3e3-4b75-9645-193bafe68025 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.657250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc225-c3e3-4b75-9645-193bafe68025 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.659016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 563/1133] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:44:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:44:32.665903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.666289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.666440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.683260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:44:32.684415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:44:32.738197 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 571/1134] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:44:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:44:32.763584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddc225-c3e3-4b75-9645-193bafe68025 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.775360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddc225-c3e3-4b75-9645-193bafe68025 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.780274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.781065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.781343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.781610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.791383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:44:32.798091 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:44:32.799202 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 564/1135] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:44:32.805523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.814234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235fb1-6afd-42f6-9df9-9f6196f21226 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.818878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.819518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.819789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.820057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.820834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:32.821134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:32.822685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:32.831248 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 572/1136] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:32.837269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.848086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f28ea-8333-4148-9b65-fa9c45008dbb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.852559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.853412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.853689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.853961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] PATH_INFO: `/v3/users/3e9f7cf1745a417f8db88279a5c289fb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.855129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e9f7cf1745a417f8db88279a5c289fb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:32.857457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:32.859134 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 565/1137] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/users/3e9f7cf1745a417f8db88279a5c289fb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:32.865325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.874669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f1bd-6d6e-44c4-bdac-336ffc9e85b8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.879120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.879729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.880003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.880269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.888128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:32.889827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:32.898358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 573/1138] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:44:32.904891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.914146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f7c-2ec4-4ddc-ad90-57f308450d04 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.919047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.919931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.920219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.920489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] PATH_INFO: `/v3/projects/f19eadbdc460491091ca3c38231c2873` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.921915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] RBAC: Authorizing `identity:get_project(project_id=f19eadbdc460491091ca3c38231c2873)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:32.924079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7759b8-0740-471d-bb79-e26252be1728 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:32.925774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 566/1139] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/projects/f19eadbdc460491091ca3c38231c2873 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:44:32.931996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:44:32.940513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e759-490a-4eb7-8ff4-69766e4ea0ab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:44:32.945276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:44:32.945891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:44:32.946170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:44:32.946476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:44:32.947293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=f19eadbdc460491091ca3c38231c2873, user.id=3e9f7cf1745a417f8db88279a5c289fb) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:44:32.947592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:44:32.949891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af0f4f-8895-4dd5-8a63-d0dd372c3ef7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:44:32.955307 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 574/1140] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:44:32 2021] GET /identity/v3/role_assignments?user.id=3e9f7cf1745a417f8db88279a5c289fb&scope.project.id=f19eadbdc460491091ca3c38231c2873&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:29.489296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f002b-0333-4838-adfd-32e3c04556bd None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:29.489901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f002b-0333-4838-adfd-32e3c04556bd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:29.489901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f002b-0333-4838-adfd-32e3c04556bd None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:29.491979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 567/1141] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:29.500159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:29.500682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:29.500771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:29.519236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:29.520430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:29.528645 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 575/1142] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:29.556065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f002b-0333-4838-adfd-32e3c04556bd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:29.569646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f002b-0333-4838-adfd-32e3c04556bd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:29.576860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:29.577646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:29.577965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:29.578366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:29.595885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:29.597786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:29.615560 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:29.616808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 568/1143] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:29.626611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:29.633517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccfe58-8b10-4fe5-b69c-6e6b77ab2e8c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:29.639123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:29.639853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:29.640199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:29.640564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:29.641375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:29.641744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:29.643392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ddf8d-11c8-444f-953e-93fe7570f3c7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:29.661907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 576/1144] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:29.662713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:29.681171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be2da-5011-433b-9741-c6fa6cdeebd9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:29.688003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:29.688708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:29.689007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:29.689294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:29.689995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:29.691946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cccb0c-183d-47e2-9e59-9fdc9fa3bcfc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:29.720651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 569/1145] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 10 03:45:29 2021] POST /identity/v3/users => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:45:32.124082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389e14-0ad1-491b-93a2-c6758e33b52d None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.124637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389e14-0ad1-491b-93a2-c6758e33b52d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.124637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389e14-0ad1-491b-93a2-c6758e33b52d None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.126860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 577/1146] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:45:32.134119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.135812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.135812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.153022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:32.154214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:32.162104 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 570/1147] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:45:32.189154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68389e14-0ad1-491b-93a2-c6758e33b52d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.202161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68389e14-0ad1-491b-93a2-c6758e33b52d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.207084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.208066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.208373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.208711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.220877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:32.228210 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:45:32.229469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 578/1148] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:32.236139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.245802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6506cf-a492-435a-a3e6-129b623a14bf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.250546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.251206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.251478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.251746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.252496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.252818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.254441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.263749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 571/1149] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:32.270393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.281423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f41d-d96a-48ad-9cd5-093cf90a65fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.287027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.287858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.288191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.288488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.300079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.302205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.321190 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:32.322390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 579/1150] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:32.329258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.340006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127736-9de6-4017-8cc1-3d0af66a687b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.345105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.345791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.346161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.346343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.347078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.347376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.351237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.363090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 572/1151] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:32.370137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.383543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417403ce-2436-44d8-acfc-8f4076d83172 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.389435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.391096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.391096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.391096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.400280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.402537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.418441 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:32.424650 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 580/1152] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:32.427900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.438469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528202-9e27-4d12-a16a-bb94804275a4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.447456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.448163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.448460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.448761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.449617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.449922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.451737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.482543 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 573/1153] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:32.491059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.503418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ea8f-7901-4546-8f9a-aa3e064aca7a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.508697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.509419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.509798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.509930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.518392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.520220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.534961 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 581/1154] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:45:32.536546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.548144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eadfad-d6f3-4bd1-814b-e7ebdd5dd945 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.553068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.553956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.554350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.554718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.567872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.568904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.587637 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:32.588959 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 574/1155] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:32.599825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.607810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aca9d0-a6df-4056-b11f-b90e39fcc258 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.612953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.613644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.614668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.614668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.615045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.615359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.617021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.631172 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 582/1156] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:32.638206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.650070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d862-015f-4f22-81d7-6c3a3a077c9d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.654951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.655738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.655998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.656273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.666770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.668971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.682725 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:32.684175 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 575/1157] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:32.691699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.702942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf497-82fd-4380-b88c-b50654943bb5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.707758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.708260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.708781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.708876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.709599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.709902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.712250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21126d3-8af5-4932-8a54-becca0c7100e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.725184 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 583/1158] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:32.731794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:32.743045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc474a-ca6b-449e-8791-4c444ab18452 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:32.747769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:32.748418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:32.748726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:32.748983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:32.749819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=a4345bdda5c3489084a72f2bb5f18707) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:32.750121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:32.751932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4981-9559-450a-bea5-373e467de77d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:32.757866 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 576/1159] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:45:32 2021] GET /identity/v3/role_assignments?user.id=a4345bdda5c3489084a72f2bb5f18707&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.096300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e18-01d6-4eb0-b394-75c94af55426 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.096843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e18-01d6-4eb0-b394-75c94af55426 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.097065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e18-01d6-4eb0-b394-75c94af55426 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.099277 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 584/1160] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:35.107403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.107897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.107976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.126603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:35.128022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:35.137931 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 577/1161] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:35.163258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347e18-01d6-4eb0-b394-75c94af55426 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.179814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347e18-01d6-4eb0-b394-75c94af55426 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.185607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.186403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.186678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.186944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.197517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:35.204163 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:45:35.205390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 585/1162] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:35.212591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.225057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0026806-ebaf-4328-b5c9-efc7d31f7c63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.231428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.232093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.232408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.232707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.233682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] RBAC: Adding query filter params (name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:35.234120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.235693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.244594 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 578/1163] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.250770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.260774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43377-f30e-4479-a8aa-1cf651e54a48 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.266314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.267386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.267869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.268309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.282261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.284924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.307032 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:35.314061 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 586/1164] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:35.315271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.325362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a14d4-44c3-4de5-b25d-0e6f6a99b7ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.329954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.330700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.331070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.331436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.332339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:35.332781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.334436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.347444 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 579/1165] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.354365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.366805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b4a7b-56c5-4c5f-8ac5-c8b8214de522 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.373198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.374568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.375129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.375575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.388319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.391246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.412172 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:35.414013 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 587/1166] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:35.421654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.437768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95fec5-58d8-4e04-b791-d4666d966e75 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.443916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.444830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.445179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.445532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.446508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:35.446886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.450016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.480362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 580/1167] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.488223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.500388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6112f03-0478-4f28-8e09-1f17550339c6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.506783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.507634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.508267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.508549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.524736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.526955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.547235 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:35.548714 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 588/1168] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:45:35.555448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.565544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662a3-00fa-49a5-b50b-18822f88f46b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.570825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.571641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.572019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.572390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.573315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:35.573761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.575593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.588578 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 581/1169] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.595060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.605419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443b88-27b2-4f8a-bf41-dde7a95dd57a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.609764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.610525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.610799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.611065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.618938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.619556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.633341 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:35.640943 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 589/1170] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:35.642478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.655028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf08d-fd74-4be5-8584-380f4c6cb257 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.664647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.664647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.664647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.664647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.664978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:35.664978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.665504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699c475-c586-4bb2-adc1-d6273e4b025c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.678380 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 582/1171] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:35.685053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:35.700831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f386-2e91-4c96-b2e7-2835bf21149f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:35.706148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:35.707068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:35.707351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:35.707621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/a4345bdda5c3489084a72f2bb5f18707/roles/7153f6ab83a145ab918834fbe9b0e244` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:35.723680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=a4345bdda5c3489084a72f2bb5f18707, role_id=7153f6ab83a145ab918834fbe9b0e244)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:35.726327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a4d99-ecb4-4eac-b7e5-17ca37d45524 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:35.740436 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 590/1172] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:45:35 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/a4345bdda5c3489084a72f2bb5f18707/roles/7153f6ab83a145ab918834fbe9b0e244 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:45:38.136344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a65885-bd26-46b6-8267-bdedab094cdd None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.136890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a65885-bd26-46b6-8267-bdedab094cdd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.136998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a65885-bd26-46b6-8267-bdedab094cdd None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.138696 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 583/1173] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:38.146171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.146632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.146727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.165408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:38.166608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:38.225088 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 591/1174] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:45:38.251118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a65885-bd26-46b6-8267-bdedab094cdd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.264654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a65885-bd26-46b6-8267-bdedab094cdd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.269174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.269957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.270237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.270505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.281593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:38.288429 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 03:45:38.289627 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 584/1175] 10.222.0.13 () {56 vars in 1123 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:45:38.296373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.305768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b80ad-1f07-4f6b-a201-356538f7f9cd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.310425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.311196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.311447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.311715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.312487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] RBAC: Adding query filter params (name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.312803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.314359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.322795 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 592/1176] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:38.328959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.339467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad89e8-74cf-41fa-9d6c-34d22a92d29c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.344171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.344976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.345274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.345524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.356175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.358002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.374687 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:38.375848 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 585/1177] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:38.382302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.392087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167538-cc13-4675-9a3e-2e14787ecffe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.396770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.397394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.397669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.397941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.398672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.399552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.401146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.413388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 593/1178] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:38.420391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.430497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1f08-a4c9-46a1-abc1-d7071b11fa7b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.435378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.436160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.436438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.436741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.444459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.446522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.460469 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:38.462180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 586/1179] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:38.468850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.479800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82d7e1-fe76-4b6f-aa5f-8293d4afd4af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.485037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.485685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.485959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.486224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.487061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.487365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.489226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.507117 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 594/1180] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:38.514137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.523800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212805-9e74-449f-954b-1d1b1b022219 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.529683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.530317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.530591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.530857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.538773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.541126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.550033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 587/1181] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:45:38.557186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.566528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c81a7b-e7c6-416d-bddc-0a10f28b7351 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.571372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.572112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.572387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.572687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.583050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.584864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.601798 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:38.603557 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 595/1182] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:38.610596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.619522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba5c0-c50b-44db-b1fe-1d25f3bea114 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.624408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.625107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.625374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.625637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.626365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.626673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.628226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.640438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 588/1183] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:38.646866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.656950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f77b-816f-4e36-8b9c-ea98711b2af6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.661564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.662333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.663708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.663708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.669534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.671441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.683865 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:38.685032 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 596/1184] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:45:38.691769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.704772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215363-2a1f-46b9-9db9-9baf59c292ce admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.709957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.710614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.710898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.711147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.712501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.712842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.714683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05916d-ac34-4fd1-970f-9779dd70cc37 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.726456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 589/1185] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:38.733946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:38.744489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6071-33be-460e-bc5c-d57af47f8f15 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:38.749375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:38.750003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:38.750352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:38.750557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:38.751370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] RBAC: Adding query filter params (role.id=7153f6ab83a145ab918834fbe9b0e244, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=a4345bdda5c3489084a72f2bb5f18707) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:38.751671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:38.753505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0aa87-8225-46c2-9c96-4afdd6268ff8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:38.759711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 597/1186] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:45:38 2021] GET /identity/v3/role_assignments?user.id=a4345bdda5c3489084a72f2bb5f18707&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=7153f6ab83a145ab918834fbe9b0e244 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:41.278142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409becf-59ba-4d08-a258-10f411b77941 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.278799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409becf-59ba-4d08-a258-10f411b77941 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.278799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409becf-59ba-4d08-a258-10f411b77941 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.280467 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 590/1187] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:41.289068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.290218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.290218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.307883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:41.309098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:41.316853 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 598/1188] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:41.345888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409becf-59ba-4d08-a258-10f411b77941 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.359674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409becf-59ba-4d08-a258-10f411b77941 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.364921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.365976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.366370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.366675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.379289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:41.387570 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:45:41.389346 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 591/1189] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:41.396884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.407954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657be6-ed0e-4e6a-be3f-a880b28147cb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.414020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.415313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.415705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.416156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.417188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.417491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.419286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.428595 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 599/1190] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:41.436372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.450057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c906a-783c-4a6e-8698-541dd85a861e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.455752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.456675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.457058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.457327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.469618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.471430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.498905 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:41.500557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 592/1191] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:45:41.506990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.518719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19608-1578-4051-b84d-82b40090e60f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.527705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.529259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.529506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.530124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.531127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.531599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.533903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.547773 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 600/1192] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:41.554374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.564635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e88eb1-5a98-4548-a8d3-7f1b17e351a0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.569706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.570489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.570787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.571059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.578674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.580675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.594874 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:41.596180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 593/1193] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:41.603099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.612831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecdf3d-ac95-4e67-8f2a-077445315151 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.617402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.618075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.618355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.618627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.619467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.619771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.621627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.640321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 601/1194] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:41.647010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.659303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf712-2951-4bee-920b-7c27dd005fcd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.665074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.665907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.666257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.666593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.675317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.677283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.688454 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 594/1195] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:45:41.695225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.705626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b833d-bf59-4eee-b091-395570826ec1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.710372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.711131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.712013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.712283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.723890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.725761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.744070 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:41.745308 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 602/1196] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:45:41.751751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.761671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cb43-3a49-4a1d-9819-4fb83b032e47 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.766388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.767026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.767305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.767573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.768294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.768592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.770193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.782590 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 595/1197] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:41.789009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.799255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1c42-c873-4f58-a83f-233b2d1a7523 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.807202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.808122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.808488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.808843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.817185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.819811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.834828 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:41.836025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 603/1198] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:41.843265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.853001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53af31-1fd0-44a8-b331-7f6b065849c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.857718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.858365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.858642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.858894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.859671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.859972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.862681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46fec2-40c8-4545-890c-0ad1ac65df5e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.874926 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 596/1199] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:41.882703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:41.893676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff87c9-f713-45f9-8bad-daace5150190 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:41.898492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:41.899691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:41.899975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:41.900241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:41.901111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=a4345bdda5c3489084a72f2bb5f18707) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:41.901417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:41.903214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3bc1a-bf35-4a45-b653-b4820af56a97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:41.909129 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 604/1200] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:45:41 2021] GET /identity/v3/role_assignments?user.id=a4345bdda5c3489084a72f2bb5f18707&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:44.354902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410df0-5e13-4ec0-9834-17e3bdd97d91 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.355741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410df0-5e13-4ec0-9834-17e3bdd97d91 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.355741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410df0-5e13-4ec0-9834-17e3bdd97d91 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.357238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 597/1201] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:44.364591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.365054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.365173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.382817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:44.384025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:44.396631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 605/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:44.418710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410df0-5e13-4ec0-9834-17e3bdd97d91 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.432576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410df0-5e13-4ec0-9834-17e3bdd97d91 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.438598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.439607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.439993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.440377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.460589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:44.478772 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:45:44.484714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 598/1203] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:44.488908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.498150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520f25-10e0-4ce2-98c3-90b4d4439574 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.503423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.503987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.504264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.504538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.505321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:44.505659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.507212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.515947 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 606/1204] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:44.522605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.533291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867461-1ffa-4424-92aa-4e8d0a7e0d52 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.538083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.538869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.539131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.539951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.551136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.553021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.569387 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:44.570524 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 599/1205] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:44.577135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.587091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605e976-61e3-4326-ae57-f1406fb1e70d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.591879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.592617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.593032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.593309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.594066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:44.594335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.595921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.608525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 607/1206] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:44.614861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.624511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5099dd-f360-4bf1-8d23-c3dfdd10cfe3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.629670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.630471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.630763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.631042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.639873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.641956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.656111 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:44.657263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 600/1207] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:44.663734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.673550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60b1d-1c5b-4eb7-bbf2-b7644425034c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.678262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.678920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.679200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.679476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.680342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:44.680670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.682506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.703023 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 608/1208] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:44.709638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.720525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807f49-4d96-4006-983f-004a7dac6339 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.725593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.726352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.726643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.726927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.737927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.739699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.756113 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:44.757326 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 601/1209] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:44.764575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.775235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228258-6fca-4bd6-b97b-89ad366cfae2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.780261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.780945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.781220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.781490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.782221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:44.782520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.784077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.797830 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 609/1210] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:44.804158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.815389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fcc3b-d197-4668-ba0e-612d68949671 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.820223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.821550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.821831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.822099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.829481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.831585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.846398 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:44.847568 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 602/1211] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:44.854253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.863943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044009-895a-4bc3-a6d1-5de4df956f25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.868658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.869316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.869597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.869873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.870714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:44.871023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.872853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522518-afd9-4e93-b46e-fedf8ee9a92f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.886481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 610/1212] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:44.893189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:44.903651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783e59-5e19-4ba2-aeea-8d8bb5bb2d17 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:44.908206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:44.909094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:44.909380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:44.909645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] PATH_INFO: `/v3/projects/965b7da990b947c19ba74a09cc22832f/users/a4345bdda5c3489084a72f2bb5f18707/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:44.911732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b7da990b947c19ba74a09cc22832f, user_id=a4345bdda5c3489084a72f2bb5f18707, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:44.914380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f90b2-6de6-4e65-902a-d7aefeada681 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:44.928976 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 603/1213] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 03:45:44 2021] PUT /identity/v3/projects/965b7da990b947c19ba74a09cc22832f/users/a4345bdda5c3489084a72f2bb5f18707/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:45:47.257560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988820-ae6d-45ba-9288-97c7162684d9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.258615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988820-ae6d-45ba-9288-97c7162684d9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.258615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988820-ae6d-45ba-9288-97c7162684d9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.260405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 611/1214] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:47.267331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.267704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.267883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.285728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:47.286907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:47.341435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 604/1215] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:47.366758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988820-ae6d-45ba-9288-97c7162684d9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.378916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988820-ae6d-45ba-9288-97c7162684d9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.383699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.384452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.384757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.385019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.394599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:45:47.401383 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 03:45:47.402486 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 612/1216] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:47.408532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.417233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d756eb-9992-4628-af6b-b7e692e329bd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.421682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.422321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.422600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.422875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.423629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.423932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.425542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.434022 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 605/1217] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:47.439747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.449660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255501-1e65-486b-98a6-a00171443c1c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.454005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.454730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.455002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.455271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.468445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.470933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.488903 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:47.490370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 613/1218] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:47.499128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.511268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8f0f-5536-423f-ac04-4db5894b0616 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.517170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.517974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.518377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.518654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.519511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.519856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.522222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.537078 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 606/1219] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:45:47.544258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.554515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b87e8-5e19-48f8-9017-3273b203a687 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.559502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.560271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.560548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.560876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.568783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.571295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.584122 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 03:45:47.585258 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 614/1220] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:47.591414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.600738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47009f9-7734-483a-a0e9-f59cc9f90066 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.605156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.605785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.606060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.606327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.607148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.607446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.609275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.626046 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 607/1221] 10.222.0.13 () {56 vars in 1164 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:47.631963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.641700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d0ba-fdf3-4c37-bffb-e1299aabca8f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.646082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.646688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.646961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.647228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.654613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.656293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.665324 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 615/1222] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:45:47.671330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.681152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d811-c898-4a6c-a61f-5825155e7ea6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.685530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.686271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.686546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.686813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.696823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.698583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.714706 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 03:45:47.715784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 608/1223] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:47.721602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.730518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7723c1d-ab7a-48a2-9918-77bff33a7cd2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.734938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.735563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.735838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.736109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.736855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.737155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.738692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.750577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 616/1224] 10.222.0.13 () {56 vars in 1130 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:47.756297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.765668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942585-a630-4d33-a161-62fdfa41ac06 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.770036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.770776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.771052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.771321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.777875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.779768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.792645 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 03:45:47.794093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 609/1225] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:47.800082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.809877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245079-089e-43e4-8d0c-ba6a1e6865fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.814433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.815060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.815336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.815604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.816388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.816728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.818779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b3b74-fc4b-4f28-b2dd-b2487050e791 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.829925 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 617/1226] 10.222.0.13 () {56 vars in 1169 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:47.836326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:47.847325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a7d5a-23c6-4254-b296-6699feefaab0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:47.852300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:47.852950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:47.853229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:47.853503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:47.854334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] RBAC: Adding query filter params (role.id=a31f542edf7f4f97b0d346bcaa39858b, scope.project.id=965b7da990b947c19ba74a09cc22832f, user.id=a4345bdda5c3489084a72f2bb5f18707) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:47.854638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:47.856413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6628c6-fd9b-4bdd-b130-052049b8b91b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:47.862006 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 610/1227] 10.222.0.13 () {56 vars in 1395 bytes} [Wed Nov 10 03:45:47 2021] GET /identity/v3/role_assignments?user.id=a4345bdda5c3489084a72f2bb5f18707&scope.project.id=965b7da990b947c19ba74a09cc22832f&role.id=a31f542edf7f4f97b0d346bcaa39858b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:50.194606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3640d7-f868-4187-8ff6-304a71684dd4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:50.195112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3640d7-f868-4187-8ff6-304a71684dd4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:50.195204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3640d7-f868-4187-8ff6-304a71684dd4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:50.197591 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 618/1228] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:50.204540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:50.204976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:50.205136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:50.223689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:50.224918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:50.232506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 611/1229] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:50.256551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3640d7-f868-4187-8ff6-304a71684dd4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:50.269075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3640d7-f868-4187-8ff6-304a71684dd4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:50.273371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:50.274131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:50.274409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:50.274681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:50.275339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:50.276934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:50.287508 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 03:45:50.288602 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 619/1230] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:45:50 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:50.294682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:50.303264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54b61-6527-4f52-af94-8a3be23264d2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:50.308189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:50.308853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:50.309130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:50.309399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:50.310104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:50.310403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:50.311956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58b08d-a268-4946-bc96-d00fd817ffd2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:50.316510 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 612/1231] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 10 03:45:50 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:50.323231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:50.332289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988439-e2e3-44fa-b7ec-e074e1e2e41c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:50.336726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:50.337338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:50.337616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:50.337889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:50.338580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] RBAC: Adding query filter params (type=placement) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:50.338881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:50.340423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a106-7565-47fa-bf93-25576d3431ff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:50.344658 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 620/1232] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 10 03:45:50 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:52.629031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a146-f5dc-4003-8a38-9523f22d1657 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:52.629612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a146-f5dc-4003-8a38-9523f22d1657 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:52.629612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a146-f5dc-4003-8a38-9523f22d1657 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:52.631339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 613/1233] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:52.638788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169705a9-0407-4b8f-b95d-79b062be9e0a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:52.639161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169705a9-0407-4b8f-b95d-79b062be9e0a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:52.639329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169705a9-0407-4b8f-b95d-79b062be9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:52.656528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-169705a9-0407-4b8f-b95d-79b062be9e0a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:52.657802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-169705a9-0407-4b8f-b95d-79b062be9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:52.665705 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 621/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:52 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:52.690691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7a146-f5dc-4003-8a38-9523f22d1657 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:52.703303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7a146-f5dc-4003-8a38-9523f22d1657 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:52.707694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:52.708321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:52.708594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:52.708889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:52.709608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:52.711169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94bf42-fbfc-4abf-984a-c975d0e1ca57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:52.723223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 614/1235] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Nov 10 03:45:52 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:45:55.024001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccedd-6bd6-4f35-ab6a-28416085ac8c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.025114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccedd-6bd6-4f35-ab6a-28416085ac8c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.025114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccedd-6bd6-4f35-ab6a-28416085ac8c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.026849 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 622/1236] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:45:55.033806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.034199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.034358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.052029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:55.053231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:55.069589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 615/1237] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:55 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:55.094809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ccedd-6bd6-4f35-ab6a-28416085ac8c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:55.107221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ccedd-6bd6-4f35-ab6a-28416085ac8c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:55.111548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:55.112312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.112591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.112899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.113560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:55.115126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:55.125764 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 03:45:55.126861 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 623/1238] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:45:55 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:55.132981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:55.142010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326821f-d1fc-448e-941b-1638d78ca997 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:55.146467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:55.147090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.147366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.147633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.148333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:55.148661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:55.150815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:55.155838 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 616/1239] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 10 03:45:55 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:55.161659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:55.170665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bf5f-5ab4-45e4-89ab-d605ea972420 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:55.175102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:55.175699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.175977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.176252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.177136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] RBAC: Adding query filter params (interface=public, service_id=53ae4761de8849aa905a1734d74e5d27, region_id=RegionOne) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:55.177443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:55.178951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dcc32-125b-49fd-b907-bdf8525513a1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:55.183803 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 624/1240] 10.222.0.13 () {56 vars in 1272 bytes} [Wed Nov 10 03:45:55 2021] GET /identity/v3/endpoints?service_id=53ae4761de8849aa905a1734d74e5d27&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:55.189337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:55.199014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a86-b86b-4da7-b5b3-078bb97d3422 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:55.203401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:55.203996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:55.204271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:55.204541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:55.205233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:55.206721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4529b3-3224-46a7-bf45-2b8da31b0acb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:55.213933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 617/1241] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:45:55 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:45:57.494280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f968-6074-4a80-b31e-851b92762ae9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:57.494843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f968-6074-4a80-b31e-851b92762ae9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:57.494939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f968-6074-4a80-b31e-851b92762ae9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:57.496817 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 625/1242] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:45:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:45:57.504224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:57.504712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:57.504807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:57.522676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:45:57.523852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:45:57.532374 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 618/1243] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:45:57 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:45:57.556794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f968-6074-4a80-b31e-851b92762ae9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:57.568780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f968-6074-4a80-b31e-851b92762ae9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:57.573542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:57.574302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:57.574573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:57.574836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:57.575484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:57.577134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:57.588145 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 03:45:57.589259 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 626/1244] 10.222.0.13 () {56 vars in 1138 bytes} [Wed Nov 10 03:45:57 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 03:45:57.595575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:57.604278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ab75-f798-4158-a62c-9f30cf66f499 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:57.608762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:57.609393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:57.609667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:57.609937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:57.610641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:45:57.610938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:57.612514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623bc1-8285-451e-ad63-b92ff3f30eca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:57.617580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 619/1245] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 10 03:45:57 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:45:57.623221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:45:57.632782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c501-35f7-4153-879b-f1b20532ccd0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:45:57.637647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:45:57.638249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:45:57.638521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:45:57.638789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:45:57.639509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:45:57.641055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d722a0-5a3e-4272-aa5a-6cf30827a40c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:45:57.658471 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 627/1246] 10.222.0.13 () {60 vars in 1165 bytes} [Wed Nov 10 03:45:57 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:47:07.587123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:07.587621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:07.587706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:07.595205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 620/1247] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:07 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:07.596639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744505c-0090-49b5-b3cd-03912e77c0c6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:07.597066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744505c-0090-49b5-b3cd-03912e77c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:07.597280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744505c-0090-49b5-b3cd-03912e77c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:07.717305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d744505c-0090-49b5-b3cd-03912e77c0c6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:07.718413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d744505c-0090-49b5-b3cd-03912e77c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:07.832670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 628/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:07.855070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:07.856901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:07.992393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e51c-3f28-417a-8dd8-6485d8b3d601 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:08.091468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:08.092132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:08.092414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:08.092717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:08.093458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:08.095404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d101-05d6-4970-b5f3-74575b7051f8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:08.114379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 621/1249] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:47:07 2021] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:47:10.506882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b81-289b-4c3b-b262-03884e141875 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:10.507419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b81-289b-4c3b-b262-03884e141875 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:10.507419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b81-289b-4c3b-b262-03884e141875 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:10.509321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 629/1250] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:10.516691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ec23-e371-4fa7-8ba5-4c8531de98d9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:10.517153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ec23-e371-4fa7-8ba5-4c8531de98d9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:10.517231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ec23-e371-4fa7-8ba5-4c8531de98d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:10.590432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-efd6ec23-e371-4fa7-8ba5-4c8531de98d9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:10.591638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-efd6ec23-e371-4fa7-8ba5-4c8531de98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:10.692508 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 622/1251] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:10.745320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:10.745640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:10.745863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:10.747827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 630/1252] 10.222.0.13 () {54 vars in 964 bytes} [Wed Nov 10 03:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:10.754389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e14b-5fee-4f61-9e02-50ab140dcd4b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:10.755754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e14b-5fee-4f61-9e02-50ab140dcd4b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:10.756103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e14b-5fee-4f61-9e02-50ab140dcd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:10.834577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f870e14b-5fee-4f61-9e02-50ab140dcd4b None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:10.836315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f870e14b-5fee-4f61-9e02-50ab140dcd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:10.914608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 623/1253] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Nov 10 03:47:10 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:47:10.923994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:10.925655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:11.027436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0371dc-1d9e-4ecd-ba9f-625744c99973 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:11.097081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:11.097724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:11.098004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:11.098275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:11.100050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:11.203892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:11.205349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436133a8-0bd3-44cd-97f9-3d671b95a64e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:11.223407 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 631/1254] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:13.873119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:13.873632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:13.873632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:13.875434 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 624/1255] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:13.882836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275ba9-bf2a-4c6d-8de4-f3a705d0847f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:13.883250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275ba9-bf2a-4c6d-8de4-f3a705d0847f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:13.883356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275ba9-bf2a-4c6d-8de4-f3a705d0847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:13.945473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-11275ba9-bf2a-4c6d-8de4-f3a705d0847f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:13.946668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-11275ba9-bf2a-4c6d-8de4-f3a705d0847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:14.036987 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 632/1256] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:14.077475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:14.078985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:14.176140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4bd4-90b2-43d8-a255-cd4c301429ff None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:14.245271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:14.245897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:14.246174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:14.246445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:14.248074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:14.348669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:14.350071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b71d-be9a-49e5-a7ea-a7a7ae43dbd1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:14.367353 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 625/1257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:16.990011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:16.990537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:16.990537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:16.992380 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 633/1258] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:16.999512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:16.999919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:17.000061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:17.062891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:17.064069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:17.155917 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 626/1259] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:47:17.192369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:17.194716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:17.312426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705e609-6302-4fd7-8d27-8a3cd3219726 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:17.399285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:17.400101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:17.400377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:17.400680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:17.410003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:17.411949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28855e3f-30b6-4051-b3f1-c8a8b761c2bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:17.414258 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 634/1260] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:47:17 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:47:17.426837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:17.428025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:17.516265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d582-0594-4131-a951-d80dd29c83d1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:17.584316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:17.585498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:17.585776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:17.586049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:17.587666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:17.690047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:17.691383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4cdaf-560b-4741-b761-ababcc289b72 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:17.708971 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 627/1261] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:20.559377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:20.559939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:20.559939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:20.561722 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 635/1262] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:20.568940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0bbb-dfd6-4591-b21d-b195c6d9797d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:20.569367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0bbb-dfd6-4591-b21d-b195c6d9797d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:20.569749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0bbb-dfd6-4591-b21d-b195c6d9797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:20.632717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-098d0bbb-dfd6-4591-b21d-b195c6d9797d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:20.633885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-098d0bbb-dfd6-4591-b21d-b195c6d9797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:20.723875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 628/1263] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:20.760433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:20.761978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:20.887690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565583-c8f0-4228-afc4-a23156ad9405 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:20.974443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:20.975268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:20.975533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:20.975797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:20.984984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:20.986965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f53b5-272f-4088-98f2-43ce067b539d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:20.988647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 636/1264] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:47:20 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:47:21.017729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:21.018012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:21.018283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:21.020063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 629/1265] 10.222.0.13 () {54 vars in 964 bytes} [Wed Nov 10 03:47:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:21.026041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f114-7fd7-4d16-b18a-cb75109c6745 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:21.026322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f114-7fd7-4d16-b18a-cb75109c6745 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:21.026599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f114-7fd7-4d16-b18a-cb75109c6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:21.097127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-16f9f114-7fd7-4d16-b18a-cb75109c6745 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:21.098226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-16f9f114-7fd7-4d16-b18a-cb75109c6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:21.168505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 637/1266] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Nov 10 03:47:21 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:21.177873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:21.179911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:21.277226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c2c5a-e3e8-434c-99e1-9e37a124f8f8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:21.345029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:21.345656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:21.345932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:21.346203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:21.347870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:21.449906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:21.451324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b05200-8bc2-4fe6-8419-ad92d69d9265 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:21.468510 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 630/1267] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:24.911740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:24.912271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:24.912271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:24.914683 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 638/1268] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:24.922551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488294-4674-468e-9715-fbdaa3094047 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:24.923110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488294-4674-468e-9715-fbdaa3094047 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:24.923110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488294-4674-468e-9715-fbdaa3094047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:24.989210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-de488294-4674-468e-9715-fbdaa3094047 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:24.990484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de488294-4674-468e-9715-fbdaa3094047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:25.085157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 631/1269] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:25.124224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:25.125763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:25.223965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6936-b3dc-4eca-aee3-aee4ee5b552c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:25.293492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:25.294127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:25.294399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:25.294667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:25.296305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:25.406048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:25.407466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a97aa-8be0-46c1-86a1-4820afabbf1d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:25.424521 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 639/1270] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:27.818957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:27.819733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:27.819733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:27.821507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 632/1271] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:27.829901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb951a-4c39-40b8-8186-4b7a2e2597a6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:27.830327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb951a-4c39-40b8-8186-4b7a2e2597a6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:27.830462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb951a-4c39-40b8-8186-4b7a2e2597a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:27.893363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ffbb951a-4c39-40b8-8186-4b7a2e2597a6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:27.894561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ffbb951a-4c39-40b8-8186-4b7a2e2597a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:27.988915 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 640/1272] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:28.028143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:28.029715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:28.127920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef23c8-05bd-4db3-b8f8-4bbc5d4734d0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:28.202050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:28.202715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:28.202990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:28.203257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:28.204911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:28.306302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:28.307720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa8bc-5768-4b0c-9590-a97787270d61 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:28.325608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 633/1273] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:30.697267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:30.697890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:30.697890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:30.699850 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 641/1274] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:30.707814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:30.708376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:30.708469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:30.771524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:30.773280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:30.866506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 634/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:30.900876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:30.902380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:31.020100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64e544-2a6a-4fbc-8240-92b86a777d5c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:31.113382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:31.114226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:31.114502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:31.114775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:31.124210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:31.126269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43bed-1ae4-402f-9465-d66e9c26e688 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:31.127968 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 642/1276] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:47:30 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:47:31.140817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:31.142002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:31.229707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682015-a21a-4f8f-aa4b-31fce01506e9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:31.300764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:31.301418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:31.301695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:31.301967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:31.303702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:31.408233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:31.409678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb01b-60e5-40e6-8130-51fcd7bacc01 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:31.426659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 635/1277] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:33.977968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:33.978499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:33.978499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:33.980436 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 643/1278] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:33.987550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fca6b-b1b1-4bff-a000-15e626cbf32b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:33.987970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fca6b-b1b1-4bff-a000-15e626cbf32b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:33.988094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fca6b-b1b1-4bff-a000-15e626cbf32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:34.053380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f1fca6b-b1b1-4bff-a000-15e626cbf32b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:34.054583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f1fca6b-b1b1-4bff-a000-15e626cbf32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:34.151280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 636/1279] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:34.190938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:34.192451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:34.295088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6302-7c96-478d-ab73-344911cec627 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:34.362839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:34.363464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:34.363736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:34.364002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:34.365633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:34.467960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:34.469717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3ef6-a23c-4e80-8cb1-9c43b6fe2573 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:34.487665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 644/1280] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:36.852826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:36.853290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:36.853382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:36.855175 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 637/1281] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:36.862278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107103-2040-4fe4-abc4-500acffcfd20 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:36.862678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107103-2040-4fe4-abc4-500acffcfd20 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:36.862846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107103-2040-4fe4-abc4-500acffcfd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:36.924781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-65107103-2040-4fe4-abc4-500acffcfd20 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:36.925949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-65107103-2040-4fe4-abc4-500acffcfd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:37.018018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 645/1282] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:47:37.060691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:37.062268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:37.160299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5a31-82dc-44eb-ad83-5498c13c3352 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:37.234783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:37.235416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:37.235692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:37.235962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:37.237624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:37.340942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:37.342277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea11126-d6b2-4eec-86da-1a1e6dd30902 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:37.359744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 638/1283] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:40.001895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:40.002372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:40.002483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:40.004209 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 646/1284] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:40.011193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100641-2192-4961-b1ee-aac4f1dad409 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:40.011619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100641-2192-4961-b1ee-aac4f1dad409 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:40.011744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100641-2192-4961-b1ee-aac4f1dad409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:40.079623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d2100641-2192-4961-b1ee-aac4f1dad409 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:40.080769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d2100641-2192-4961-b1ee-aac4f1dad409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:40.181454 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 639/1285] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:47:40.222542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:40.228210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:40.316902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4dc33-0e3d-4b4d-9894-140bcf71936a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:40.321243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:40.321878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:40.322157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:40.322428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:40.331116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:40.332458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b94582-c367-4afe-955c-44e1d36a5817 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:40.342171 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 647/1286] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:44.600640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175362-9825-489b-8963-7264b91844b1 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:44.601144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175362-9825-489b-8963-7264b91844b1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:44.601144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175362-9825-489b-8963-7264b91844b1 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:44.602903 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 640/1287] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:44.610091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65cdb-44b3-4f1c-8350-7a1b230b6abd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:44.610591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65cdb-44b3-4f1c-8350-7a1b230b6abd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:44.610693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65cdb-44b3-4f1c-8350-7a1b230b6abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:44.628380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-92e65cdb-44b3-4f1c-8350-7a1b230b6abd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:44.629627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-92e65cdb-44b3-4f1c-8350-7a1b230b6abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:44.637671 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 648/1288] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:44.679556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175362-9825-489b-8963-7264b91844b1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:44.689857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175362-9825-489b-8963-7264b91844b1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:44.693548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:44.694281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:44.694900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:44.695249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:44.704125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:44.705576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea193-12e6-49df-904a-25fbee5c3ca2 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:44.714742 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 641/1289] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:47.620634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a7da-c1a8-4a4c-8504-c2fc6348d367 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:47.621166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a7da-c1a8-4a4c-8504-c2fc6348d367 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:47.621278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a7da-c1a8-4a4c-8504-c2fc6348d367 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:47.623141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 649/1290] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:47.630178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc220a0-51fa-4d2a-a5ff-34d72a404ca5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:47.630603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc220a0-51fa-4d2a-a5ff-34d72a404ca5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:47.630847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc220a0-51fa-4d2a-a5ff-34d72a404ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:47.648289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bdc220a0-51fa-4d2a-a5ff-34d72a404ca5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:47.649756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bdc220a0-51fa-4d2a-a5ff-34d72a404ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:47.657626 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 642/1291] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:47.698197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1a7da-c1a8-4a4c-8504-c2fc6348d367 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:47.708527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1a7da-c1a8-4a4c-8504-c2fc6348d367 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:47.711962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:47.712577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:47.712891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:47.713160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:47.721577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:47.722969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb05ed-948a-4c49-958b-23c5d6d11d90 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:47.732505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 650/1292] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:52.038318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb456-0a8f-49c0-9048-6462e7293af0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:52.038856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb456-0a8f-49c0-9048-6462e7293af0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:52.038856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb456-0a8f-49c0-9048-6462e7293af0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:52.040669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 643/1293] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:47:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:47:52.047990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02fe7-7064-4854-9e0c-5ef2de29847d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:52.048395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02fe7-7064-4854-9e0c-5ef2de29847d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:52.048522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02fe7-7064-4854-9e0c-5ef2de29847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:52.066263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d4e02fe7-7064-4854-9e0c-5ef2de29847d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:52.067533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d4e02fe7-7064-4854-9e0c-5ef2de29847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:52.076206 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 651/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:47:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:47:52.116644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cb456-0a8f-49c0-9048-6462e7293af0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:47:52.126910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cb456-0a8f-49c0-9048-6462e7293af0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:47:52.130363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:47:52.131479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:52.131756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:52.132024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:52.140714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:47:52.142115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4282a-1416-4066-a102-790c1b4eb16d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:47:52.151997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 644/1295] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:47:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:47:57.370868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fc8a-4457-45b1-a5dd-cdc96acd32a2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:57.371373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fc8a-4457-45b1-a5dd-cdc96acd32a2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:57.371451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fc8a-4457-45b1-a5dd-cdc96acd32a2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:57.373189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 652/1296] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:47:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:47:57.379779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced236-b44f-44e4-8c33-9b139b43662e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:47:57.380292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced236-b44f-44e4-8c33-9b139b43662e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:47:57.380377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced236-b44f-44e4-8c33-9b139b43662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:47:57.460351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-96ced236-b44f-44e4-8c33-9b139b43662e None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:47:57.461799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-96ced236-b44f-44e4-8c33-9b139b43662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:47:57.596119 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 645/1297] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:47:57 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:02.126909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf701-4f1a-4097-938e-19069c5c442a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:02.127432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf701-4f1a-4097-938e-19069c5c442a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:02.127432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf701-4f1a-4097-938e-19069c5c442a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:02.129376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 653/1298] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:48:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:02.134623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df3d-fd5e-4df1-a71b-57b8e45e2259 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:02.135062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df3d-fd5e-4df1-a71b-57b8e45e2259 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:02.135147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df3d-fd5e-4df1-a71b-57b8e45e2259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:02.152795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7ec1df3d-fd5e-4df1-a71b-57b8e45e2259 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:02.153957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ec1df3d-fd5e-4df1-a71b-57b8e45e2259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:02.162786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 646/1299] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:48:02 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:03.578198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e6192-5af0-477e-b387-8f4b477cebb2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:03.578707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e6192-5af0-477e-b387-8f4b477cebb2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:03.578834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e6192-5af0-477e-b387-8f4b477cebb2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:03.580535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 654/1300] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:48:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:03.585869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530d39-6d81-47fd-b732-2d8b2b266aa1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:03.586257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530d39-6d81-47fd-b732-2d8b2b266aa1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:03.586487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530d39-6d81-47fd-b732-2d8b2b266aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:03.605585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-32530d39-6d81-47fd-b732-2d8b2b266aa1 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:03.606742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-32530d39-6d81-47fd-b732-2d8b2b266aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:03.615528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 647/1301] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:48:03 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:48:07.566052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001a0b-2566-4a0c-b00b-8bf9a0e070dd None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:07.566574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001a0b-2566-4a0c-b00b-8bf9a0e070dd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:07.566574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001a0b-2566-4a0c-b00b-8bf9a0e070dd None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:07.568998 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 655/1302] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:07.576176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd92b1-8fae-4b53-b24c-5b19c074d6de None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:07.576601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd92b1-8fae-4b53-b24c-5b19c074d6de None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:07.576757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd92b1-8fae-4b53-b24c-5b19c074d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:07.593962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2bbd92b1-8fae-4b53-b24c-5b19c074d6de None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:07.595107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2bbd92b1-8fae-4b53-b24c-5b19c074d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:07.602917 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 648/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:07.655107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef88f8-9e22-4a80-8eae-1417fcb9301f None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:07.655490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef88f8-9e22-4a80-8eae-1417fcb9301f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:07.655836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef88f8-9e22-4a80-8eae-1417fcb9301f None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:07.657730 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 656/1304] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:48:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:07.663714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecd0-9aa5-4aca-bc6c-dc81869151f6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:07.664070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecd0-9aa5-4aca-bc6c-dc81869151f6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:07.664416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecd0-9aa5-4aca-bc6c-dc81869151f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:07.727843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2a22ecd0-9aa5-4aca-bc6c-dc81869151f6 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:07.729428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a22ecd0-9aa5-4aca-bc6c-dc81869151f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:07.814849 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 649/1305] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:48:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:07.824136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef88f8-9e22-4a80-8eae-1417fcb9301f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:07.841809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef88f8-9e22-4a80-8eae-1417fcb9301f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:07.847379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:07.848014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:07.848297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:07.848652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:07.859245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:07.860843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184bf61-de24-494e-ab7d-bf3704bf427c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:07.870918 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 657/1306] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:10.421716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91052e3-1521-4b98-a90f-a466a2c164a3 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:10.422281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91052e3-1521-4b98-a90f-a466a2c164a3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:10.422281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91052e3-1521-4b98-a90f-a466a2c164a3 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:10.424035 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 650/1307] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:10.432019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed045-9ffd-4f5f-9929-b7d42adc4226 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:10.432420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed045-9ffd-4f5f-9929-b7d42adc4226 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:10.432564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed045-9ffd-4f5f-9929-b7d42adc4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:10.450427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9e2ed045-9ffd-4f5f-9929-b7d42adc4226 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:10.451598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9e2ed045-9ffd-4f5f-9929-b7d42adc4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:10.459414 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 658/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:10.508329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91052e3-1521-4b98-a90f-a466a2c164a3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:10.523983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91052e3-1521-4b98-a90f-a466a2c164a3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:10.529457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:10.530162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:10.530509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:10.530853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:10.539582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:10.541261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10dbac-b7da-467a-9598-a72bc89e1c13 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:10.550929 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 651/1309] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:13.184534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e3504-5fa2-4efd-8b61-c73544bdcfbd None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:13.185066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e3504-5fa2-4efd-8b61-c73544bdcfbd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:13.185183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e3504-5fa2-4efd-8b61-c73544bdcfbd None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:13.186888 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 659/1310] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:13.194213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715aae-f6e2-4011-9c2e-12c8a98552c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:13.195310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715aae-f6e2-4011-9c2e-12c8a98552c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:13.195753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715aae-f6e2-4011-9c2e-12c8a98552c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:13.218233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92715aae-f6e2-4011-9c2e-12c8a98552c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:13.219670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92715aae-f6e2-4011-9c2e-12c8a98552c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:13.230643 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 652/1311] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:48:13.280973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378927d-89a9-40b6-8a72-0f7fc25505de None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:13.281297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378927d-89a9-40b6-8a72-0f7fc25505de None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:13.281554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378927d-89a9-40b6-8a72-0f7fc25505de None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:13.283717 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 660/1312] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:48:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:13.293156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a874-ed5b-4027-a110-276eee428c84 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:13.293729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a874-ed5b-4027-a110-276eee428c84 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:13.294195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a874-ed5b-4027-a110-276eee428c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:13.314393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e210a874-ed5b-4027-a110-276eee428c84 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:13.315745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e210a874-ed5b-4027-a110-276eee428c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:13.326033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 653/1313] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:48:13 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:13.337588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378927d-89a9-40b6-8a72-0f7fc25505de None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:13.353508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378927d-89a9-40b6-8a72-0f7fc25505de None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:13.360284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:13.361304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:13.361642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:13.361982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:13.374701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:13.376550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103297-b97f-46bf-ab55-89b1738f9d7c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:13.387796 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 661/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:15.839507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1049ce-150e-459a-aa64-6af2bf449eab None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:15.840255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1049ce-150e-459a-aa64-6af2bf449eab None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:15.840716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1049ce-150e-459a-aa64-6af2bf449eab None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:15.849614 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 654/1315] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:15 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:15.850857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391250-43dc-47ef-8075-f3d7f62b2030 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:15.851296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391250-43dc-47ef-8075-f3d7f62b2030 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:15.851371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391250-43dc-47ef-8075-f3d7f62b2030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:15.893727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d5391250-43dc-47ef-8075-f3d7f62b2030 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:15.895273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d5391250-43dc-47ef-8075-f3d7f62b2030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:15.923207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 662/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:15.965806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1049ce-150e-459a-aa64-6af2bf449eab None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:15.983555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1049ce-150e-459a-aa64-6af2bf449eab None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:15.990060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:15.991511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:15.992004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:15.992489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:16.002553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:16.004817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd82c7-c1bd-42f1-bb86-4d497f2f49f8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:16.016094 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 655/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:18.935659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9863a-22d8-44f3-aaff-bf6874bfd3a0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:18.935659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9863a-22d8-44f3-aaff-bf6874bfd3a0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:18.935659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9863a-22d8-44f3-aaff-bf6874bfd3a0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:18.935659 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 663/1318] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d9df-9a12-40cf-8aeb-9dccd31b8d86 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d9df-9a12-40cf-8aeb-9dccd31b8d86 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d9df-9a12-40cf-8aeb-9dccd31b8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1fd1d9df-9a12-40cf-8aeb-9dccd31b8d86 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1fd1d9df-9a12-40cf-8aeb-9dccd31b8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:18.939986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 656/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:18.941647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9863a-22d8-44f3-aaff-bf6874bfd3a0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:18.941647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9863a-22d8-44f3-aaff-bf6874bfd3a0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:18.941647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:18.941647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:18.942155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:18.942155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:18.942155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:18.942155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760cda5-2d13-4601-8ea0-f5cdc15e71f4 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:18.942155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 664/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:19.533842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d876-41d9-40ca-b280-f81bf2429a70 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:19.534130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d876-41d9-40ca-b280-f81bf2429a70 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:19.534379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d876-41d9-40ca-b280-f81bf2429a70 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:19.536387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 657/1321] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:19.543773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a097-3629-450a-9492-2e1535ba8cff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:19.544058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a097-3629-450a-9492-2e1535ba8cff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:19.544330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a097-3629-450a-9492-2e1535ba8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:19.562130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4c60a097-3629-450a-9492-2e1535ba8cff None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:19.563318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c60a097-3629-450a-9492-2e1535ba8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:19.572183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 665/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:19.634899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393e52-cdf5-4774-9f01-18b9cf0274b0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:19.635182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393e52-cdf5-4774-9f01-18b9cf0274b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:19.635457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393e52-cdf5-4774-9f01-18b9cf0274b0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:19.637265 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 658/1323] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 10 03:48:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:19.642777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257252-b46e-471a-89b6-e406284262ab None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:19.643178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257252-b46e-471a-89b6-e406284262ab None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:19.643596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257252-b46e-471a-89b6-e406284262ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:19.690401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-52257252-b46e-471a-89b6-e406284262ab None None] MFA Rules not processed for user `7e779dee8d114aa890e1725ef72b0ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:19.691722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52257252-b46e-471a-89b6-e406284262ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:19.750684 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 666/1324] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 03:48:19 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:19.761430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393e52-cdf5-4774-9f01-18b9cf0274b0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:19.771926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393e52-cdf5-4774-9f01-18b9cf0274b0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:19.775570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:19.776494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:19.776905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:19.777298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:19.786620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:19.788306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd47af5-1089-42e2-8eac-4a1bc0d89496 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:19.797673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 659/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:21.576086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052e94-6fa9-42f5-92f3-972fca1c9dce None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:21.576682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052e94-6fa9-42f5-92f3-972fca1c9dce None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:21.576682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052e94-6fa9-42f5-92f3-972fca1c9dce None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:21.578453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 667/1326] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:21.585735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df44db-53ca-44d2-9143-ac6eaf05e337 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:21.586163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df44db-53ca-44d2-9143-ac6eaf05e337 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:21.586308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df44db-53ca-44d2-9143-ac6eaf05e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:21.607606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-15df44db-53ca-44d2-9143-ac6eaf05e337 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:21.607606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-15df44db-53ca-44d2-9143-ac6eaf05e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:21.615780 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 660/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:21.663734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052e94-6fa9-42f5-92f3-972fca1c9dce None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:21.678298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052e94-6fa9-42f5-92f3-972fca1c9dce None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:21.683825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:21.684329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:21.684623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:21.684902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:21.693753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:21.694682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d33e3-5a9b-42ed-bcf1-603a2454f326 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:21.704451 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 668/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:24.354428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831985-7d83-483b-9aa2-a0fb6fef400d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:24.355979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831985-7d83-483b-9aa2-a0fb6fef400d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:24.355979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831985-7d83-483b-9aa2-a0fb6fef400d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:24.357095 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 661/1329] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:24.364843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ece6-4feb-47a5-b4b0-bcd14418475c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:24.365302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ece6-4feb-47a5-b4b0-bcd14418475c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:24.365405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ece6-4feb-47a5-b4b0-bcd14418475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:24.386739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d747ece6-4feb-47a5-b4b0-bcd14418475c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:24.388197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d747ece6-4feb-47a5-b4b0-bcd14418475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:24.396111 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 669/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:24.441478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42831985-7d83-483b-9aa2-a0fb6fef400d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:24.459286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42831985-7d83-483b-9aa2-a0fb6fef400d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:24.465544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:24.466172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:24.466451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:24.466905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:24.476133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:24.478509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddd506-6fd8-44ba-84e8-9d2574773cf5 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:24.490627 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 662/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:26.831018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764049d-5165-4c28-8df5-54280804d53a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:26.831914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764049d-5165-4c28-8df5-54280804d53a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:26.832294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764049d-5165-4c28-8df5-54280804d53a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:26.834288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 670/1332] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:26.841642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a99c-c70e-489f-9e02-2881d10ab883 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:26.842451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a99c-c70e-489f-9e02-2881d10ab883 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:26.842897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a99c-c70e-489f-9e02-2881d10ab883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:26.868652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bff5a99c-c70e-489f-9e02-2881d10ab883 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:26.868652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bff5a99c-c70e-489f-9e02-2881d10ab883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:26.876035 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 663/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:26.924858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764049d-5165-4c28-8df5-54280804d53a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:26.939174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764049d-5165-4c28-8df5-54280804d53a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:26.944730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:26.945625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:26.945900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:26.946173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:26.954242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:26.955785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a44d1-3d31-464a-898d-b6404e14cb7b service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:26.965366 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 671/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:29.775120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d933d7-2d92-473a-874b-2c492e2d182f None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:29.775878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d933d7-2d92-473a-874b-2c492e2d182f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:29.775878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d933d7-2d92-473a-874b-2c492e2d182f None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:29.777480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 664/1335] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:29.785100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de908c-341a-4697-bf40-6a9fa10f1708 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:29.786144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de908c-341a-4697-bf40-6a9fa10f1708 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:29.786144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de908c-341a-4697-bf40-6a9fa10f1708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:29.805138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d0de908c-341a-4697-bf40-6a9fa10f1708 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:29.806425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d0de908c-341a-4697-bf40-6a9fa10f1708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:29.814352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 672/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:29.861661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d933d7-2d92-473a-874b-2c492e2d182f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:29.880521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d933d7-2d92-473a-874b-2c492e2d182f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:29.887503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:29.888305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:29.888689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:29.889035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:29.899441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:29.901533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae996-fc7d-4cb3-b02c-31b8003c9c5e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:29.914035 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 665/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:32.458597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30121-f278-4331-a898-58def4838c3c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:32.459056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30121-f278-4331-a898-58def4838c3c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:32.459297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30121-f278-4331-a898-58def4838c3c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:32.461995 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 673/1338] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:32.472642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4b74-d22b-460b-874d-f987c0fe8ccb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:32.473761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4b74-d22b-460b-874d-f987c0fe8ccb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:32.473900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4b74-d22b-460b-874d-f987c0fe8ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:32.499487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9dbd4b74-d22b-460b-874d-f987c0fe8ccb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:32.501981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9dbd4b74-d22b-460b-874d-f987c0fe8ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:32.511994 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 666/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:48:32.560033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30121-f278-4331-a898-58def4838c3c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:32.574239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30121-f278-4331-a898-58def4838c3c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:32.579839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:32.580470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:32.580778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:32.581050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:32.589840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:32.591445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6a070-2c90-4c9a-8d70-8cb0ba6f4ed7 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:32.601292 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 674/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:35.002448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880326ac-e4e6-4889-96e6-33abdcd3ae24 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.003059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880326ac-e4e6-4889-96e6-33abdcd3ae24 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.003059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880326ac-e4e6-4889-96e6-33abdcd3ae24 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.004817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 667/1341] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:35.011936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe231a0-a927-4986-b0a1-2487191603f1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.012400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe231a0-a927-4986-b0a1-2487191603f1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.012507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe231a0-a927-4986-b0a1-2487191603f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.029587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4fe231a0-a927-4986-b0a1-2487191603f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:35.031827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4fe231a0-a927-4986-b0a1-2487191603f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:35.040017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 675/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:35.088407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880326ac-e4e6-4889-96e6-33abdcd3ae24 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:35.102839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880326ac-e4e6-4889-96e6-33abdcd3ae24 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:35.108145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:35.108797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.109073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.109347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.117830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:35.119373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3b09d-a0f6-4ff2-99f0-e330506b78ee service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:35.128375 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 668/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:35.620281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046cf6-2732-40e9-8784-60fc7cd389da None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.620531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046cf6-2732-40e9-8784-60fc7cd389da None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.620830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046cf6-2732-40e9-8784-60fc7cd389da None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.622608 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 676/1344] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:35.630400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092eed-cf18-4e48-9945-c504b4348f1a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.630670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092eed-cf18-4e48-9945-c504b4348f1a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.630942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092eed-cf18-4e48-9945-c504b4348f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.648740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c6092eed-cf18-4e48-9945-c504b4348f1a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:35.649908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c6092eed-cf18-4e48-9945-c504b4348f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:35.657620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 669/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:35.716251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000be6-0023-49b5-97b0-01cabf6f77a8 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.717047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000be6-0023-49b5-97b0-01cabf6f77a8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.717336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000be6-0023-49b5-97b0-01cabf6f77a8 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.719137 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 677/1346] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 10 03:48:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:35.724918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91176-90a2-431d-8dbf-37b0da592ce9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.725196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91176-90a2-431d-8dbf-37b0da592ce9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.725466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91176-90a2-431d-8dbf-37b0da592ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.773960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-57e91176-90a2-431d-8dbf-37b0da592ce9 None None] MFA Rules not processed for user `b0e3e62850b34fe786eda1156be94f74`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:35.775148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-57e91176-90a2-431d-8dbf-37b0da592ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:35.837211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 670/1347] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 03:48:35 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:35.846549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000be6-0023-49b5-97b0-01cabf6f77a8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:35.857105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000be6-0023-49b5-97b0-01cabf6f77a8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:35.860563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:35.861254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:35.861539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:35.861812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:35.870395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:35.871745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f6c0-a495-4b8e-8690-b32b54e015d7 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:35.881384 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 678/1348] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:36.502744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08475d-f942-4e6c-bd50-830382c36b87 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:36.503305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08475d-f942-4e6c-bd50-830382c36b87 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:36.503411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08475d-f942-4e6c-bd50-830382c36b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:36.556082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4d08475d-f942-4e6c-bd50-830382c36b87 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:36.557325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d08475d-f942-4e6c-bd50-830382c36b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:36.618362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 671/1349] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:48:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:36.665695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b956-0378-4fcc-af60-b1cb146c94fe None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:36.666208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b956-0378-4fcc-af60-b1cb146c94fe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:36.666344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b956-0378-4fcc-af60-b1cb146c94fe None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:36.668207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 679/1350] 10.222.0.13 () {54 vars in 942 bytes} [Wed Nov 10 03:48:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:36.675258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d486-37be-4986-a885-7662cff02ab9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:36.675548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d486-37be-4986-a885-7662cff02ab9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:36.675823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d486-37be-4986-a885-7662cff02ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:36.722961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e8c6d486-37be-4986-a885-7662cff02ab9 None None] MFA Rules not processed for user `525c6651aaa6451cbe1dd9f91e1c68ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:36.724203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e8c6d486-37be-4986-a885-7662cff02ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:36.796587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 672/1351] 10.222.0.13 () {58 vars in 1039 bytes} [Wed Nov 10 03:48:36 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:36.806738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b956-0378-4fcc-af60-b1cb146c94fe None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:36.821225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b956-0378-4fcc-af60-b1cb146c94fe None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:36.828955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:36.829602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:36.829884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:36.830247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:36.838724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:36.840268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f6c5-e550-4b2c-b93e-5ad6b9bf65af service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:36.848286 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 680/1352] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:48:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:48:37.570363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d455-026e-4cf8-a41a-1c3fb7a96411 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:37.570967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d455-026e-4cf8-a41a-1c3fb7a96411 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:37.570967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d455-026e-4cf8-a41a-1c3fb7a96411 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:37.572694 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 673/1353] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:37.580051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f249b-aff5-43e9-8cb4-b7a0f22e3001 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:37.581791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f249b-aff5-43e9-8cb4-b7a0f22e3001 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:37.582877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f249b-aff5-43e9-8cb4-b7a0f22e3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:37.601481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-277f249b-aff5-43e9-8cb4-b7a0f22e3001 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:37.602689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-277f249b-aff5-43e9-8cb4-b7a0f22e3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:37.611509 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 681/1354] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:37.659242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d455-026e-4cf8-a41a-1c3fb7a96411 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:37.674601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d455-026e-4cf8-a41a-1c3fb7a96411 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:37.684270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:37.685078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:37.685554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:37.685692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:37.696404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:37.698013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed68691-fd53-4f46-90c5-ef833b1a0a3a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:37.707966 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 674/1355] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:48:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:48:55.086590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1328f-4d49-4937-8c2e-e5429ebe712a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:55.087126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1328f-4d49-4937-8c2e-e5429ebe712a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:55.087126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1328f-4d49-4937-8c2e-e5429ebe712a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:55.088901 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 682/1356] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:55.095920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef7337-4200-47e8-acdf-72826eca76c6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:55.096331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef7337-4200-47e8-acdf-72826eca76c6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:55.096467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef7337-4200-47e8-acdf-72826eca76c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:55.114255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-80ef7337-4200-47e8-acdf-72826eca76c6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:55.115425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80ef7337-4200-47e8-acdf-72826eca76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:55.123030 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 675/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:55.150135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1328f-4d49-4937-8c2e-e5429ebe712a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:55.165169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1328f-4d49-4937-8c2e-e5429ebe712a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:55.170180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:55.170857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:55.171135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:55.171408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:55.172150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:55.174032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc29be8-bd02-4075-b47c-367a069be36b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:55.193165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 683/1358] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:48:55 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:48:57.462903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7b2b-9211-46ff-ac26-3c21b0352a75 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:57.463443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7b2b-9211-46ff-ac26-3c21b0352a75 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:57.463443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7b2b-9211-46ff-ac26-3c21b0352a75 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:57.465250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 676/1359] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:57.473012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:57.473399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:57.473585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:57.491543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:48:57.492762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:48:57.500380 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 684/1360] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:48:57.525076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7b2b-9211-46ff-ac26-3c21b0352a75 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:57.537718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7b2b-9211-46ff-ac26-3c21b0352a75 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:57.542154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:57.542978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:57.543258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:57.543527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] PATH_INFO: `/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:57.554429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] RBAC: Authorizing `identity:get_project(project_id=54d0dbcc34cd41e7842b0425cd547f9b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:57.556452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:57.558161 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 677/1361] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:48:57 2021] GET /identity/v3/projects/54d0dbcc34cd41e7842b0425cd547f9b => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:48:57.564536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:57.573634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeb731-6878-447a-8bf9-b753818a063c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:57.578092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:57.578725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:57.579004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:57.579277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:57.580047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] RBAC: Adding query filter params (scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:48:57.580352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:57.582176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc100996-6d73-4bda-ad77-230c4e3df428 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:57.588502 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 685/1362] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:48:57 2021] GET /identity/v3/role_assignments?scope.project.id=54d0dbcc34cd41e7842b0425cd547f9b => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:48:57.594295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:48:57.604259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014851-ff4e-4a39-8459-11369bd1cd7a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:48:57.608726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:48:57.609549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:57.609827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:57.610099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] PATH_INFO: `/v3/users/9c2be4fd922242e1a93a8ca2d8314928` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:57.623415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] RBAC: Authorizing `identity:get_user(user_id=9c2be4fd922242e1a93a8ca2d8314928)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:48:57.625523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767cb90-1d12-4007-80d7-3588f9a374cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:48:57.627099 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 678/1363] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:48:57 2021] GET /identity/v3/users/9c2be4fd922242e1a93a8ca2d8314928 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:48:59.975527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc788-dd10-4d96-a884-15ed4be8e9b3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:59.976086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc788-dd10-4d96-a884-15ed4be8e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:59.976086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc788-dd10-4d96-a884-15ed4be8e9b3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:48:59.977873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 686/1364] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:48:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:48:59.985062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:48:59.985475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:48:59.985592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:00.003092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:00.005027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:00.012484 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 679/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:48:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:00.037479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc788-dd10-4d96-a884-15ed4be8e9b3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:00.049766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc788-dd10-4d96-a884-15ed4be8e9b3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:00.054687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:00.055548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:00.055822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:00.056090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] PATH_INFO: `/v3/projects/a210aedaae3649bea6079458bde4c633` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:00.067342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] RBAC: Authorizing `identity:get_project(project_id=a210aedaae3649bea6079458bde4c633)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:00.069428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:00.071418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 687/1366] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:00 2021] GET /identity/v3/projects/a210aedaae3649bea6079458bde4c633 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:49:00.077723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:00.086581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9867ad-2a15-45c9-9f01-c17ca52b04d4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:00.090942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:00.091564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:00.091840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:00.092110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:00.092896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] RBAC: Adding query filter params (scope.project.id=a210aedaae3649bea6079458bde4c633) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:00.093192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:00.094972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25d15b-89ee-4f50-82d4-b115fa252308 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:00.101271 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 680/1367] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:00 2021] GET /identity/v3/role_assignments?scope.project.id=a210aedaae3649bea6079458bde4c633 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:00.107413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:00.117505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6405be-878d-4f27-9743-ffe70b16f976 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:00.121890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:00.122741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:00.123015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:00.123285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:00.136829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:00.139021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c74b76-43bc-434d-a91d-ac6483301190 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:00.140625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 688/1368] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:00 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:02.473285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4255-802b-4acd-a972-f6ed98e21925 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:02.473827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4255-802b-4acd-a972-f6ed98e21925 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:02.473827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4255-802b-4acd-a972-f6ed98e21925 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:02.475641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 681/1369] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:02.482975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:02.483523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:02.483523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:02.501831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:02.503022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:02.510733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 689/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:49:02.536426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4255-802b-4acd-a972-f6ed98e21925 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:02.549006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4255-802b-4acd-a972-f6ed98e21925 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:02.553398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:02.554220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:02.554492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:02.554759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] PATH_INFO: `/v3/projects/e759a896dad443d0938f7cb7473bd222` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:02.555909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] RBAC: Authorizing `identity:get_project(project_id=e759a896dad443d0938f7cb7473bd222)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:02.557723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:02.559349 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 682/1371] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:02 2021] GET /identity/v3/projects/e759a896dad443d0938f7cb7473bd222 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:02.565867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:02.574956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4edce-8f81-42ba-a853-b84c2f3ced63 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:02.579433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:02.580060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:02.580337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:02.580627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:02.581398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] RBAC: Adding query filter params (scope.project.id=e759a896dad443d0938f7cb7473bd222) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:02.582205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:02.584000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10412f-3396-41f4-a91e-f87e0e4cca67 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:02.589591 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 690/1372] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:02 2021] GET /identity/v3/role_assignments?scope.project.id=e759a896dad443d0938f7cb7473bd222 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:02.595508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:02.605369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542c0ba-35cb-4a39-b873-7de859d670ec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:02.609773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:02.610581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:02.610852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:02.611149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:02.612294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:02.614078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ceea-742d-42c1-a4dd-bb4821038e74 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:02.615641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 683/1373] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:02 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:04.935838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb76af-b6de-4d3e-9a05-45aeba75ba9c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:04.936424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb76af-b6de-4d3e-9a05-45aeba75ba9c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:04.936424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb76af-b6de-4d3e-9a05-45aeba75ba9c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:04.938210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 691/1374] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:04.945628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:04.946038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:04.946167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:04.963579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:04.964786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:04.972992 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 684/1375] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:04.998883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb76af-b6de-4d3e-9a05-45aeba75ba9c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:05.011083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb76af-b6de-4d3e-9a05-45aeba75ba9c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:05.015481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:05.016303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:05.016579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:05.016879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] PATH_INFO: `/v3/projects/eb9200e8495e40bbbba9c0636aee9423` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:05.027551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] RBAC: Authorizing `identity:get_project(project_id=eb9200e8495e40bbbba9c0636aee9423)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:05.029611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:05.031440 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 692/1376] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:04 2021] GET /identity/v3/projects/eb9200e8495e40bbbba9c0636aee9423 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:05.038454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:05.047387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b918a3-9696-42cd-8b25-5f88b9e70cd7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:05.052816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:05.053446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:05.053720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:05.053989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:05.054752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] RBAC: Adding query filter params (scope.project.id=eb9200e8495e40bbbba9c0636aee9423) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:05.055049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:05.056865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:05.063406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 685/1377] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:05 2021] GET /identity/v3/role_assignments?scope.project.id=eb9200e8495e40bbbba9c0636aee9423 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:49:05.069466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:05.079125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c9eb-d767-4853-8813-3b7b6fc0490b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:05.083658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:05.084430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:05.084740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:05.085015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:05.086177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:05.087908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea02d2e-3be7-458b-8dda-ab3f946b1c81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:05.089492 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 693/1378] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:05 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:05.095288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:05.105012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9daaa-e50c-4809-a732-e7cf0f546584 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:05.109401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:05.110206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:05.110480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:05.110747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] PATH_INFO: `/v3/users/7064396c92904d19b1383fecfb8fcf55` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:05.125014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] RBAC: Authorizing `identity:get_user(user_id=7064396c92904d19b1383fecfb8fcf55)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:05.127060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c9b7a-8f0f-4e6c-a5e3-bb3c84c281fd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:05.128714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 686/1379] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:05 2021] GET /identity/v3/users/7064396c92904d19b1383fecfb8fcf55 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:07.509275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11732bd-5113-4396-a8e7-d7d4be418b22 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:07.509867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11732bd-5113-4396-a8e7-d7d4be418b22 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:07.509867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11732bd-5113-4396-a8e7-d7d4be418b22 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:07.511602 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 694/1380] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:07.523408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:07.523408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:07.523408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:07.539596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:07.540818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:07.548437 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 687/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:07.574665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11732bd-5113-4396-a8e7-d7d4be418b22 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:07.586476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11732bd-5113-4396-a8e7-d7d4be418b22 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:07.590778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:07.591595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:07.591867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:07.592133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] PATH_INFO: `/v3/projects/f19eadbdc460491091ca3c38231c2873` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:07.602237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] RBAC: Authorizing `identity:get_project(project_id=f19eadbdc460491091ca3c38231c2873)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:07.604224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:07.605905 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 695/1382] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:07 2021] GET /identity/v3/projects/f19eadbdc460491091ca3c38231c2873 => generated 361 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:49:07.612324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:07.621923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ef36-b33e-40f3-9a29-7b445a5120a9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:07.626467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:07.627106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:07.627363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:07.627634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:07.629066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] RBAC: Adding query filter params (scope.project.id=f19eadbdc460491091ca3c38231c2873) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:07.629369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:07.631170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e565e-063c-4c2e-a63e-fc48e5e4b38b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:07.636398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 688/1383] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:07 2021] GET /identity/v3/role_assignments?scope.project.id=f19eadbdc460491091ca3c38231c2873 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:07.642463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:07.651783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078416d-d0a2-4ef7-a56d-0adf4ae9bf6e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:07.656223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:07.657078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:07.657353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:07.657624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] PATH_INFO: `/v3/users/3e9f7cf1745a417f8db88279a5c289fb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:07.670442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e9f7cf1745a417f8db88279a5c289fb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:07.672502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c000-9d7d-4ebf-93fa-8099f5736e28 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:07.674114 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 696/1384] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:07 2021] GET /identity/v3/users/3e9f7cf1745a417f8db88279a5c289fb => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:10.012898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bf0e-b052-4c09-95fa-32069fae532a None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.013313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bf0e-b052-4c09-95fa-32069fae532a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.013456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bf0e-b052-4c09-95fa-32069fae532a None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.015284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 689/1385] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:10.023071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.023486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.023614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.041029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:10.042204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:10.049805 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 697/1386] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:10.074526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bf0e-b052-4c09-95fa-32069fae532a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:10.087197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bf0e-b052-4c09-95fa-32069fae532a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:10.091497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:10.092315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.092589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.092887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] PATH_INFO: `/v3/projects/f65d2d49eda34ae4bf39409b4225c986` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.104120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] RBAC: Authorizing `identity:get_project(project_id=f65d2d49eda34ae4bf39409b4225c986)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:10.106155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:10.107808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 690/1387] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:10 2021] GET /identity/v3/projects/f65d2d49eda34ae4bf39409b4225c986 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:10.115592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:10.124345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792f2a-b870-4646-a595-8e9e46413c2a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:10.129697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:10.130349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.130623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.130895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.131666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] RBAC: Adding query filter params (scope.project.id=f65d2d49eda34ae4bf39409b4225c986) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:10.131965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:10.133811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:10.139711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 698/1388] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:10 2021] GET /identity/v3/role_assignments?scope.project.id=f65d2d49eda34ae4bf39409b4225c986 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:10.146811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:10.156599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de71c8-6d32-4047-a6dc-e7a9d3de8859 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:10.161131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:10.161972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.162248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.162520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] PATH_INFO: `/v3/users/017b9bbfc89c40cd8b28ababf500ad07` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.175404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] RBAC: Authorizing `identity:get_user(user_id=017b9bbfc89c40cd8b28ababf500ad07)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:10.177535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ea17-5140-4599-aef9-eb17406b2d9b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:10.179145 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 691/1389] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:10 2021] GET /identity/v3/users/017b9bbfc89c40cd8b28ababf500ad07 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:10.185412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:10.195577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155824ef-0c02-4f39-93a2-13337b078dd6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:10.200069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:10.200941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:10.201221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:10.201493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] PATH_INFO: `/v3/users/6c49a731c22844ea8a4c513a8bee9f2b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:10.214944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c49a731c22844ea8a4c513a8bee9f2b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:10.217081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888a7d-274d-412a-9fc1-69e1b51e6de0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:10.218688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 699/1390] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:10 2021] GET /identity/v3/users/6c49a731c22844ea8a4c513a8bee9f2b => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:12.651937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9ea0-2624-473b-b950-302d16ab8cc0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.652457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9ea0-2624-473b-b950-302d16ab8cc0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.652576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9ea0-2624-473b-b950-302d16ab8cc0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.654318 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 692/1391] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:12.662181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.662591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.662739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.680410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:12.681621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:12.689240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 700/1392] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:49:12.714288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9ea0-2624-473b-b950-302d16ab8cc0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:12.726739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9ea0-2624-473b-b950-302d16ab8cc0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:12.731090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:12.731910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.732183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.732453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] PATH_INFO: `/v3/projects/fabcdfb53d104b1f8c560611b4e841e7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.743183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabcdfb53d104b1f8c560611b4e841e7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:12.745228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:12.746892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 693/1393] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 10 03:49:12 2021] GET /identity/v3/projects/fabcdfb53d104b1f8c560611b4e841e7 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:12.753441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:12.762228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d09ef-d0c1-4fc1-ad45-a981de5dab9b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:12.766667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:12.767292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.767566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.767835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.769133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] RBAC: Adding query filter params (scope.project.id=fabcdfb53d104b1f8c560611b4e841e7) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:49:12.769446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:12.771578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:12.778126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 701/1394] 10.222.0.13 () {56 vars in 1231 bytes} [Wed Nov 10 03:49:12 2021] GET /identity/v3/role_assignments?scope.project.id=fabcdfb53d104b1f8c560611b4e841e7 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:49:12.784919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:12.794374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab7c2c-8a14-4dad-af78-3e2734010aa1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:12.798810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:12.799652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.799935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.800205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] PATH_INFO: `/v3/users/99765343c3fa4367bcfd7aae4fb07ab0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.801428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] RBAC: Authorizing `identity:get_user(user_id=99765343c3fa4367bcfd7aae4fb07ab0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:12.803507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1be6-1b67-4ee5-bd4d-f0baa47042fe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:12.805136 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 694/1395] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:12 2021] GET /identity/v3/users/99765343c3fa4367bcfd7aae4fb07ab0 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:49:12.811239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:12.820962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba5df-9d66-4467-a68c-efcce75170b0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:12.825444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:12.826283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:12.826556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:12.826825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] PATH_INFO: `/v3/users/68e2062e0f2c4721be375c86224003a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:12.828003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] RBAC: Authorizing `identity:get_user(user_id=68e2062e0f2c4721be375c86224003a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:12.829811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69234b-4294-4e2f-8116-61a8ce29354d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:12.831921 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 702/1396] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 10 03:49:12 2021] GET /identity/v3/users/68e2062e0f2c4721be375c86224003a3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:49:18.431418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5404e-4b1a-46d9-b80a-35fab6ddbfc3 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:18.431985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5404e-4b1a-46d9-b80a-35fab6ddbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:18.431985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5404e-4b1a-46d9-b80a-35fab6ddbfc3 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:18.433738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 695/1397] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 10 03:49:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:18.439547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360254-d7ec-42d6-94e5-02bdbb957709 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:18.439966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360254-d7ec-42d6-94e5-02bdbb957709 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:18.440077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360254-d7ec-42d6-94e5-02bdbb957709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:18.459090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8a360254-d7ec-42d6-94e5-02bdbb957709 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:18.460255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8a360254-d7ec-42d6-94e5-02bdbb957709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:18.468422 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 703/1398] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 10 03:49:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:18.483404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58c5c-88a6-460c-af50-fbd221fc0759 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:18.483802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58c5c-88a6-460c-af50-fbd221fc0759 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:18.484183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58c5c-88a6-460c-af50-fbd221fc0759 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:18.486355 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 696/1399] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 10 03:49:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:18.491533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2236-26bf-46c9-b618-690ab52ae5f9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:18.491815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2236-26bf-46c9-b618-690ab52ae5f9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:18.492089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2236-26bf-46c9-b618-690ab52ae5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:18.510013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-869a2236-26bf-46c9-b618-690ab52ae5f9 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:18.511191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-869a2236-26bf-46c9-b618-690ab52ae5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:18.521085 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 704/1400] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 10 03:49:18 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:21.468511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d76a-44dd-46b7-8583-aa2db7cb4602 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:21.469082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d76a-44dd-46b7-8583-aa2db7cb4602 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:21.469082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d76a-44dd-46b7-8583-aa2db7cb4602 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:21.470907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 697/1401] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:21.477822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dd69-d01f-499d-b7ce-fe50ae765642 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:21.478221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dd69-d01f-499d-b7ce-fe50ae765642 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:21.478361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dd69-d01f-499d-b7ce-fe50ae765642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:21.497564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bfe2dd69-d01f-499d-b7ce-fe50ae765642 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:21.498755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bfe2dd69-d01f-499d-b7ce-fe50ae765642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:21.507372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 705/1402] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:21.552243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d76a-44dd-46b7-8583-aa2db7cb4602 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:21.567686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d76a-44dd-46b7-8583-aa2db7cb4602 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:21.573461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:21.574076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:21.574379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:21.574649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:21.583161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:21.584712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31522c1-2eaa-4f61-9768-978f164283c4 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:21.593751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 698/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:23.183877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06918-200d-4250-8796-493b4e7d24a5 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:23.184434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06918-200d-4250-8796-493b4e7d24a5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:23.184434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06918-200d-4250-8796-493b4e7d24a5 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:23.186321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 706/1404] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:23.192555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0174722-5b51-4d05-bc79-2eb886856b2b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:23.193013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0174722-5b51-4d05-bc79-2eb886856b2b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:23.193135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0174722-5b51-4d05-bc79-2eb886856b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:23.216718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b0174722-5b51-4d05-bc79-2eb886856b2b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:23.217907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0174722-5b51-4d05-bc79-2eb886856b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:23.225998 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 699/1405] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:23.432562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea06918-200d-4250-8796-493b4e7d24a5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:23.447572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea06918-200d-4250-8796-493b4e7d24a5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:23.452941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:23.453600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:23.453877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:23.454149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:23.462353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:23.463930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146670e2-313e-43ff-99ff-025f57d36f62 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:23.473029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 707/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:25.014323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f04b5-197c-46ce-9de0-00185b15d5b1 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:25.014893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f04b5-197c-46ce-9de0-00185b15d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:25.014991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f04b5-197c-46ce-9de0-00185b15d5b1 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:25.016772 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 700/1407] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:25.022295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53de0-c62b-4019-88fb-467a4c9d03ba None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:25.022719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53de0-c62b-4019-88fb-467a4c9d03ba None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:25.022832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53de0-c62b-4019-88fb-467a4c9d03ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:25.040240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fbd53de0-c62b-4019-88fb-467a4c9d03ba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:25.041467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fbd53de0-c62b-4019-88fb-467a4c9d03ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:25.049489 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 708/1408] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:25.213448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f04b5-197c-46ce-9de0-00185b15d5b1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:25.227726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f04b5-197c-46ce-9de0-00185b15d5b1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:25.233108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:25.233723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:25.233998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:25.234267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:25.242649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:25.244226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f7276-c25b-4018-a2ac-b5182a12a8ac service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:25.253154 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 701/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:26.764918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4e01-a30d-4c83-b2c0-749e28563b51 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:26.765602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4e01-a30d-4c83-b2c0-749e28563b51 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:26.765602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4e01-a30d-4c83-b2c0-749e28563b51 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:26.767231 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 709/1410] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:26.774062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcaf1-5148-4225-8021-a5632df83f30 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:26.774572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcaf1-5148-4225-8021-a5632df83f30 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:26.774884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcaf1-5148-4225-8021-a5632df83f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:26.795409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c08bcaf1-5148-4225-8021-a5632df83f30 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:26.796586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c08bcaf1-5148-4225-8021-a5632df83f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:26.804243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 702/1411] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:26.964955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea4e01-a30d-4c83-b2c0-749e28563b51 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:26.978662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea4e01-a30d-4c83-b2c0-749e28563b51 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:26.983951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:26.984570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:26.984876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:26.985147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:26.993401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:26.994944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1a203-d401-4db8-86ad-b110c000c4e1 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:27.004469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 710/1412] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:28.505850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2d32d-9998-42dc-9ae7-8725dc30bc62 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:28.506419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2d32d-9998-42dc-9ae7-8725dc30bc62 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:28.506419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2d32d-9998-42dc-9ae7-8725dc30bc62 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:28.508146 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 703/1413] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:28.513774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3c0-ce2b-4a3f-94bd-2d79eb2e4f86 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:28.514186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3c0-ce2b-4a3f-94bd-2d79eb2e4f86 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:28.514338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3c0-ce2b-4a3f-94bd-2d79eb2e4f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:28.531393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6c33c3c0-ce2b-4a3f-94bd-2d79eb2e4f86 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:28.532552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c33c3c0-ce2b-4a3f-94bd-2d79eb2e4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:28.540186 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 711/1414] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:49:28.700934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2d32d-9998-42dc-9ae7-8725dc30bc62 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:28.715105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2d32d-9998-42dc-9ae7-8725dc30bc62 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:28.720507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:28.721162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:28.721443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:28.721719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:28.729570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:28.731136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eca2d-c272-4314-8992-957f7ffa80c0 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:28.740891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 704/1415] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:30.207222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000d68-1bc4-4a4b-a161-245df2a456c9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:30.207784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000d68-1bc4-4a4b-a161-245df2a456c9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:30.207784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000d68-1bc4-4a4b-a161-245df2a456c9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:30.209627 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 712/1416] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:30.215188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9634-db8c-4694-8889-8dcce651130d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:30.215598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9634-db8c-4694-8889-8dcce651130d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:30.215742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9634-db8c-4694-8889-8dcce651130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:30.233167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e9a9634-db8c-4694-8889-8dcce651130d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:30.234342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e9a9634-db8c-4694-8889-8dcce651130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:30.242470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 705/1417] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:30.403981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000d68-1bc4-4a4b-a161-245df2a456c9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:30.418207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000d68-1bc4-4a4b-a161-245df2a456c9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:30.423425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:30.424045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:30.424323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:30.424591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:30.433027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:30.434585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939ffe-c7a0-4315-9dec-2a865eecd6aa service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:30.443788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 713/1418] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:31.905708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f57-b42d-4b22-b066-e31bf58cfe3d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:31.906270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f57-b42d-4b22-b066-e31bf58cfe3d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:31.906270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f57-b42d-4b22-b066-e31bf58cfe3d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:31.908046 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 706/1419] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:31.914053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd46174-ec15-421b-a94d-e877ea9aa9e1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:31.914476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd46174-ec15-421b-a94d-e877ea9aa9e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:31.914588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd46174-ec15-421b-a94d-e877ea9aa9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:31.932443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5cd46174-ec15-421b-a94d-e877ea9aa9e1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:31.933686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5cd46174-ec15-421b-a94d-e877ea9aa9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:31.941307 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 714/1420] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:32.100269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2f57-b42d-4b22-b066-e31bf58cfe3d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:32.114913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2f57-b42d-4b22-b066-e31bf58cfe3d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:32.120221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:32.120873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:32.121148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:32.121434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:32.129270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:32.130835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1f527-9243-4a6f-906c-f5f93420720b service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:32.139701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 707/1421] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:33.617328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbcd5-6cf5-4ce2-8738-c21e213cb833 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:33.617866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbcd5-6cf5-4ce2-8738-c21e213cb833 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:33.617986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbcd5-6cf5-4ce2-8738-c21e213cb833 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:33.619669 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 715/1422] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:33.625338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d538e-916d-41b7-bfd2-e47269290446 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:33.625769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d538e-916d-41b7-bfd2-e47269290446 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:33.625897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d538e-916d-41b7-bfd2-e47269290446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:33.643353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0f5d538e-916d-41b7-bfd2-e47269290446 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:33.644555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f5d538e-916d-41b7-bfd2-e47269290446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:33.652188 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 708/1423] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:33.812551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbcd5-6cf5-4ce2-8738-c21e213cb833 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:33.826598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbcd5-6cf5-4ce2-8738-c21e213cb833 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:33.832692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:33.833330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:33.833611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:33.833883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:33.842152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:33.843725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949cfee-2cb7-4143-8ba0-4ba1cc5d560b service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:33.853540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 716/1424] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:35.327091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbdefe-e30e-470e-9754-fe34d7522b1d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:35.327735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbdefe-e30e-470e-9754-fe34d7522b1d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:35.327735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbdefe-e30e-470e-9754-fe34d7522b1d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:35.329444 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 709/1425] 10.222.0.13 () {54 vars in 911 bytes} [Wed Nov 10 03:49:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:35.335641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558d71-5e4f-4d72-b551-bd00fb6132a7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:35.336084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558d71-5e4f-4d72-b551-bd00fb6132a7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:35.336187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558d71-5e4f-4d72-b551-bd00fb6132a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:35.354089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-32558d71-5e4f-4d72-b551-bd00fb6132a7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:35.355266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-32558d71-5e4f-4d72-b551-bd00fb6132a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:35.362872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 717/1426] 10.222.0.13 () {58 vars in 1008 bytes} [Wed Nov 10 03:49:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:35.522251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbdefe-e30e-470e-9754-fe34d7522b1d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:35.536143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbdefe-e30e-470e-9754-fe34d7522b1d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:35.541464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:35.542088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:35.542368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:35.542642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:35.551330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:35.552913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a10a-56c6-4852-b34a-4150d22093d0 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:35.561923 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 710/1427] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:37.787536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793fa3-e146-43d5-8e30-31ec6a4358e1 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:37.788102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793fa3-e146-43d5-8e30-31ec6a4358e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:37.788102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793fa3-e146-43d5-8e30-31ec6a4358e1 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:37.789899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 718/1428] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:37.797042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13ad3-233e-465e-836f-e7bf8c123fb1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:37.797487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13ad3-233e-465e-836f-e7bf8c123fb1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:37.797605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13ad3-233e-465e-836f-e7bf8c123fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:37.814789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f0a13ad3-233e-465e-836f-e7bf8c123fb1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:37.815958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f0a13ad3-233e-465e-836f-e7bf8c123fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:37.823770 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 711/1429] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:37.864552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793fa3-e146-43d5-8e30-31ec6a4358e1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:37.875249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793fa3-e146-43d5-8e30-31ec6a4358e1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:37.879213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:37.879840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:37.880114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:37.880387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:37.889507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:37.890907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d27c-ad2c-4e4b-a3a5-9527dcc0e5a3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:37.900563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 719/1430] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:40.377697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3879-3f7d-491f-98e7-0faf8257a096 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:40.378257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3879-3f7d-491f-98e7-0faf8257a096 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:40.378257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3879-3f7d-491f-98e7-0faf8257a096 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:40.380077 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 712/1431] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:40.387266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7920-c977-476b-ac58-8e82214741c8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:40.387686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7920-c977-476b-ac58-8e82214741c8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:40.387791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7920-c977-476b-ac58-8e82214741c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:40.405152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-54aa7920-c977-476b-ac58-8e82214741c8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:40.406317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-54aa7920-c977-476b-ac58-8e82214741c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:40.414411 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 720/1432] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:49:40.459298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3879-3f7d-491f-98e7-0faf8257a096 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:40.469797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3879-3f7d-491f-98e7-0faf8257a096 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:40.473924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:40.474550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:40.474830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:40.475103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:40.483870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:40.485414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327432-aed0-4553-9443-f80b35a1767d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:40.494994 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 713/1433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:43.115570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979a71b-ec42-4ee5-b318-c33ebc928051 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:43.116114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979a71b-ec42-4ee5-b318-c33ebc928051 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:43.116114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979a71b-ec42-4ee5-b318-c33ebc928051 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:43.117877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 721/1434] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:43.124797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2de2-8526-44d1-8d4a-c85a299de0b9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:43.125259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2de2-8526-44d1-8d4a-c85a299de0b9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:43.125375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2de2-8526-44d1-8d4a-c85a299de0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:43.142795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bb4d2de2-8526-44d1-8d4a-c85a299de0b9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:43.143972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb4d2de2-8526-44d1-8d4a-c85a299de0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:43.151623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 714/1435] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:43.193136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979a71b-ec42-4ee5-b318-c33ebc928051 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:43.203625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979a71b-ec42-4ee5-b318-c33ebc928051 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:43.207041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:43.207656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:43.207927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:43.208196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:43.216661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:43.218051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e6a9-3377-4549-99ad-18a76ee3b04c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:43.228060 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 722/1436] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:45.681449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:45.682017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:45.682017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:45.683764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 715/1437] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:45.690988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938313-5817-42b2-a7ca-eb5988f4116c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:45.691427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938313-5817-42b2-a7ca-eb5988f4116c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:45.691532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938313-5817-42b2-a7ca-eb5988f4116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:45.709437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7938313-5817-42b2-a7ca-eb5988f4116c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:45.710615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7938313-5817-42b2-a7ca-eb5988f4116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:45.718221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 723/1438] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:45.759592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:45.761257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:45.774334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408738b-a8ee-4826-9386-4ffa50aa14f9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:45.777742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:45.778359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:45.778658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:45.778927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:45.787971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:45.789400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda34498-d894-439f-a640-156b657aae77 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:45.798364 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 716/1439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:48.256811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f29ca-d55e-48da-aeb3-60b23a2de604 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:48.257380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f29ca-d55e-48da-aeb3-60b23a2de604 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:48.257380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f29ca-d55e-48da-aeb3-60b23a2de604 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:48.259126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 724/1440] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:48.266108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee0396-5ed9-43af-8d74-17382c71b174 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:48.266516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee0396-5ed9-43af-8d74-17382c71b174 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:48.266658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee0396-5ed9-43af-8d74-17382c71b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:48.283730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0dee0396-5ed9-43af-8d74-17382c71b174 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:48.284962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0dee0396-5ed9-43af-8d74-17382c71b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:48.292537 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 717/1441] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:48.333176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f29ca-d55e-48da-aeb3-60b23a2de604 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:48.343499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f29ca-d55e-48da-aeb3-60b23a2de604 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:48.347434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:48.348047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:48.348320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:48.348585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:48.356964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:48.358350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c30a92-b2dc-4724-a7d5-569d47a323bc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:48.368029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 725/1442] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:50.781600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc472-f8f7-40ff-9ae2-122b7668e8a0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:50.782192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc472-f8f7-40ff-9ae2-122b7668e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:50.782192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc472-f8f7-40ff-9ae2-122b7668e8a0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:50.783939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 718/1443] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:50.791262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0be8-a5a1-4e5a-9e79-7d22a6067226 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:50.791718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0be8-a5a1-4e5a-9e79-7d22a6067226 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:50.791827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0be8-a5a1-4e5a-9e79-7d22a6067226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:50.809503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-208c0be8-a5a1-4e5a-9e79-7d22a6067226 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:50.810673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-208c0be8-a5a1-4e5a-9e79-7d22a6067226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:50.818783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 726/1444] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:50.860424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bc472-f8f7-40ff-9ae2-122b7668e8a0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:50.870924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bc472-f8f7-40ff-9ae2-122b7668e8a0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:50.874378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:50.874997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:50.875272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:50.875542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:50.884667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:50.886076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6843-0523-4588-8b58-d1c193bae923 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:50.895829 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 719/1445] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:53.251988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a27a-cc88-4142-a484-1d0eaaa9f202 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:53.252530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a27a-cc88-4142-a484-1d0eaaa9f202 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:53.252530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a27a-cc88-4142-a484-1d0eaaa9f202 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:53.254384 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 727/1446] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:53.261632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3e7c-385f-46a7-aed2-4babce408406 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:53.262103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3e7c-385f-46a7-aed2-4babce408406 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:53.262207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3e7c-385f-46a7-aed2-4babce408406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:53.280789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-71db3e7c-385f-46a7-aed2-4babce408406 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:53.281962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-71db3e7c-385f-46a7-aed2-4babce408406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:53.290204 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 720/1447] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:53.331291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658a27a-cc88-4142-a484-1d0eaaa9f202 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:53.341533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658a27a-cc88-4142-a484-1d0eaaa9f202 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:53.345064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:53.345751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:53.346054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:53.346945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:53.355652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:53.357097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323546f6-d586-4f02-812a-0868b7530eaf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:53.366004 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 728/1448] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:55.700100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400369c-a369-4f44-9cac-a2d1c1f13b35 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:55.700706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400369c-a369-4f44-9cac-a2d1c1f13b35 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:55.700706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400369c-a369-4f44-9cac-a2d1c1f13b35 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:55.702427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 721/1449] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:55.710030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e914-575b-4192-bd4b-905e6aa0bb11 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:55.710469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e914-575b-4192-bd4b-905e6aa0bb11 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:55.710574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e914-575b-4192-bd4b-905e6aa0bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:55.728851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-de81e914-575b-4192-bd4b-905e6aa0bb11 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:55.730031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de81e914-575b-4192-bd4b-905e6aa0bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:55.737625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 729/1450] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:55.777112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400369c-a369-4f44-9cac-a2d1c1f13b35 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:55.787917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400369c-a369-4f44-9cac-a2d1c1f13b35 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:55.791391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:55.792005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:55.792280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:55.792546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:55.801072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:55.802475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124798b-40e3-4af6-aa5b-7fe7b3decabd service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:55.811681 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 722/1451] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:49:58.186682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4b7a-e207-44bb-b138-b2ccb7e34a21 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:58.187226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4b7a-e207-44bb-b138-b2ccb7e34a21 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:58.187226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4b7a-e207-44bb-b138-b2ccb7e34a21 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:58.189049 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 730/1452] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:49:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:49:58.196436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80791d-bb58-449f-bd55-81c17fd66b5c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:58.196863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80791d-bb58-449f-bd55-81c17fd66b5c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:58.197015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80791d-bb58-449f-bd55-81c17fd66b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:58.214314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9a80791d-bb58-449f-bd55-81c17fd66b5c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:49:58.215548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9a80791d-bb58-449f-bd55-81c17fd66b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:49:58.223865 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 723/1453] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:49:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:49:58.262832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e4b7a-e207-44bb-b138-b2ccb7e34a21 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:49:58.273840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e4b7a-e207-44bb-b138-b2ccb7e34a21 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:49:58.278928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:49:58.279916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:49:58.280318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:49:58.280594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:49:58.294086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:49:58.295584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ce71d-f831-4db8-bae5-87de12d3a182 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:49:58.305385 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 731/1454] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:49:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:00.686455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630a5a-424b-452a-82ca-89d9f8f4138d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:00.687034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630a5a-424b-452a-82ca-89d9f8f4138d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:00.687034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630a5a-424b-452a-82ca-89d9f8f4138d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:00.688864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 724/1455] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:00.696891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fcc8-d5ba-45b9-81a3-aec36540b6bf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:00.697334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fcc8-d5ba-45b9-81a3-aec36540b6bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:00.697426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fcc8-d5ba-45b9-81a3-aec36540b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:00.715718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dd59fcc8-d5ba-45b9-81a3-aec36540b6bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:00.716934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dd59fcc8-d5ba-45b9-81a3-aec36540b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:00.724457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 732/1456] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:00.764038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb630a5a-424b-452a-82ca-89d9f8f4138d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:00.774429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb630a5a-424b-452a-82ca-89d9f8f4138d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:00.777973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:00.778594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:00.778870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:00.779141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:00.788007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:00.789454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b0c7e-245a-455c-93ce-9e86244dfc6b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:00.798576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 725/1457] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:18.476003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed960a7-af9e-4f2a-97ab-8302107c7b81 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:18.476597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed960a7-af9e-4f2a-97ab-8302107c7b81 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:18.476597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed960a7-af9e-4f2a-97ab-8302107c7b81 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:18.478319 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 733/1458] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:18.484218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590458ea-bae0-4365-8172-c5851259f54d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:18.484643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590458ea-bae0-4365-8172-c5851259f54d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:18.484817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590458ea-bae0-4365-8172-c5851259f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:18.504653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-590458ea-bae0-4365-8172-c5851259f54d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:18.505824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-590458ea-bae0-4365-8172-c5851259f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:18.513465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 726/1459] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:18.562630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d079-146b-47c4-840a-c737fe077a30 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:18.562913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d079-146b-47c4-840a-c737fe077a30 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:18.563187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d079-146b-47c4-840a-c737fe077a30 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:18.565483 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 734/1460] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 10 03:50:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:18.570903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891baf3f-cd67-472a-9d59-56438e75e99d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:18.571193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891baf3f-cd67-472a-9d59-56438e75e99d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:18.571465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891baf3f-cd67-472a-9d59-56438e75e99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:18.590538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-891baf3f-cd67-472a-9d59-56438e75e99d None None] MFA Rules not processed for user `b0e3e62850b34fe786eda1156be94f74`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:18.592581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-891baf3f-cd67-472a-9d59-56438e75e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:18.599337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 727/1461] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 03:50:18 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:18.607056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d079-146b-47c4-840a-c737fe077a30 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:18.617193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d079-146b-47c4-840a-c737fe077a30 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:18.620602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:18.621240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:18.621510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:18.621779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:18.630697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:18.632078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6300-ae2c-4868-9835-80198e0f57c7 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:18.640891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 735/1462] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:21.055701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479297-1647-4732-9b39-79849cd34d91 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:21.056253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479297-1647-4732-9b39-79849cd34d91 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:21.056253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479297-1647-4732-9b39-79849cd34d91 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:21.058045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 728/1463] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:21.063859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbe1c0-3281-4421-ba80-4ba08503996d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:21.064306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbe1c0-3281-4421-ba80-4ba08503996d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:21.064447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbe1c0-3281-4421-ba80-4ba08503996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:21.083737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-aabbe1c0-3281-4421-ba80-4ba08503996d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:21.084880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-aabbe1c0-3281-4421-ba80-4ba08503996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:21.092399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 736/1464] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:21.117698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31479297-1647-4732-9b39-79849cd34d91 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:21.129719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31479297-1647-4732-9b39-79849cd34d91 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:21.134080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:21.134731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:21.134989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:21.135259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:21.136013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:21.137867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f877e7-b8d7-442d-a95c-4ccf663d9307 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:21.151734 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 729/1465] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 10 03:50:21 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:50:23.510551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9beb0-e118-4fb7-8c8e-dad17dfe6d5e None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:23.511101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9beb0-e118-4fb7-8c8e-dad17dfe6d5e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:23.511101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9beb0-e118-4fb7-8c8e-dad17dfe6d5e None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:23.512888 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 737/1466] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:23.519205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27b0-bd60-4d71-9f8d-bc33dd2fab3b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:23.519633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27b0-bd60-4d71-9f8d-bc33dd2fab3b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:23.519732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27b0-bd60-4d71-9f8d-bc33dd2fab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:23.537587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a31e27b0-bd60-4d71-9f8d-bc33dd2fab3b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:23.538755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a31e27b0-bd60-4d71-9f8d-bc33dd2fab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:23.546320 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 730/1467] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:23.591207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9beb0-e118-4fb7-8c8e-dad17dfe6d5e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:23.605754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9beb0-e118-4fb7-8c8e-dad17dfe6d5e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:23.610984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:23.611603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:23.611877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:23.612145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:23.619952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:23.621531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3039-8218-4384-aa2b-894e1eb52923 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:23.631079 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 738/1468] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:26.115759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd588b-5ee3-42f0-87c4-e1d8c81ad74b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:26.116244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd588b-5ee3-42f0-87c4-e1d8c81ad74b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:26.116244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd588b-5ee3-42f0-87c4-e1d8c81ad74b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:26.118015 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 731/1469] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:26.123890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230018-8041-44cb-8223-73ba622110b9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:26.124321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230018-8041-44cb-8223-73ba622110b9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:26.124438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230018-8041-44cb-8223-73ba622110b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:26.142789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b4230018-8041-44cb-8223-73ba622110b9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:26.143967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b4230018-8041-44cb-8223-73ba622110b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:26.151537 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 739/1470] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:26.190108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd588b-5ee3-42f0-87c4-e1d8c81ad74b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:26.200669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd588b-5ee3-42f0-87c4-e1d8c81ad74b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:26.204072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:26.205298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:26.205578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:26.205843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:26.214643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:26.216048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dde380-1ead-4322-874c-cb14ff17570f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:26.225113 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 732/1471] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:28.626210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c8e5-bc13-4de6-888a-bb52c7ee2087 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:28.626707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c8e5-bc13-4de6-888a-bb52c7ee2087 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:28.626839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c8e5-bc13-4de6-888a-bb52c7ee2087 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:28.628538 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 740/1472] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:28.634589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13013-6fd3-4b8b-b1a1-fda4c41e9539 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:28.634993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13013-6fd3-4b8b-b1a1-fda4c41e9539 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:28.635134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13013-6fd3-4b8b-b1a1-fda4c41e9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:28.652859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a3d13013-6fd3-4b8b-b1a1-fda4c41e9539 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:28.654022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a3d13013-6fd3-4b8b-b1a1-fda4c41e9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:28.662229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 733/1473] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:28.701924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c8e5-bc13-4de6-888a-bb52c7ee2087 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:28.713049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c8e5-bc13-4de6-888a-bb52c7ee2087 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:28.716597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:28.717246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:28.717525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:28.717797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:28.727156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:28.728557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097919a-250b-4804-ba2e-24148d33503d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:28.737693 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 741/1474] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:31.187150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d155d4-31d2-4c7e-a3d1-c73039321e0b None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:31.187687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d155d4-31d2-4c7e-a3d1-c73039321e0b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:31.187687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d155d4-31d2-4c7e-a3d1-c73039321e0b None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:31.189536 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 734/1475] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:31.196019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5c54-c585-4989-9eaa-0f3a1426a46e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:31.196440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5c54-c585-4989-9eaa-0f3a1426a46e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:31.196570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5c54-c585-4989-9eaa-0f3a1426a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:31.214857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3d5a5c54-c585-4989-9eaa-0f3a1426a46e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:31.216057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3d5a5c54-c585-4989-9eaa-0f3a1426a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:31.224345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 742/1476] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:50:31.267205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d155d4-31d2-4c7e-a3d1-c73039321e0b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:31.277663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d155d4-31d2-4c7e-a3d1-c73039321e0b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:31.281129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:31.281750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:31.282024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:31.282295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:31.291407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:31.292837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f14a05-4e29-443c-9d04-cb28a83b8d81 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:31.302409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 735/1477] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:50:33.839476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6947c9-c932-4476-bde2-8a51e7db56c3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:33.839907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6947c9-c932-4476-bde2-8a51e7db56c3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:33.840020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6947c9-c932-4476-bde2-8a51e7db56c3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:33.841854 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 743/1478] 10.222.0.13 () {54 vars in 926 bytes} [Wed Nov 10 03:50:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:50:33.847981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ef7a-fde2-484c-8652-2e9e1672429b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:33.848414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ef7a-fde2-484c-8652-2e9e1672429b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:33.848527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ef7a-fde2-484c-8652-2e9e1672429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:33.866269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0754ef7a-fde2-484c-8652-2e9e1672429b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:50:33.867466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0754ef7a-fde2-484c-8652-2e9e1672429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:50:33.875247 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 736/1479] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Nov 10 03:50:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:50:33.916017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6947c9-c932-4476-bde2-8a51e7db56c3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:50:33.926675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6947c9-c932-4476-bde2-8a51e7db56c3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:50:33.930136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:50:33.930747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:50:33.931045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:50:33.931313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:50:33.940827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:50:33.942221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453712ea-fea6-4f4d-a68a-6b9a36c5d833 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:50:33.951526 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 744/1480] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:50:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:51:50.113660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.114181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.114181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.131592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:51:50.132790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:50.140296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 737/1481] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:51:50.148073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.148568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.148708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.166440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:51:50.167612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:50.176140 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 745/1482] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:51:50.180403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.189772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2453-5c7d-4184-9f58-33fa7dcefc55 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.194206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.194839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.195109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.195377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.196359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:51:50.196682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.198233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.209609 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 738/1483] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:51:50.218056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.226678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e187a-9541-433e-aba1-42b8c66e9253 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.231140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.231770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.232043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.232308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.233037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.234901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.269736 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 746/1484] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:51:50.273908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.284186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641a1d3-17ee-419b-af84-f3eb653403b1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.336548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.337152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.337437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.337703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.338383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.340257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.359733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 739/1485] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:51:50.365067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.374801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d101e8-652d-4b5a-9273-cf565de9d869 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.379232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.379870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.380146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.380411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.381171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.382734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.397179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 747/1486] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:51:50.401211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.411250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736dcd-4dd6-4cf2-8e47-5a33c16e7eca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.415648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.416288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.416563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.416865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.417588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.419151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef28e74-2339-4819-b8a7-220b2713d284 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.431893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 740/1487] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:51:50.435774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.445313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa35a0-b4c8-4d5b-9d21-e212f62051ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.450193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.451125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.451433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.451700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] PATH_INFO: `/v3/projects/25ad27ca8807432e8dbb2fe1c3253eaa/users/81987a1d3b484ccba146c33c9aa47100/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.466170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ad27ca8807432e8dbb2fe1c3253eaa, user_id=81987a1d3b484ccba146c33c9aa47100, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.469455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.481813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 748/1488] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:51:50 2021] PUT /identity/v3/projects/25ad27ca8807432e8dbb2fe1c3253eaa/users/81987a1d3b484ccba146c33c9aa47100/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:51:50.492862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153ee-3f32-45fd-9874-072471e492f1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.493065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153ee-3f32-45fd-9874-072471e492f1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.493289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153ee-3f32-45fd-9874-072471e492f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.520181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-059153ee-3f32-45fd-9874-072471e492f1 None None] MFA Rules not processed for user `81987a1d3b484ccba146c33c9aa47100`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:51:50.521416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-059153ee-3f32-45fd-9874-072471e492f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:50.581193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 741/1489] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:51:50.592460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.658385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f0c96-35e9-4a54-b1db-ead0674d4ce3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.663748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.664383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.664815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.665093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.673142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.674701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.683252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 749/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:51:50 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:51:50.750254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a443cf-9c46-4d7a-93b6-7758ce23b03c None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.750539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a443cf-9c46-4d7a-93b6-7758ce23b03c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.750813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a443cf-9c46-4d7a-93b6-7758ce23b03c None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.752544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 742/1491] 10.222.0.13 () {52 vars in 829 bytes} [Wed Nov 10 03:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:51:50.756030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:50.814044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e569-0baa-4d8f-8a6f-58aee66c5303 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:50.818482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:50.819332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.819610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.819884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] PATH_INFO: `/v3/users/81987a1d3b484ccba146c33c9aa47100` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.821357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81987a1d3b484ccba146c33c9aa47100)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:50.822351 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:51:50.822351 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:51:50.822351 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:51:50.823529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:50.883850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81987a1d3b484ccba146c33c9aa47100'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:50.895972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81987a1d3b484ccba146c33c9aa47100'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:50.896628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81987a1d3b484ccba146c33c9aa47100'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:50.897335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81987a1d3b484ccba146c33c9aa47100'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:50.905786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81987a1d3b484ccba146c33c9aa47100'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:50.931632 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 750/1492] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:51:50 2021] DELETE /identity/v3/users/81987a1d3b484ccba146c33c9aa47100 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:51:50.936017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:50.937006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:50.937132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:50.954782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:51:50.955955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:51.012010 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 743/1493] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:51:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:51:51.021688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:51.023070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:51.079494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce624b7-8e51-411b-b758-3d30594b983e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:51.083153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:51.083787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:51.084064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:51.084333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:51.093120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:51.094526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36191012-052e-4b51-9979-24be3ba7b7dc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:51.103562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 751/1494] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:51:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:51:51.437225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:51:51.438685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:51:51.450528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84a9b-bb3b-4c4c-bf02-cc83f7e89346 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:51:51.455048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:51:51.455886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:51:51.456159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:51:51.456428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] PATH_INFO: `/v3/projects/25ad27ca8807432e8dbb2fe1c3253eaa` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:51:51.457649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ad27ca8807432e8dbb2fe1c3253eaa)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:51:51.458656 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:51:51.458656 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:51:51.458656 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:51:51.459820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:51:51.521310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ad27ca8807432e8dbb2fe1c3253eaa', 'request_id': 'req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:51.527136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ad27ca8807432e8dbb2fe1c3253eaa', 'request_id': 'req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:51.540464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ad27ca8807432e8dbb2fe1c3253eaa', 'request_id': 'req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:51.555587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] The token cache is being invalidate because project 25ad27ca8807432e8dbb2fe1c3253eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:51:51.555868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:51.556592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-39fd1349-fa48-4c08-a7ab-d108a8b19b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:51:51.558129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 744/1495] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:51:51 2021] DELETE /identity/v3/projects/25ad27ca8807432e8dbb2fe1c3253eaa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:54:49.001398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46e8a-5755-4965-865d-f73c27baa4eb None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:49.002006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46e8a-5755-4965-865d-f73c27baa4eb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:49.002006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46e8a-5755-4965-865d-f73c27baa4eb None None] PATH_INFO: `/v3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:49.003218 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 752/1496] 10.222.0.21 () {54 vars in 925 bytes} [Wed Nov 10 03:54:48 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:54:49.010182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6260-f1fe-49d2-9960-3cfffe7be7de None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:49.010621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6260-f1fe-49d2-9960-3cfffe7be7de None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:49.010725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6260-f1fe-49d2-9960-3cfffe7be7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:49.028801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-772f6260-f1fe-49d2-9960-3cfffe7be7de None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:54:49.030150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-772f6260-f1fe-49d2-9960-3cfffe7be7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:54:49.091550 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 745/1497] 10.222.0.21 () {58 vars in 1015 bytes} [Wed Nov 10 03:54:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:54:49.233293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e4d5-dc02-40a1-b789-aba71ae82243 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:49.233578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e4d5-dc02-40a1-b789-aba71ae82243 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:49.233847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e4d5-dc02-40a1-b789-aba71ae82243 None None] PATH_INFO: `/v3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:49.235674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 753/1498] 10.222.0.26 () {54 vars in 925 bytes} [Wed Nov 10 03:54:49 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:54:49.242899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1eef-fe50-4687-90b2-75722d5faa4e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:49.243249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1eef-fe50-4687-90b2-75722d5faa4e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:49.243624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1eef-fe50-4687-90b2-75722d5faa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:49.262647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-874d1eef-fe50-4687-90b2-75722d5faa4e None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:54:49.263757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-874d1eef-fe50-4687-90b2-75722d5faa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:54:49.272215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 746/1499] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 10 03:54:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:54:52.849387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c623-4c79-4d89-aae0-57323b5d62b1 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.849858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c623-4c79-4d89-aae0-57323b5d62b1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.850067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c623-4c79-4d89-aae0-57323b5d62b1 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.853068 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 754/1500] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:54:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:54:52.857612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9539-6813-407a-ab83-11a1666fc7e9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.858072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9539-6813-407a-ab83-11a1666fc7e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.858297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9539-6813-407a-ab83-11a1666fc7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.876475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-535f9539-6813-407a-ab83-11a1666fc7e9 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:54:52.877693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-535f9539-6813-407a-ab83-11a1666fc7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:54:52.886448 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 747/1501] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:54:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:54:52.895296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c623-4c79-4d89-aae0-57323b5d62b1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:54:52.908643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c623-4c79-4d89-aae0-57323b5d62b1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:54:52.913350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:54:52.913975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.914248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.914516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.918134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf1007-25a9-4855-ab83-df0981e18757 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.918419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf1007-25a9-4855-ab83-df0981e18757 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.918692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf1007-25a9-4855-ab83-df0981e18757 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.920504 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 748/1502] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:54:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:54:52.923155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:54:52.924726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:54:52.925657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c31f-1ea5-4729-bce8-0ef980060c66 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.925939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c31f-1ea5-4729-bce8-0ef980060c66 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.926215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c31f-1ea5-4729-bce8-0ef980060c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.934080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 755/1503] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:54:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:54:52.944510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c259c31f-1ea5-4729-bce8-0ef980060c66 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:54:52.945708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c259c31f-1ea5-4729-bce8-0ef980060c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:54:52.955676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 749/1504] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:54:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:54:52.963537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:54:52.974212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac7ad1-4d5d-4966-9d27-90e8723fc5b3 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:54:52.979282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:54:52.979993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:54:52.980313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:54:52.980675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:54:52.989095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:54:52.990993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28630b6-d555-4e23-b365-3106b7cc3ff6 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:54:53.001129 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 756/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:54:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:55:33.004471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:33.005100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:33.005100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:33.006831 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 750/1506] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 03:55:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:55:33.012361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985da49-daab-417c-8aaf-840a6d76cdf6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:33.012880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985da49-daab-417c-8aaf-840a6d76cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:33.012985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985da49-daab-417c-8aaf-840a6d76cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:33.030377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e985da49-daab-417c-8aaf-840a6d76cdf6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:55:33.032040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e985da49-daab-417c-8aaf-840a6d76cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:33.086427 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 757/1507] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 03:55:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:55:33.250897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:55:33.252826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:33.323630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d47c85-792a-4899-aa8b-13158cb78fc0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:55:33.329527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:55:33.330156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:33.330510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:33.330802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:33.338657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:55:33.340146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9137c-e335-417e-9076-ba65ca5fe7d8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:55:33.350283 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 751/1508] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:55:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:55:34.834731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27bacb-0d16-4923-926d-727d98800964 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:34.835221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27bacb-0d16-4923-926d-727d98800964 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:34.835348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27bacb-0d16-4923-926d-727d98800964 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:34.837156 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 758/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 03:55:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:55:34.842503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c450-060f-4a76-b690-30ccbfa859c5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:34.842904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c450-060f-4a76-b690-30ccbfa859c5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:34.843050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c450-060f-4a76-b690-30ccbfa859c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:34.861097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a7f6c450-060f-4a76-b690-30ccbfa859c5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:55:34.862275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7f6c450-060f-4a76-b690-30ccbfa859c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:34.869801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 752/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 03:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:55:35.027188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27bacb-0d16-4923-926d-727d98800964 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:55:35.041697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27bacb-0d16-4923-926d-727d98800964 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:55:35.046964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:55:35.047591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:35.047887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:35.048139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:35.056017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:55:35.057596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee561fc-aa97-4aec-9f57-4f35af47cb0e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:55:35.067195 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 759/1511] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:55:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:55:39.142963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:39.143626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:39.143626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:39.145449 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 753/1512] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 03:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:55:39.151254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0640-c4c5-41ef-a8ec-52bbee3c0629 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:39.151708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0640-c4c5-41ef-a8ec-52bbee3c0629 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:39.151807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0640-c4c5-41ef-a8ec-52bbee3c0629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:39.170274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-88ed0640-c4c5-41ef-a8ec-52bbee3c0629 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:55:39.171510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-88ed0640-c4c5-41ef-a8ec-52bbee3c0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:39.179400 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 760/1513] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 03:55:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:55:39.220547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:55:39.222277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:39.277172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40822b-143e-430a-bc55-9afb9a7236a4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:55:39.281264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:55:39.281896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:39.282171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:39.282439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:39.290979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:55:39.292562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de241f85-159d-4ade-bccb-7787fcc6f6f4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:55:39.301970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 754/1514] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:55:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:55:41.618730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e90a1-28e8-4cb6-94fa-51a85a2fafe7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:41.619304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e90a1-28e8-4cb6-94fa-51a85a2fafe7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:41.619304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e90a1-28e8-4cb6-94fa-51a85a2fafe7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:41.621082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 761/1515] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 03:55:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:55:41.627378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5304-326b-4fa1-8dea-836524afffd8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:41.627789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5304-326b-4fa1-8dea-836524afffd8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:41.627964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5304-326b-4fa1-8dea-836524afffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:41.646258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3fcd5304-326b-4fa1-8dea-836524afffd8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:55:41.647495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3fcd5304-326b-4fa1-8dea-836524afffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:55:41.655313 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 755/1516] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 03:55:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:55:41.695597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e90a1-28e8-4cb6-94fa-51a85a2fafe7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:55:41.706606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e90a1-28e8-4cb6-94fa-51a85a2fafe7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:55:41.710096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:55:41.710722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:55:41.710998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:55:41.711269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:55:41.719932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:55:41.721359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5cb2-6b54-41be-8bbd-e0c5d54cebca service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:55:41.730348 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 762/1517] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:55:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:56:33.501038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65007-708c-4e84-867a-4f30c287e0c9 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:56:33.501627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65007-708c-4e84-867a-4f30c287e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:56:33.501627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65007-708c-4e84-867a-4f30c287e0c9 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:56:33.503460 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 756/1518] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:56:33.509041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d17c1-c6de-4ae1-8649-e1b76792985e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:56:33.509522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d17c1-c6de-4ae1-8649-e1b76792985e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:56:33.509603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d17c1-c6de-4ae1-8649-e1b76792985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:56:33.527010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-327d17c1-c6de-4ae1-8649-e1b76792985e None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:56:33.528201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-327d17c1-c6de-4ae1-8649-e1b76792985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:56:33.537362 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 763/1519] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:56:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:02.998879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4efbf-5116-479f-9223-ace9beb7bb27 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.000031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4efbf-5116-479f-9223-ace9beb7bb27 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.000031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4efbf-5116-479f-9223-ace9beb7bb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.024030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-66d4efbf-5116-479f-9223-ace9beb7bb27 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.025260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66d4efbf-5116-479f-9223-ace9beb7bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.039607 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 757/1520] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.048243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.048815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.048815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.079301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.080494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.088000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f36037-43bd-4a3c-a38d-9d8af9c2752a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.088260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f36037-43bd-4a3c-a38d-9d8af9c2752a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.088470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f36037-43bd-4a3c-a38d-9d8af9c2752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.092726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 764/1521] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.097219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.110759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663ed1-ea43-491c-9c65-b84f0d31f53b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.115862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.116531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.116928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.117119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.117833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.118136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.119749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.121050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a7f36037-43bd-4a3c-a38d-9d8af9c2752a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.122240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7f36037-43bd-4a3c-a38d-9d8af9c2752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.140306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 765/1522] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:57:03.142427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 758/1523] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.148173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.151062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.151351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.151623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.160977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1bd6-9c60-460b-81f5-aeda946db7c5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.174443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.174997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.175292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.175547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.176583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.178618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc148da-e34f-4337-a093-3b810059f7b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.178824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.179983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.197439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 759/1524] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:03.198358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.216128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72682748-b3a4-4f35-b658-362404ce07bd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.230541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.231200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.231475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.231745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.232476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.241286 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 766/1525] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:03.242685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592f947-0aaa-47de-a296-39ff308e7b81 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.242977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592f947-0aaa-47de-a296-39ff308e7b81 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.243256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592f947-0aaa-47de-a296-39ff308e7b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.244248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.245890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.274917 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 760/1526] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:03.278927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.293618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1592f947-0aaa-47de-a296-39ff308e7b81 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.294968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1592f947-0aaa-47de-a296-39ff308e7b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.301921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b812a4-0f5e-41e6-884b-aac293d779a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.397966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.399414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.400043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.400538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.401601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.403727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.431259 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 767/1527] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.432719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a6ff-00d0-47c6-aa42-e4999b9e0102 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.433015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a6ff-00d0-47c6-aa42-e4999b9e0102 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.433291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a6ff-00d0-47c6-aa42-e4999b9e0102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.448862 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 761/1528] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:03.450048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.462210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7ac8a6ff-00d0-47c6-aa42-e4999b9e0102 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.463040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ac8a6ff-00d0-47c6-aa42-e4999b9e0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.471514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dd641-dad8-4092-8b9f-0a533d46c338 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.482179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.483153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.484924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.485434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.486933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.489414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd53b6-99cc-440c-976a-2e09105f676f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.491305 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 768/1529] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.498550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.499281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.499789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.524518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.526011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.538391 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 762/1530] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:03.539848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6393d1-a5d7-4eaa-9bf0-5def6d2f7d0e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.540134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6393d1-a5d7-4eaa-9bf0-5def6d2f7d0e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.540455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6393d1-a5d7-4eaa-9bf0-5def6d2f7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.542576 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 769/1531] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.543726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.554281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f7c69-5102-468a-bd18-76d662eb9d48 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.562422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ed6393d1-a5d7-4eaa-9bf0-5def6d2f7d0e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.563756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed6393d1-a5d7-4eaa-9bf0-5def6d2f7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.613521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.614176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.614453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.614736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.615469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.617097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa992-811d-442e-83f5-eb39bae2031b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.625247 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 763/1532] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.626853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134052-c0f1-4ed6-a9aa-5e7355b02772 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.627146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134052-c0f1-4ed6-a9aa-5e7355b02772 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.627419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134052-c0f1-4ed6-a9aa-5e7355b02772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.630842 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 770/1533] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:03.632515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.633046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.633988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.645688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b0134052-c0f1-4ed6-a9aa-5e7355b02772 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.646883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0134052-c0f1-4ed6-a9aa-5e7355b02772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.660519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.661645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.662430 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 764/1534] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.663988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c3e1-4ba2-483a-bfc8-223e41d97eae None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.663988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c3e1-4ba2-483a-bfc8-223e41d97eae None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.665667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c3e1-4ba2-483a-bfc8-223e41d97eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.669908 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 771/1535] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.670719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.680837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43c6f9-0554-449e-aa14-8f7c4b8c708e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.684168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ad83c3e1-4ba2-483a-bfc8-223e41d97eae None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.685294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.685449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ad83c3e1-4ba2-483a-bfc8-223e41d97eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.685939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.686225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.686498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.687232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.689160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.693182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 765/1536] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.694377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.694657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.694922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.709805 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 772/1537] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:03.710737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.714852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.716060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.720523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaffef-1e36-4d82-95cb-afc2afabdbf4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.724570 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 766/1538] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.725271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.728038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.728967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.729251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.729528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.730271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.730577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.732214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add7c-062f-4f8d-8329-5c93c1b33544 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.735007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80bf81-c409-49c9-8b61-22afb2466477 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.739575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.740209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.740489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.740792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.741519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.743822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73412195-9192-4d9c-b002-ef99b42670b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.745539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 773/1539] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:03.746774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.747055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.747327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.760999 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 767/1540] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:03.762536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8346a-5dfc-4fb4-aea6-10a13eed74cd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.762919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8346a-5dfc-4fb4-aea6-10a13eed74cd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.763307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8346a-5dfc-4fb4-aea6-10a13eed74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.763676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.764963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.772810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 774/1541] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.776592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.782019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-94d8346a-5dfc-4fb4-aea6-10a13eed74cd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.783352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94d8346a-5dfc-4fb4-aea6-10a13eed74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.786808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559b56-50b1-448a-aa1d-63f548e9c17f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.791362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 768/1542] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.791502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.792226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.792547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.792866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.792988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.793165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.793273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.793904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.794212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.796582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.808663 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 775/1543] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:03.809484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.815742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.817163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.818870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10495-e77f-4993-9728-fe1364e1528e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.829613 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 769/1544] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.829613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.831224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.831446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.831738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.832001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.832806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.834391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.839046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463641d-fae0-4f4b-9709-cde6e06a9176 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.844180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.844858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.845131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.845232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 776/1545] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:03.845417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.845971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.846147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.846411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.847970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.855195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec5b38-0ebf-49f1-9f3c-7c980e38c973 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.859339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 770/1546] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:03.860089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.866601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.867231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.867504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.867768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.868490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.870367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2744-8ce2-42fd-b343-7a18e173d61f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.874609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610962ac-cd65-4d05-961d-374fdc3c72a5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.879179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.880030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.880300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.880567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] PATH_INFO: `/v3/projects/461dfa2013f345e7a5363c5a3ec3dcd7/users/1bd1c783ebc8445fbb2ce7e519fc5e9f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.895173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461dfa2013f345e7a5363c5a3ec3dcd7, user_id=1bd1c783ebc8445fbb2ce7e519fc5e9f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.895381 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 777/1547] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:03.896668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.896949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.897214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.897832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.911948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 771/1548] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:03 2021] PUT /identity/v3/projects/461dfa2013f345e7a5363c5a3ec3dcd7/users/1bd1c783ebc8445fbb2ce7e519fc5e9f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:03.912756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.916118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:03.917344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:03.975178 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 778/1549] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:03.979031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:03.981562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03b61-1785-4138-9993-3d747430ded7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.985716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270e4e-2911-4a9c-9781-5afe33e3e09c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:03.986977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.987799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.988114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.988389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.989145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:03.989449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.990330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:03.990968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:03.991126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:03.991266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:03.991516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:03.992216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:03.994103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.002907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 772/1550] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:04.003778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.013482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5c4c7-bc5d-4b3a-9f7d-1d0146f2fe61 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.018686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.019329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.019609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.019880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.020300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 779/1551] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:03 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.020693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:04.021054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.021519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.022632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.035109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 773/1552] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:04.035937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.045122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe30d8-44a4-43b5-a55a-24fbf8458bfe admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.082416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b9c3-addf-4093-b0e8-d1d91d5efb93 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.087056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.087708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.087987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.088262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.089028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.090655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.098573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.099353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.099718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.100179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.100828 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 780/1553] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.101813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.105185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.105621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188510d2-40c3-463f-9096-22c65fffccf0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.119095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202dac-63f7-43a0-97f6-2e22285591f7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.123870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.124570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.124967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.125175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.125914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.128062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.135653 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 774/1554] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.136969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.140206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.140206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.151701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 781/1555] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.152521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.162737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aea8a-25fa-48af-aaa6-3199a421a5ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.166047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] MFA Rules not processed for user `1bd1c783ebc8445fbb2ce7e519fc5e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:04.167233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:04.216324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.217023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.217297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.217690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.219173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:04.219477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.221114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.230055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 775/1556] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:04.230958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.233176 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 782/1557] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:04.234218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.251163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46af8-e1e7-408f-99d6-b00ceea0e4cd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.252331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1c15-e623-4fc7-886b-3dce8e36ee17 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.256245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.256750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.257026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.257440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.258119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.258301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.258964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.259356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.259788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.260591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.260730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.262815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.284580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 783/1558] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.285403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.288959 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 776/1559] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.289897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.295159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266785-0137-4ff7-835d-1e785d9e2029 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.348383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3abf45-9ead-446c-849c-feb972231082 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.349398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.350055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.350331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.350602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.351299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.353183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.353308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.354083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.354364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.354639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] PATH_INFO: `/v3/projects/0a1c76a9ed644e47800602cf6ba9cdfe/users/c35e7651ebfa4fdb959186dd4a59fc66/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.368776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1c76a9ed644e47800602cf6ba9cdfe, user_id=c35e7651ebfa4fdb959186dd4a59fc66, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.371444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.379356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 784/1560] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.380281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.394385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 777/1561] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:04 2021] PUT /identity/v3/projects/0a1c76a9ed644e47800602cf6ba9cdfe/users/c35e7651ebfa4fdb959186dd4a59fc66/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:04.394385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.445762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196faf9-720e-4427-954b-0cff3e720318 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.456443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f952-b8df-4d41-af23-db08835a326f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.461088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.461745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.462018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.462288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.463008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.464578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.474236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 778/1562] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.475353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.488176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c12350-e0c9-4121-bfde-024c925e4f70 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.492809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.493447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.493726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.493999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.494686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.496633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.500537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.501237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.501517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.501795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.502497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.504404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.523108 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 779/1563] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.523984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.524389 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 785/1564] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.525793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.535561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204289-a919-48c3-9896-f1c5350e6fe7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.584630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e595-21f7-4d64-8634-5b51c6387aea admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.589367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.589726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.590169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.590382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.590575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.590671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.590919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.591058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.591646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.591763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.593279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.593680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.603197 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 786/1565] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.605464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.616428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461ea80-2a56-417a-b89e-229e936eaf75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.622070 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 780/1566] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.622070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.622961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.623658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.623939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.624823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.625545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.627468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf958-0d81-4951-a53f-eae04277e608 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.647134 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 787/1567] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.648692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.648976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.649247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.675124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] MFA Rules not processed for user `c35e7651ebfa4fdb959186dd4a59fc66`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:04.676383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:04.681666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdc64-24ed-42c5-90fb-6e53eb26a1b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.686538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489da17-0895-4829-8507-3ada855628de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.687702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489da17-0895-4829-8507-3ada855628de admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.687982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489da17-0895-4829-8507-3ada855628de admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.688258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489da17-0895-4829-8507-3ada855628de admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.689001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489da17-0895-4829-8507-3ada855628de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.690891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489da17-0895-4829-8507-3ada855628de admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.711064 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 781/1568] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.711639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489da17-0895-4829-8507-3ada855628de admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.720720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489da17-0895-4829-8507-3ada855628de admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.725408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.726049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.726327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.726607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.727331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.728934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.739751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 782/1569] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.740279 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 788/1570] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:04.741110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.741243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.751677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae62d2-94d3-499d-ade1-cd6aabc1c71a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.753947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eb91e-5b6b-4c55-8d24-f85bca5bd8a1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.756309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.756989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.757268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.757540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.758230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.758551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.759194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.759473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.759747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.760088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.760479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.762078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.771844 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 789/1571] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.771844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.780163 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 783/1572] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.781300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.785482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5857aa-c5ee-48b2-a640-7fe00993700d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.790089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.790671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d292d4-4606-420a-b371-d14d6628637c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.790786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.790993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.791267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.791990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.793617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.795256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.796419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.796746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.797014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.797688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.799530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.804568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 790/1573] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.808266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.818212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0815c-3030-4894-a318-da2d272e931f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.822949 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 784/1574] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.823069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.823647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.823754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.823928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.824202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.825012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.826575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.836751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb116-d0c1-4ca1-9e51-a68b7759f61e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.840214 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 791/1575] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.842546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.845466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.846125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.846402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.846680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.847415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.849031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.851701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4954-5bee-44ae-881e-71aef4843a94 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.856236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.856922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.857202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.857473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.858165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.860506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.861023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 785/1576] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.864813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.873873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e274e-9459-497d-8065-2daed9d5a7b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.879587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.880485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.880797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.881068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] PATH_INFO: `/v3/projects/3f8e7740b4ef428f9ad247019be4f89f/users/78ca9cfb120e40eba4be137b26f105f9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.888694 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 792/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:04 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:04.888694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.895677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8e7740b4ef428f9ad247019be4f89f, user_id=78ca9cfb120e40eba4be137b26f105f9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.898305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.913375 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 786/1578] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:04 2021] PUT /identity/v3/projects/3f8e7740b4ef428f9ad247019be4f89f/users/78ca9cfb120e40eba4be137b26f105f9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:04.914227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.945972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a71c-3196-4b5b-8a50-97443208a8dc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.977582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf5d5-a628-4973-9f25-fb5309ab887a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:04.982145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:04.982794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:04.983071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:04.983367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:04.984653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:04.986229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:04.995733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 787/1579] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:04.999500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:04.999769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.000437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.000749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.001023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.001746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.003301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.008876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2258-36c6-4e4e-a11b-9ed3894d05c5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.016251 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 793/1580] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.016407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.016520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.016674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.016674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.016674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] PATH_INFO: `/v3/projects/339eb11906014f7c862dbbb62ca29698/users/f9a1cd1d3e4243499dac48ce3e3dff7c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.025719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f305aec-3808-4877-b9e6-e622e13878fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.030826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.031264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=339eb11906014f7c862dbbb62ca29698, user_id=f9a1cd1d3e4243499dac48ce3e3dff7c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.031543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.031824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.032095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.032846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.033904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.034377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.044462 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 794/1581] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.045280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.047816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 788/1582] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:04 2021] PUT /identity/v3/projects/339eb11906014f7c862dbbb62ca29698/users/f9a1cd1d3e4243499dac48ce3e3dff7c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.048525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.060376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72410641-d05e-4a3d-8e41-bd41d6ef0a18 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.105849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e2599-0429-4b71-9785-043adedefa9c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.111403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.112051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.112378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.112596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.113375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.114207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.114927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.115024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.115207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.115483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.116264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.117891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf978e-c41b-4c2c-8896-7e7a0356b551 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.124412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 789/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.125279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.128033 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 795/1584] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.129746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.130107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.130382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.139723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d452d5-d372-4232-a9e8-b596095b3bb4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.144318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.144999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.145276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.145545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.146298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.148180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.155139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] MFA Rules not processed for user `78ca9cfb120e40eba4be137b26f105f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.156903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.168104 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 790/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:05.169003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.180328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4a023-a16b-4ff5-8439-57207b64e5e8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.185052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.185678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.185954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.186226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.186974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.188532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.198499 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 791/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.199385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.208326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb350-b600-43c1-9e18-929a5dc498fb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.212888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.213715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.213988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.214258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] PATH_INFO: `/v3/projects/2b50d34b9bae42878e3fc0ebe3018c95/users/5cf45a07294245c9bf0cf8bc554d6385/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.227790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 796/1587] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.227790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.229432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b50d34b9bae42878e3fc0ebe3018c95, user_id=5cf45a07294245c9bf0cf8bc554d6385, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.232029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d099ec-df7f-4f3d-8e66-6417e86cc8a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.236091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bd85f-a271-45ba-bc1d-3b9c6ee1b52c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.240774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.241661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.241927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.242197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] PATH_INFO: `/v3/projects/a6ffd10bef4647a88193c928734c21e6/users/37116e7eca5d40ed9abe470334be0602/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.247802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 792/1588] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/2b50d34b9bae42878e3fc0ebe3018c95/users/5cf45a07294245c9bf0cf8bc554d6385/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.249183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.249530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.250287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.256448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ffd10bef4647a88193c928734c21e6, user_id=37116e7eca5d40ed9abe470334be0602, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.259078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.272031 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 797/1589] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/a6ffd10bef4647a88193c928734c21e6/users/37116e7eca5d40ed9abe470334be0602/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.273473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.277121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] MFA Rules not processed for user `f9a1cd1d3e4243499dac48ce3e3dff7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.278320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.332820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984479e2-da1e-401b-810e-9be92d47d562 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.337506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.338455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.338805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.339078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] PATH_INFO: `/v3/projects/ab88bff9418941ccb7f2042cc8b2080e/users/340283bb618c43c1bb1b03a2f12b0717/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.345225 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 793/1590] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.345225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.351855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bc00-b1d6-44b9-b538-470cd641c6a4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.356584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.357478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.357752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.357982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab88bff9418941ccb7f2042cc8b2080e, user_id=340283bb618c43c1bb1b03a2f12b0717, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.358100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] PATH_INFO: `/v3/projects/d65047a5d8ed4c359989170ef998fe5d/users/8b3a06a02ba6459088397115452f50c1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.360602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.372105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65047a5d8ed4c359989170ef998fe5d, user_id=8b3a06a02ba6459088397115452f50c1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.373481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 798/1591] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/ab88bff9418941ccb7f2042cc8b2080e/users/340283bb618c43c1bb1b03a2f12b0717/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.374310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.374778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.387933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 794/1592] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/d65047a5d8ed4c359989170ef998fe5d/users/8b3a06a02ba6459088397115452f50c1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.388804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.435236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05cc2-ff80-4b57-be01-0b53ef6c1342 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.448132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538aec3-e6d4-4dfe-aea2-52c5f5c39f4b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.453298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.454174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.454459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.454725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] PATH_INFO: `/v3/projects/a80ba1af7939454d9e27540022b25f3c/users/9ce74759f04041d3aff19617232e66c8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.469423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80ba1af7939454d9e27540022b25f3c, user_id=9ce74759f04041d3aff19617232e66c8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.472233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.484881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 795/1593] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/a80ba1af7939454d9e27540022b25f3c/users/9ce74759f04041d3aff19617232e66c8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.485560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.493527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.494725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.495232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.495733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.497184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.500336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32125-c733-4360-83ce-c0067f136fd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.517462 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 799/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.517462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.517462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.517462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.541392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] MFA Rules not processed for user `5cf45a07294245c9bf0cf8bc554d6385`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.542605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.549771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e5d-6954-4d46-bac9-9cb51a827346 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.554379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.555024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.555303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.555597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.556269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.558168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.583963 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 796/1595] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:05.584886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.605668 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 800/1596] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.606741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.608071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.643888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05503257-381a-41cc-b864-edfc72a504dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.648489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.649176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.649447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.649715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.650433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.651991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559f237-d890-4933-aaca-955db8984c87 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.661077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e054c5-bd63-4618-8929-8558e8b604c5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.662030 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 797/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:05.663161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15863-52cf-4cef-b59f-4eda71e27aee None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.663454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15863-52cf-4cef-b59f-4eda71e27aee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.663714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15863-52cf-4cef-b59f-4eda71e27aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.688595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-72e15863-52cf-4cef-b59f-4eda71e27aee None None] MFA Rules not processed for user `340283bb618c43c1bb1b03a2f12b0717`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.689807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72e15863-52cf-4cef-b59f-4eda71e27aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.707059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.707701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.707979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.708249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.750581 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 798/1598] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.752044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.752332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.752627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.761613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.763025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f0f6-6e8b-4780-9964-43ba8396d215 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.772638 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 801/1599] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:05.774097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.774386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.774686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.778060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] MFA Rules not processed for user `8b3a06a02ba6459088397115452f50c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.779255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.801153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] MFA Rules not processed for user `9ce74759f04041d3aff19617232e66c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:05.802422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:05.853718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 799/1600] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.854615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.864771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ced5a-e651-4cee-8f9b-5c6cc57e4ebc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.869369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.870235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.870523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.870795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] PATH_INFO: `/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0/users/0c6ae21a09804e7eaf668cb2b8839255/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.872891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 802/1601] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:05.873562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.885037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d58a1-b1f5-443d-91f7-47bf6927cd8d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.887181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddcf2e4b5984bf19e0ed716dd3f68a0, user_id=0c6ae21a09804e7eaf668cb2b8839255, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.890430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.890741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.891114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.891397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.891844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.892567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.894549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.906469 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 800/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0/users/0c6ae21a09804e7eaf668cb2b8839255/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:05.907640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.920715 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 803/1603] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/users => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:05.920715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:05.930888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb447e-4cae-4aee-a6d5-1f35ca981cc3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.977266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc3f2-bd9c-481f-9ec3-e56b78f91b6c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:05.983499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.984186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.984468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.984776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.985485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.987436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:05.990027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:05.990876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:05.991180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:05.991438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] PATH_INFO: `/v3/projects/a6ffd10bef4647a88193c928734c21e6/users/37116e7eca5d40ed9abe470334be0602/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:05.993473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ffd10bef4647a88193c928734c21e6, user_id=37116e7eca5d40ed9abe470334be0602, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:05.996217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.013944 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 804/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:05 2021] PUT /identity/v3/projects/a6ffd10bef4647a88193c928734c21e6/users/37116e7eca5d40ed9abe470334be0602/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.013944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.019549 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 801/1605] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:05 2021] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.020382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.081943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eddf8c-cae1-4de9-a303-b25a1e57f6d5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.084977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b6e9d-31bb-4537-b077-a5fb374eaeca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.087405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.088028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.088316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.088583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.089318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.090274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.091027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.091270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.091380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.091645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.092336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.094518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.123027 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 802/1606] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.128121 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 805/1607] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.128599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.132261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.190899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162411a-c7f0-4d7f-8cc3-bcbf1304c9eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.199798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.200229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09edf1-7614-4f11-ad93-6e9c5277f916 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.200492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.200797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.201074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.201868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.203805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfa491-3948-4837-a59f-2ef0dbaac463 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.205393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.206060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.206343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.206621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.207363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.208984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.218952 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 806/1608] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.219810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.229989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1df45-e745-416f-a610-a526dd208356 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.234393 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 803/1609] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.234393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.234393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.234393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.259747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] MFA Rules not processed for user `37116e7eca5d40ed9abe470334be0602`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:06.261069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.284172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.284652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.284936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.285209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.285965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.287556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.297672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 807/1610] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.298440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.307506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523dd86-9052-4e28-9825-4b487392c935 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.312974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.313611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.313891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.314160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.314849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.316724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.327942 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 804/1611] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:06.329872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.337871 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 808/1612] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/users => generated 305 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.341452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.342814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c931075-73bb-49b3-96a0-5849c548b094 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.348083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.348897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.349251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.349528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.350260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.350875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef6db-9192-40d5-8c99-c8bda318790c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.352152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.355469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.356111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.356390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.356689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.357383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.359829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.372575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 805/1613] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.373412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.381688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 809/1614] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.383029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.383349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f358cb-9c79-49ae-8088-6dbd31d60a24 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.388194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.389081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.389377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.389663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] PATH_INFO: `/v3/users/f9a1cd1d3e4243499dac48ce3e3dff7c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.390860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a1cd1d3e4243499dac48ce3e3dff7c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.391875 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:57:06.391875 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:57:06.391875 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:57:06.393090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.393965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4837c6-40ce-4d60-9173-2f07ddf79ecf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.398518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.399395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.400009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.400285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] PATH_INFO: `/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0/users/0c6ae21a09804e7eaf668cb2b8839255/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.402270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddcf2e4b5984bf19e0ed716dd3f68a0, user_id=0c6ae21a09804e7eaf668cb2b8839255, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.404847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.417159 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 810/1615] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0/users/0c6ae21a09804e7eaf668cb2b8839255/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.428915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.459413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a1cd1d3e4243499dac48ce3e3dff7c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:06.469363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a1cd1d3e4243499dac48ce3e3dff7c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:06.470037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a1cd1d3e4243499dac48ce3e3dff7c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:06.488568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a1cd1d3e4243499dac48ce3e3dff7c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:06.492230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98b29f-7f72-48a4-9e82-a8868e9a75ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.496676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a1cd1d3e4243499dac48ce3e3dff7c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:06.497336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.497996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.498273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.498622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.499244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.501170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.505879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 806/1616] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:06 2021] DELETE /identity/v3/users/f9a1cd1d3e4243499dac48ce3e3dff7c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.505879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.505879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.523982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 811/1617] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:06.523982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.524368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.536564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eab5a-fa0d-4b70-91c0-a1bf137afc05 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.567722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ba77-e496-4e18-88c0-fbcab8f286c9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.572960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.573832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.601643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.601643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] PATH_INFO: `/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2/users/0409aaa5209748f7a8f8f1513328e2bc/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.601643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f82f9d3fa472ba49fe68bb575f2e2, user_id=0409aaa5209748f7a8f8f1513328e2bc, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.602118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.602118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.602118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.602118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.602424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.602494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.602579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdad6a-0f23-4992-abbf-8f37b0dff056 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.607590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 812/1618] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.609509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.609796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.610075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.611738 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 813/1619] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:57:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:06.612460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.615977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 807/1620] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2/users/0409aaa5209748f7a8f8f1513328e2bc/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.615977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.615977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.617430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.675998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0770-40c3-4cc3-a9db-af6772e175ed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.680513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8de31d-bbe4-4dd5-b766-58ff4d2233c0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.680743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.681403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.681685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.681962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.682697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.684297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ce40b-26e2-4b74-bba6-e7677fae10d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.685158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.685808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.686094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.686366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.687120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.688792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b848f1-be56-460c-81b8-a832b14d38c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.694044 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 808/1621] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.698360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.698914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.699041 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 814/1622] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.700027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.700307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.700579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.702295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.718721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:06.719911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.727771 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 815/1623] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:06.728535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.728810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] MFA Rules not processed for user `0c6ae21a09804e7eaf668cb2b8839255`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:06.729808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.729984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.741521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a17163-1c3d-4457-8db2-30a24f413578 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.746260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.746935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.747214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.747487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.748213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.749842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.759450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 816/1624] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.760192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.769162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea7a8-7ab0-43fe-8345-4ab976cf19fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.773716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.774539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.774815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.775086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] PATH_INFO: `/v3/projects/129fd04869494cf59aed6dbd71b4d984/users/a25d6ef4e6c844f59aa5750fa33796f1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.789635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129fd04869494cf59aed6dbd71b4d984, user_id=a25d6ef4e6c844f59aa5750fa33796f1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.792289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d03fa-380b-4e49-95a4-9137d01c9680 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.809295 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 809/1625] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:06.810490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.815845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 817/1626] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/129fd04869494cf59aed6dbd71b4d984/users/a25d6ef4e6c844f59aa5750fa33796f1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.818540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.819016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.819304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.822504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb346bd-1111-4e0e-b2b2-8fc496a0939d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.843694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:06.844909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.878328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.879124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.879507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.879880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.880785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.882469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.892763 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 810/1627] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:06.893615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.902999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442c76-ece2-41a6-92ad-110813f43eb4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.908087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.908967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.909241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.909514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] PATH_INFO: `/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2/users/d900351de0054c81baac94f55a98b955/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.912909 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 818/1628] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:57:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:06.913734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.923766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbad3a0c439401ea9505edb4bfc7cc2, user_id=d900351de0054c81baac94f55a98b955, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.924172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c6d3-f4f7-4887-b1c0-dcd738658716 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:06.926403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.928778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:06.929676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:06.929980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:06.930255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] PATH_INFO: `/v3/projects/417caf0eb5534bdda2823c49b2d3418c/users/2126c9ab84b84a0f90f724a3398ae825/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:06.939427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 811/1629] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2/users/d900351de0054c81baac94f55a98b955/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.940446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.943311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:06.946323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] RBAC: Authorizing `identity:create_grant(project_id=417caf0eb5534bdda2823c49b2d3418c, user_id=2126c9ab84b84a0f90f724a3398ae825, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:06.949265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:06.963053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 819/1630] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/417caf0eb5534bdda2823c49b2d3418c/users/2126c9ab84b84a0f90f724a3398ae825/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:06.964086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:06.999967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b2e6-c704-496c-ad49-aa59feb2a04b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.022086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acfe6c-3179-48d9-a0bb-ef1fa54b269a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.026569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.027445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.027723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.028000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] PATH_INFO: `/v3/projects/7a916eb456a64773ae0abf746e32e1b6/users/916e27d4e40447c1b10385466fba2148/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.042504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a916eb456a64773ae0abf746e32e1b6, user_id=916e27d4e40447c1b10385466fba2148, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.045126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.048354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.049179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.049323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.049615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.058536 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 820/1631] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:06 2021] PUT /identity/v3/projects/7a916eb456a64773ae0abf746e32e1b6/users/916e27d4e40447c1b10385466fba2148/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.058759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.059326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.060261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d294212-a175-4e65-a9a8-d471c1ade753 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.069895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 812/1632] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:07.071303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac6d6-7f05-424c-9b90-fd547695b427 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.071590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac6d6-7f05-424c-9b90-fd547695b427 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.072134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac6d6-7f05-424c-9b90-fd547695b427 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.073967 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 813/1633] 10.222.0.13 () {54 vars in 960 bytes} [Wed Nov 10 03:57:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:07.074580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac6d6-7f05-424c-9b90-fd547695b427 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.125566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151d94f-4015-47f2-a172-5635aa85cf1f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.130823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.131519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.132117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.132223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.133012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.134597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.142851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac6d6-7f05-424c-9b90-fd547695b427 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.146638 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 821/1634] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:07.148137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.149291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.149709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.149806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.150228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] PATH_INFO: `/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2/users/0409aaa5209748f7a8f8f1513328e2bc/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.152311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f82f9d3fa472ba49fe68bb575f2e2, user_id=0409aaa5209748f7a8f8f1513328e2bc, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.154957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.176326 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 814/1635] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:07 2021] PUT /identity/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2/users/0409aaa5209748f7a8f8f1513328e2bc/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.176326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.227494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce9a7-09de-4f97-acfa-a1b592dfd481 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.244800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3c20b-bdb8-45db-8ec6-067e7e2f6df7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.254606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.255403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.255877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.256308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.257181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.259084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.271309 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 815/1636] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:07.272404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.283811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267581c-c872-4a56-a7c2-28950f2ccdb2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.289424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.290082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.290359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.290665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.291377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.293096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.300383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.301202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.301588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.301964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.303510 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 816/1637] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:07.303970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.305624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.319913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280f6fe-185c-4787-a233-5e163a5fb976 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.325045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.325697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.325974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.326248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.327037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.329165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328896d-3346-4c6b-98d2-4e90d4aaecbc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.340523 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 817/1638] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:07.342232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.342519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.343162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.361802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.363017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.372673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 818/1639] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:07.373444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.373853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.376110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de676-861b-44fe-9655-57cda42aaf2c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.384700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775836e3-6490-4069-b229-96dfa0ba0bad None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.388492 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 822/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:07.391121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.391546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.392009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.392293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.392830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.393242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.393696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] PATH_INFO: `/v3/projects/129fd04869494cf59aed6dbd71b4d984/users/a25d6ef4e6c844f59aa5750fa33796f1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.395873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=129fd04869494cf59aed6dbd71b4d984, user_id=a25d6ef4e6c844f59aa5750fa33796f1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.398881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.414269 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 819/1641] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:07 2021] PUT /identity/v3/projects/129fd04869494cf59aed6dbd71b4d984/users/a25d6ef4e6c844f59aa5750fa33796f1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.415064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.437649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] MFA Rules not processed for user `0409aaa5209748f7a8f8f1513328e2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.438983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.509102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfddf1-d743-4379-9577-bc288302d5da admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.514121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.515809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.516158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.516501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] PATH_INFO: `/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2/users/d900351de0054c81baac94f55a98b955/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.519245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbad3a0c439401ea9505edb4bfc7cc2, user_id=d900351de0054c81baac94f55a98b955, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.522155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.523889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 823/1642] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:07.524798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.540173 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 820/1643] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:07 2021] PUT /identity/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2/users/d900351de0054c81baac94f55a98b955/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.540173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.542480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a310e-2d6e-40bb-914f-da5b1a96b106 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.598749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.599547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.599817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.600086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] PATH_INFO: `/v3/projects/417caf0eb5534bdda2823c49b2d3418c/users/2126c9ab84b84a0f90f724a3398ae825/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.602159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417caf0eb5534bdda2823c49b2d3418c, user_id=2126c9ab84b84a0f90f724a3398ae825, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.602945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c105f-5121-4f49-b297-9632d0a1260d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.604755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.607829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.609422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.609771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.610113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] PATH_INFO: `/v3/projects/7a916eb456a64773ae0abf746e32e1b6/users/916e27d4e40447c1b10385466fba2148/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.612164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a916eb456a64773ae0abf746e32e1b6, user_id=916e27d4e40447c1b10385466fba2148, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.614946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.615461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 824/1644] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:07 2021] PUT /identity/v3/projects/417caf0eb5534bdda2823c49b2d3418c/users/2126c9ab84b84a0f90f724a3398ae825/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.617656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.626611 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 821/1645] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:07 2021] PUT /identity/v3/projects/7a916eb456a64773ae0abf746e32e1b6/users/916e27d4e40447c1b10385466fba2148/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.627567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.629252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.692859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194499b-73a7-4362-95a0-a1c0398da81f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.698315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.698730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a5f-0b1b-4e98-a1b9-2be5bd4c07c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:07.699173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.699571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.699850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] PATH_INFO: `/v3/projects/339eb11906014f7c862dbbb62ca29698` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.701192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339eb11906014f7c862dbbb62ca29698)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.703096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.760852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339eb11906014f7c862dbbb62ca29698', 'request_id': 'req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:07.766184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339eb11906014f7c862dbbb62ca29698', 'request_id': 'req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:07.772141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:07.772290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339eb11906014f7c862dbbb62ca29698', 'request_id': 'req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:07.772818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.773100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.773376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.785016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] The token cache is being invalidate because project 339eb11906014f7c862dbbb62ca29698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:07.785625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:07.786507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e8fe45d-b608-4eb6-b3a9-fc31ac225eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:07.788792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 822/1646] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:07 2021] DELETE /identity/v3/projects/339eb11906014f7c862dbbb62ca29698 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:07.790340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696720ef-011d-45fc-91d5-aaa26222ffb5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.791045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696720ef-011d-45fc-91d5-aaa26222ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.791314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696720ef-011d-45fc-91d5-aaa26222ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.819346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-696720ef-011d-45fc-91d5-aaa26222ffb5 None None] MFA Rules not processed for user `a25d6ef4e6c844f59aa5750fa33796f1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.820527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-696720ef-011d-45fc-91d5-aaa26222ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.840067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:07.841663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867c3d0-456f-4fa5-a90c-d0ae1a223bfc service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:07.851159 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 825/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:07.853490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b999f-8726-4743-8b68-61bc08b9c58f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.853794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b999f-8726-4743-8b68-61bc08b9c58f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.854179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b999f-8726-4743-8b68-61bc08b9c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.881487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-550b999f-8726-4743-8b68-61bc08b9c58f None None] MFA Rules not processed for user `d900351de0054c81baac94f55a98b955`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.882684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-550b999f-8726-4743-8b68-61bc08b9c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.889462 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 823/1648] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:07.891389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.891822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.892236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.923619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] MFA Rules not processed for user `2126c9ab84b84a0f90f724a3398ae825`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.925467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.954742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 826/1649] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:07.956388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34839f4-a3e9-4544-954a-5d52fcd2ef64 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:07.956849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34839f4-a3e9-4544-954a-5d52fcd2ef64 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:07.957253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34839f4-a3e9-4544-954a-5d52fcd2ef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:07.984688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e34839f4-a3e9-4544-954a-5d52fcd2ef64 None None] MFA Rules not processed for user `916e27d4e40447c1b10385466fba2148`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:07.986124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e34839f4-a3e9-4544-954a-5d52fcd2ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:07.995694 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 824/1650] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:07.996557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:07.997835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.054477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 827/1651] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:07 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:08.055861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efdae2-cf0e-4b35-9b54-d5707b279e99 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.056149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efdae2-cf0e-4b35-9b54-d5707b279e99 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.056428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efdae2-cf0e-4b35-9b54-d5707b279e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.071162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65f2dd-19de-47da-8d9e-80f8adcf8a52 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.075521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-27efdae2-cf0e-4b35-9b54-d5707b279e99 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:08.076747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-27efdae2-cf0e-4b35-9b54-d5707b279e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.078286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.079112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.079483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.079956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.082006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.147445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 828/1652] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:08.154864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.157070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.158354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.158740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.159141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.166637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 825/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:07 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.181866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:08.183127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.185538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.187469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.194664 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 829/1654] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:08.195680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.202130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80651aa-8da1-4c1b-a45f-d2a54a508225 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.208028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.209325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.209534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff3d2-c4e4-44d7-a1ac-bf7f0fcf3ec6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.209641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.209865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] PATH_INFO: `/v3/users/78ca9cfb120e40eba4be137b26f105f9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.211059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ca9cfb120e40eba4be137b26f105f9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.213164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.215419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.216061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.216342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.216651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.226466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.228053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.243240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 830/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.244145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.260359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e57a7d-ea26-48c8-884f-274314d57b96 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.265373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.266026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.266305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.266581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.267678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:08.267678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.268914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ca9cfb120e40eba4be137b26f105f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.269263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.283774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ca9cfb120e40eba4be137b26f105f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.285173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ca9cfb120e40eba4be137b26f105f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.290878 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 831/1656] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:08.291629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.293490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.301754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ca9cfb120e40eba4be137b26f105f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.314010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de3166-6a3a-4363-8252-f5e5d64fec11 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.317770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ca9cfb120e40eba4be137b26f105f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.320552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.321224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.321500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.322039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.323790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.328263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 826/1657] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:08 2021] DELETE /identity/v3/users/78ca9cfb120e40eba4be137b26f105f9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:08.328263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.328263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.336777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.338419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.349341 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 832/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.350056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.351374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.364998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c47e-a895-4acd-bca2-440a3e6a8b2d service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.391941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864707c0-3206-4826-b0a9-4fb3442ffe9f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.397793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.398674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.399028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.399197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.410748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.410748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7964d2-6bcd-455c-9e37-ada7a1736263 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.438371 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 827/1659] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:08.439011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.439666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.439769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.439969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.440047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.440220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.440291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.442877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.458228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:08.459403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.517343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.519039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.525310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 828/1660] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:08.525972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.527256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.531348 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 833/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.532085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.543892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bfa6d-f409-43f9-99d0-3e4b934dd699 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.549842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.550512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.550793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.551141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.551818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.553985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.575051 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 834/1662] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:08.576024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.578399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.613496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4652-e6bb-4fb5-8ade-bdc653fe043d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.621232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.621986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.622331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.622676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.624598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.648644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8c31-1f17-48d9-9b9c-c06fd7282cbf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.652296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.652970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.653246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.653515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.663655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.670601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.680812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 835/1663] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.681626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.691074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4377e5-8cf1-4207-903c-c3d614c48861 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.694727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.696126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.696459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.697391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.697915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.698327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.699188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.705290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.717437 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 829/1664] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:08.718938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.719292 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 836/1665] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:08.722094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.724132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.735689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e829-5feb-4686-b069-627ec268fa38 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.741793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.742913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.743009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.743256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.744219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfb24-d903-466b-a75c-26faaa8136e5 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.744326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.746279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.756460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.757696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.757981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.758261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] PATH_INFO: `/v3/users/8b3a06a02ba6459088397115452f50c1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.759664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3a06a02ba6459088397115452f50c1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.762379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.765346 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 837/1666] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:08.769985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:08.795217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7a7b0-f5a1-4545-b07a-a97b6a47bd8f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:08.804419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:08.805345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.805628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.805905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] PATH_INFO: `/v3/projects/cadaeb821aab443d8c32e727d3f34abc/users/74511ad1ae17476da98d701fae8fde7a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.848120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadaeb821aab443d8c32e727d3f34abc, user_id=74511ad1ae17476da98d701fae8fde7a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:08.852847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22b8e-6f2f-4811-867a-bffae0280970 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:08.865860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3a06a02ba6459088397115452f50c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.890568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 838/1667] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:08 2021] PUT /identity/v3/projects/cadaeb821aab443d8c32e727d3f34abc/users/74511ad1ae17476da98d701fae8fde7a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:08.895233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d875e-f4e4-4946-a334-6048a0ab8efb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.895564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d875e-f4e4-4946-a334-6048a0ab8efb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.896648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d875e-f4e4-4946-a334-6048a0ab8efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.898345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3a06a02ba6459088397115452f50c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.899371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3a06a02ba6459088397115452f50c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.918195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3a06a02ba6459088397115452f50c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.929169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d8d8903-dc1e-48aa-9435-3d6e87a4fc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3a06a02ba6459088397115452f50c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:08.940642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 830/1668] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:08 2021] DELETE /identity/v3/users/8b3a06a02ba6459088397115452f50c1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:08.946411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21dd27-1211-4cfc-af9d-cdaeb3d32670 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:08.946955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21dd27-1211-4cfc-af9d-cdaeb3d32670 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:08.947231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21dd27-1211-4cfc-af9d-cdaeb3d32670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:08.949523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fe9d875e-f4e4-4946-a334-6048a0ab8efb None None] MFA Rules not processed for user `74511ad1ae17476da98d701fae8fde7a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:08.950648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fe9d875e-f4e4-4946-a334-6048a0ab8efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:08.971701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6f21dd27-1211-4cfc-af9d-cdaeb3d32670 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:08.973368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6f21dd27-1211-4cfc-af9d-cdaeb3d32670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.035164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 839/1669] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:09.036786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.037068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.037518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.045901 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 840/1670] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:09 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:09.046982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.048779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.063620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 831/1671] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:09.065236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.065892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.066295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.093111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:09.094423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.150424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf971-1179-4e8e-97b2-1750036c0ca7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.162143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.163405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.163702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.163989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.164738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.166627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.199677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 832/1672] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:09 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:09.200859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.202892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.203767 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 841/1673] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:09 2021] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:09.204741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.206925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.264108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe2a1-ccff-4680-a318-9485d00b5097 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.270821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1b7b-010d-4aee-9641-9fb425879c1d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.276785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.277671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.277953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.278224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] PATH_INFO: `/v3/projects/3f8e7740b4ef428f9ad247019be4f89f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.279524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8e7740b4ef428f9ad247019be4f89f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.280634 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:57:09.280634 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:57:09.280634 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:57:09.281976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.315806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.316518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.316835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.317105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.326324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.327765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.337170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 833/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:09.338032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.338859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8e7740b4ef428f9ad247019be4f89f', 'request_id': 'req-4706b0ed-f27d-427c-be87-d1417bdd6573'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.345259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8e7740b4ef428f9ad247019be4f89f', 'request_id': 'req-4706b0ed-f27d-427c-be87-d1417bdd6573'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.346938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f6034-d17a-421d-ac67-c421b33d76ce service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.359097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8e7740b4ef428f9ad247019be4f89f', 'request_id': 'req-4706b0ed-f27d-427c-be87-d1417bdd6573'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.373762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] The token cache is being invalidate because project 3f8e7740b4ef428f9ad247019be4f89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:09.375170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.375843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.377815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 842/1675] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:09 2021] DELETE /identity/v3/projects/3f8e7740b4ef428f9ad247019be4f89f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:09.378671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.380347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.407347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.408066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.408307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.408581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.409353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.411268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.433497 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 834/1676] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:09 2021] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:09.434382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.436076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.454903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b0ed-f27d-427c-be87-d1417bdd6573 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.460358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.461472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.461817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.462152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] PATH_INFO: `/v3/users/c35e7651ebfa4fdb959186dd4a59fc66` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.463444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35e7651ebfa4fdb959186dd4a59fc66)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.465735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.532944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35e7651ebfa4fdb959186dd4a59fc66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.537315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2aea-93f1-47f5-83e6-271f859b2bbe admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.540002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35e7651ebfa4fdb959186dd4a59fc66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.540721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35e7651ebfa4fdb959186dd4a59fc66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.541330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35e7651ebfa4fdb959186dd4a59fc66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.543228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.544118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.544317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.544585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.547372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.550816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35e7651ebfa4fdb959186dd4a59fc66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.559561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.561263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.573302 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 843/1677] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:09 2021] DELETE /identity/v3/users/c35e7651ebfa4fdb959186dd4a59fc66 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:09.573302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.573302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.573684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 835/1678] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:09.574687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.575652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.592296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f69e-d24f-4860-89e8-30fba695ef8a service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.672695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beb1d-386c-4cdc-a513-90188e9446e3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.678006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.678902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.679195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.679465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] PATH_INFO: `/v3/users/0409aaa5209748f7a8f8f1513328e2bc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.681013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0409aaa5209748f7a8f8f1513328e2bc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.682172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.682926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.683355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.683942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.684486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.686139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.690286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740a11c-7fbe-4c10-8146-a9b7ee82edf4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.708723 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 836/1679] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:09.710820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.711047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.711454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.730212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:09.731420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.732719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0409aaa5209748f7a8f8f1513328e2bc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.739720 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 837/1680] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:09.739840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0409aaa5209748f7a8f8f1513328e2bc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.740583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0409aaa5209748f7a8f8f1513328e2bc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.741234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0409aaa5209748f7a8f8f1513328e2bc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.743611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.744952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.752057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d214c5eb-2880-48e9-9bd7-5070955e36c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0409aaa5209748f7a8f8f1513328e2bc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.757246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f78396-265a-43c8-9ba6-01f09eb36366 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.762027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.762868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.763149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.763427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] PATH_INFO: `/v3/projects/d65047a5d8ed4c359989170ef998fe5d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.764662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65047a5d8ed4c359989170ef998fe5d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.766533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.769524 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 844/1681] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:09 2021] DELETE /identity/v3/users/0409aaa5209748f7a8f8f1513328e2bc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:09.771006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063334-cc26-4049-8409-7828ef64caef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.771294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063334-cc26-4049-8409-7828ef64caef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.771577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063334-cc26-4049-8409-7828ef64caef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.795126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c7063334-cc26-4049-8409-7828ef64caef None None] MFA Rules not processed for user `1bd1c783ebc8445fbb2ce7e519fc5e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:09.796984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c7063334-cc26-4049-8409-7828ef64caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.817446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65047a5d8ed4c359989170ef998fe5d', 'request_id': 'req-f7458814-5039-4e56-bdcc-fa4ed6d6c609'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.824835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65047a5d8ed4c359989170ef998fe5d', 'request_id': 'req-f7458814-5039-4e56-bdcc-fa4ed6d6c609'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.835017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65047a5d8ed4c359989170ef998fe5d', 'request_id': 'req-f7458814-5039-4e56-bdcc-fa4ed6d6c609'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.850214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] The token cache is being invalidate because project d65047a5d8ed4c359989170ef998fe5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:09.851068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.851836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:09.853698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 838/1682] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:09 2021] DELETE /identity/v3/projects/d65047a5d8ed4c359989170ef998fe5d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:09.854597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.855929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.865907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 845/1683] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:09.866836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063334-cc26-4049-8409-7828ef64caef None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.868147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c7063334-cc26-4049-8409-7828ef64caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.922794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7458814-5039-4e56-bdcc-fa4ed6d6c609 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.928086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.929217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.929583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.929927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] PATH_INFO: `/v3/projects/a89add0df6c9484db927b4cd801398e5/users/0a126964513c4107a5d9ddbf510fcce3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.937066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063334-cc26-4049-8409-7828ef64caef None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:09.949331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89add0df6c9484db927b4cd801398e5, user_id=0a126964513c4107a5d9ddbf510fcce3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:09.952700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:09.970722 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 839/1684] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:09 2021] PUT /identity/v3/projects/a89add0df6c9484db927b4cd801398e5/users/0a126964513c4107a5d9ddbf510fcce3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:09.971631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:09.974170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:09.990732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:09.991378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:09.991655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:09.991925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:09.993879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.007129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.008539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.019262 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 846/1685] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:10.019878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.021297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.045741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c23bc-c7e9-455f-8fb7-45a624869286 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.051934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.052877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.053156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.053582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] PATH_INFO: `/v3/users/2126c9ab84b84a0f90f724a3398ae825` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.055160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2126c9ab84b84a0f90f724a3398ae825)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.057568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.106331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70116d46-69ec-4b32-b3f1-966f69e9ddbd service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.124971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2126c9ab84b84a0f90f724a3398ae825'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.133851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2126c9ab84b84a0f90f724a3398ae825'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.134556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2126c9ab84b84a0f90f724a3398ae825'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.156119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2126c9ab84b84a0f90f724a3398ae825'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.167541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2126c9ab84b84a0f90f724a3398ae825'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.176720 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 840/1686] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:09 2021] DELETE /identity/v3/users/2126c9ab84b84a0f90f724a3398ae825 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:10.177568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.178920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.184196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.185256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.185369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.185612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.188738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.274294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.276090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.283802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81bba2-b8b5-4e11-9c7f-d666cf0eeb2e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.286853 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 847/1687] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:10 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:10.288075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.289271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.289409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.290109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.290570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.291054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.291981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.293755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.305637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 841/1688] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:10 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:10.309031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015621a-9a57-48f4-b4fa-d377410d5510 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.310611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.315835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.316841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.317218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.317588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] PATH_INFO: `/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.318912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40f82f9d3fa472ba49fe68bb575f2e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.321170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.323941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfeb0-7b50-4330-9af4-8a9e1846275e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.330315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.331857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.332203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.333034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] PATH_INFO: `/v3/projects/a89add0df6c9484db927b4cd801398e5/users/0a126964513c4107a5d9ddbf510fcce3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.335254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89add0df6c9484db927b4cd801398e5, user_id=0a126964513c4107a5d9ddbf510fcce3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.338665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c75f2-3ae9-4cbf-ac03-e7dbc89c4c38 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.352431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 842/1689] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:10 2021] PUT /identity/v3/projects/a89add0df6c9484db927b4cd801398e5/users/0a126964513c4107a5d9ddbf510fcce3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:10.363882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639219-0b06-4277-b855-e9de3d768789 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.363882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639219-0b06-4277-b855-e9de3d768789 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.364011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639219-0b06-4277-b855-e9de3d768789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.390684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40f82f9d3fa472ba49fe68bb575f2e2', 'request_id': 'req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.395383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-97639219-0b06-4277-b855-e9de3d768789 None None] MFA Rules not processed for user `0a126964513c4107a5d9ddbf510fcce3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:10.396811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97639219-0b06-4277-b855-e9de3d768789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.397881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40f82f9d3fa472ba49fe68bb575f2e2', 'request_id': 'req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.404689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40f82f9d3fa472ba49fe68bb575f2e2', 'request_id': 'req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.418585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] The token cache is being invalidate because project a40f82f9d3fa472ba49fe68bb575f2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:10.418585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.419260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e92b4f9-88fd-4709-ad78-97d2e9ef43c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.427945 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 848/1690] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:10 2021] DELETE /identity/v3/projects/a40f82f9d3fa472ba49fe68bb575f2e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:10.429861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4985fe-ac78-4372-86e7-e4bb498fedb0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.430149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4985fe-ac78-4372-86e7-e4bb498fedb0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.430418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4985fe-ac78-4372-86e7-e4bb498fedb0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.441038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 849/1691] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:10 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:10.443670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.443985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.444268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.465804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:10.470343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.506773 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 843/1692] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:10 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:10.508189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.508479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.508778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.538481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:10.539826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.569569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 850/1693] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:10.570742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.574595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.587190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d1f79-9318-4c28-9421-f115bad51f73 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.592027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.592971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.593361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.593644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] PATH_INFO: `/v3/projects/0a1c76a9ed644e47800602cf6ba9cdfe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.595146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1c76a9ed644e47800602cf6ba9cdfe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.597189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.626390 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 844/1694] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:10 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:10.627386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.628948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.643315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4a4a5-3fbf-41f5-bee5-4141abedcca9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.655215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1c76a9ed644e47800602cf6ba9cdfe', 'request_id': 'req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.660548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1c76a9ed644e47800602cf6ba9cdfe', 'request_id': 'req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.667074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1c76a9ed644e47800602cf6ba9cdfe', 'request_id': 'req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.680128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] The token cache is being invalidate because project 0a1c76a9ed644e47800602cf6ba9cdfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:10.680410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.681088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8082622f-82af-4bd5-b1ec-aaac2abd0f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.682738 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 851/1695] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:10 2021] DELETE /identity/v3/projects/0a1c76a9ed644e47800602cf6ba9cdfe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:10.684306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.684583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.684883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.704218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:10.705446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.708020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.708810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.709092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.709361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.711141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.761423 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 852/1696] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:10.762273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.763642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.768133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.769732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.774587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f47d9-5585-4ffb-bacd-6a90bf3d952f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.778373 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 845/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:10 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:10.779133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.779263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.779954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.780300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.780500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.780596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] PATH_INFO: `/v3/projects/417caf0eb5534bdda2823c49b2d3418c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.781771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=417caf0eb5534bdda2823c49b2d3418c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.783748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.829563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417caf0eb5534bdda2823c49b2d3418c', 'request_id': 'req-62a59c59-3f69-424e-9915-d68a0a5a6a4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.835017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417caf0eb5534bdda2823c49b2d3418c', 'request_id': 'req-62a59c59-3f69-424e-9915-d68a0a5a6a4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.841050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417caf0eb5534bdda2823c49b2d3418c', 'request_id': 'req-62a59c59-3f69-424e-9915-d68a0a5a6a4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.844242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7bc5-18c1-488e-9c0e-a67c532a6336 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.854254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] The token cache is being invalidate because project 417caf0eb5534bdda2823c49b2d3418c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:10.854546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.855202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.856864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 853/1698] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:10 2021] DELETE /identity/v3/projects/417caf0eb5534bdda2823c49b2d3418c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:10.861725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.861725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.893217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.893781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.894056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.894320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.896077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.922659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a59c59-3f69-424e-9915-d68a0a5a6a4b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.927189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.928040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.928320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.928587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] PATH_INFO: `/v3/users/0c6ae21a09804e7eaf668cb2b8839255` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.929806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6ae21a09804e7eaf668cb2b8839255)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.931675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.963823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:10.965358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:10.975528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6ae21a09804e7eaf668cb2b8839255'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.976631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 846/1699] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:10.977357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:10.978678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:10.982882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6ae21a09804e7eaf668cb2b8839255'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.984205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6ae21a09804e7eaf668cb2b8839255'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.984838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6ae21a09804e7eaf668cb2b8839255'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.991968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca95f4-c86a-47b0-b59f-21621958e215 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:10.992704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9e4b862-5e41-4c09-b563-020f7e37993a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6ae21a09804e7eaf668cb2b8839255'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:10.997286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:10.997935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:10.998217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:10.998497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:10.999259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:10.999557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.001170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81d1da-99c5-4a57-acd3-dff020bb76a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.011332 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 854/1700] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:10 2021] DELETE /identity/v3/users/0c6ae21a09804e7eaf668cb2b8839255 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:11.012565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.012882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.013154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.016944 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 847/1701] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:11.017629 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 855/1702] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:11.020067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0fbb6-aa02-4cf2-9adc-72000e2159b0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.020399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0fbb6-aa02-4cf2-9adc-72000e2159b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.020956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0fbb6-aa02-4cf2-9adc-72000e2159b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.022475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.024306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.039578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e6a0fbb6-aa02-4cf2-9adc-72000e2159b0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:11.040714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6a0fbb6-aa02-4cf2-9adc-72000e2159b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.100119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232076-9c81-447e-bf5d-8b1c00108b91 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.106559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.107230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.107510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.107806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.109527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.111232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9853e03-3198-4dec-b5ad-53f226d033ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.133829 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 848/1703] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:11.134919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.135429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.135775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.148047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 856/1704] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:11.149853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.152773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.153118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.164021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:11.166273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.173677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:11.174808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.245078 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 849/1705] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:11.246010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.248048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 857/1706] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:11.253679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.259768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7981-2a6c-4b89-90b7-5e88d04c4c53 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.265083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2c0d-060c-459f-b6c2-d13e1d05f00e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.265799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.266706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.267227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.267718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.268689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.270512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.271035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.271163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.271427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.271693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.272455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:11.272785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.274336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.286959 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 858/1707] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:11.290104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.292113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.301686 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 850/1708] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/users => generated 295 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:11.302560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.314321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db73a-3325-4031-ae58-80117e08c75c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.323381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.324136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.324468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.324819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.325585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.328831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.369631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 851/1709] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:11.369786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb99dd-3675-4441-ab69-e470ead0f1c1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.369874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.431762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.432831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.433216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.433589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.473678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc5e-64fd-49b2-9022-e28074814241 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.478682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.479408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.479735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.479970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.480811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.482507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.497034 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 852/1710] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:11.497034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.509743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0e85-5670-4399-863c-9be8d835d77b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.517336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.518110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.518456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.518873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.519681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.522158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.522414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.523630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.539525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 859/1711] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:11.540495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.541925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.551892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 853/1712] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:11.552859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.564988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c499-24bf-49ae-bd4a-41af64c2cd67 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.573128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43d3ef-59e8-45dd-a55d-974b585cadb9 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.577857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.579719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.582779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.583172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.583994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.585728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.596655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.597316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 854/1713] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:11.597528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.597804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.598129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] PATH_INFO: `/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.598226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.599758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddcf2e4b5984bf19e0ed716dd3f68a0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.602761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.612546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ee9a-e907-466c-ab8e-7e99b91f66d2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.619386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.620316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.620913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.621327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.622576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.624360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.640349 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 855/1714] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:11.641863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.667264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68042-bbf1-4b03-872a-8bddd95e8c33 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.679000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.680041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.680638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.680638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] PATH_INFO: `/v3/projects/717e5841788344e89e8d073b02bd2e75/users/3369baa68ddd4eb0a5df5923a1974fed/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.689547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddcf2e4b5984bf19e0ed716dd3f68a0', 'request_id': 'req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:11.695854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddcf2e4b5984bf19e0ed716dd3f68a0', 'request_id': 'req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:11.699571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717e5841788344e89e8d073b02bd2e75, user_id=3369baa68ddd4eb0a5df5923a1974fed, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.704236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.704362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddcf2e4b5984bf19e0ed716dd3f68a0', 'request_id': 'req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:11.720931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] The token cache is being invalidate because project 6ddcf2e4b5984bf19e0ed716dd3f68a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:11.721227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:11.721878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:11.727668 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 860/1715] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:11 2021] DELETE /identity/v3/projects/6ddcf2e4b5984bf19e0ed716dd3f68a0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:11.727668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.727886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 856/1716] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:11 2021] PUT /identity/v3/projects/717e5841788344e89e8d073b02bd2e75/users/3369baa68ddd4eb0a5df5923a1974fed/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:11.727886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.730160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.735559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.816413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c109b7-a9b5-4428-abf9-e56a9d3b2f2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.821918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ee7f-21af-430a-8c12-c803ebc04f14 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.830330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.830988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.831353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.831549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.833366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.847572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.849212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ef335-6227-45c0-93a5-a5e1e17b7bf5 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.860837 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 857/1717] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:11.873419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.873703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.874013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.892483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.893506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.893884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.894421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.895325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:11.897265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9486a6-dee9-4466-8d0d-7ccb2d3fc8ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:11.910066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 861/1718] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:11.912031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626878-a9ff-4ef7-a141-50a913aa333c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.912451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626878-a9ff-4ef7-a141-50a913aa333c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.913222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626878-a9ff-4ef7-a141-50a913aa333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.913799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:11.915032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.938117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 858/1719] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:11.940114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:11.951069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8b626878-a9ff-4ef7-a141-50a913aa333c None None] MFA Rules not processed for user `3369baa68ddd4eb0a5df5923a1974fed`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:11.953048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b626878-a9ff-4ef7-a141-50a913aa333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:11.966416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e00dd-efce-4401-83e4-bceee8f69cfa None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:11.976291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:11.977299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:11.977706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:11.978080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] PATH_INFO: `/v3/projects/b8d7111030614ab994cb28cfe82f66df/users/ebb77877fd9f4a398e15837f80b60bf3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:11.998540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d7111030614ab994cb28cfe82f66df, user_id=ebb77877fd9f4a398e15837f80b60bf3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.010597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916be08-6fef-407e-8eee-f8fc2e0f9457 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.050470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 859/1720] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:11 2021] PUT /identity/v3/projects/b8d7111030614ab994cb28cfe82f66df/users/ebb77877fd9f4a398e15837f80b60bf3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:12.055084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644d061-bc36-4c23-b242-7b74790601da None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.055430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644d061-bc36-4c23-b242-7b74790601da None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.056191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644d061-bc36-4c23-b242-7b74790601da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.065511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 862/1721] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:11 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:12.069085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.069085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.069085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.076330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a644d061-bc36-4c23-b242-7b74790601da None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:12.078463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a644d061-bc36-4c23-b242-7b74790601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.087292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:12.088716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.166344 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 860/1722] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:12.167079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644d061-bc36-4c23-b242-7b74790601da None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.170220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a644d061-bc36-4c23-b242-7b74790601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.181975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644d061-bc36-4c23-b242-7b74790601da None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.184720 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 863/1723] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:12.187087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.187764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.188965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.189139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.189674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.190681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.190781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.194097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.223170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 861/1724] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:12.224315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.275868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e499de-c57e-49b5-a944-abaf2c0dc063 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.291891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef5c0-200e-403f-9cf3-9d62ae0d2660 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.296716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.297486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.297835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.298113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.298879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:12.299322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.300809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.312601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 862/1725] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:12.313583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.317473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.355454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.356111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.356389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.356696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.358558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.386530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1275f-76e7-4467-9c0c-990d249e4a5b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.392183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.393094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.393463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.393739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.406105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.407522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.417573 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 863/1726] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:12.418207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.427516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e039a-4dd0-4794-bf13-30892b7df5fb service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.433367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.434164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.434338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.434556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.434898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.435591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.435942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.438266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.452700 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 864/1727] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:12.453758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.464856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72b436-3af7-467c-8d79-537a1fd5e838 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.466221 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 864/1728] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/users => generated 301 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:12.470556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.471953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.472700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.473230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.473510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.474518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.477684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.482350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992434-707c-4620-a219-a4a1304c2ca8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.487622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.488381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.488885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.489233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.490110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.491782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.508268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 865/1729] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:12.509466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.523875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867db7-08b6-4fec-b403-b31bf1309602 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.529983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.530987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.531511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.531511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] PATH_INFO: `/v3/projects/809c01c2567444ecba6a29f7e9646f93/users/b3d86aeee15a4620b640e7bbca8926bf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.533711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 865/1730] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:12.536151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.557762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=809c01c2567444ecba6a29f7e9646f93, user_id=b3d86aeee15a4620b640e7bbca8926bf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.567443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.587582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 866/1731] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:12 2021] PUT /identity/v3/projects/809c01c2567444ecba6a29f7e9646f93/users/b3d86aeee15a4620b640e7bbca8926bf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:12.593232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.654376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700d78-920e-4b3b-bb39-ec37446c4c46 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.710379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72e9b2-702f-48c7-aba5-6763b243b00d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.722533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.723216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.723780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.723780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.724512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.726116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.740727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 867/1732] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:12.744713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.757023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1966d-d3c6-444f-ba25-213e8cc6055e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:12.762087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.763815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.763815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.764392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] PATH_INFO: `/v3/projects/809c01c2567444ecba6a29f7e9646f93/users/b3d86aeee15a4620b640e7bbca8926bf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.766901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809c01c2567444ecba6a29f7e9646f93, user_id=b3d86aeee15a4620b640e7bbca8926bf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.769967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00154f-1de6-48ac-bb36-4b8c477e29a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.792410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:12.792749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 868/1733] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:12 2021] PUT /identity/v3/projects/809c01c2567444ecba6a29f7e9646f93/users/b3d86aeee15a4620b640e7bbca8926bf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:12.793575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.793919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.794318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.795090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:12.797567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:12.857568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 866/1734] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/users => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:12.870585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14f76-cfe3-4c9d-a504-d46bde25baf6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:12.870910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14f76-cfe3-4c9d-a504-d46bde25baf6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:12.871204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14f76-cfe3-4c9d-a504-d46bde25baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:12.879775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:12.901721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-45a14f76-cfe3-4c9d-a504-d46bde25baf6 None None] MFA Rules not processed for user `b3d86aeee15a4620b640e7bbca8926bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:12.903111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45a14f76-cfe3-4c9d-a504-d46bde25baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:12.906028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d4cc8-7548-4a1f-ada5-260631c7f435 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:13.009909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:13.009909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.009909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.009909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.010562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:13.010562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:13.010693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 869/1735] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:12 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:13.011745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694bc3-a115-479b-8768-5dd7f8da7ecc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.012039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694bc3-a115-479b-8768-5dd7f8da7ecc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.013840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694bc3-a115-479b-8768-5dd7f8da7ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.022558 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 867/1736] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:12 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:13.023679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:13.048759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1ef35-d77c-4473-a356-8281538120b8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:13.060043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-10694bc3-a115-479b-8768-5dd7f8da7ecc None None] MFA Rules not processed for user `3369baa68ddd4eb0a5df5923a1974fed`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:13.063628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10694bc3-a115-479b-8768-5dd7f8da7ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:13.066066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:13.066830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.067112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.067391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.068455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:13.069853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:13.090670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 868/1737] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:13 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:13.092142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:13.106362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54eec-7229-4bac-8937-a8d4ab79b8bf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:13.113379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:13.114450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.114770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.115133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] PATH_INFO: `/v3/projects/5047437050b54d1c9edd93fdd58f2667/users/426f586d73984530bb8d8bd726154bce/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.132865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5047437050b54d1c9edd93fdd58f2667, user_id=426f586d73984530bb8d8bd726154bce, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:13.135585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:13.156233 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 870/1738] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:13 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:13.161228 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 869/1739] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:13 2021] PUT /identity/v3/projects/5047437050b54d1c9edd93fdd58f2667/users/426f586d73984530bb8d8bd726154bce/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:13.165123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:13.165849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.166303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.166784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.167413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:13.189775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:13.191467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:13.284948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 871/1740] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:13.290432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:13.292380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c8e96-cbec-4bb7-af91-101ae6390fc3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:13.299540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df103c-9717-4299-b5a9-146321005113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:13.300298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df103c-9717-4299-b5a9-146321005113 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.300652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df103c-9717-4299-b5a9-146321005113 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.301018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df103c-9717-4299-b5a9-146321005113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.368313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909fbaa-b574-4e21-9e60-4bb23a9bb143 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:13.373211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:13.374049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.374154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.374432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:13.377599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df103c-9717-4299-b5a9-146321005113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:13.379236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df103c-9717-4299-b5a9-146321005113 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:13.386205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:13.387661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:13.389997 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 870/1741] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:13 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:13.398404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 872/1742] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:13.973393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23554c3-444c-4202-80a0-fb38dc25796c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:13.973690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23554c3-444c-4202-80a0-fb38dc25796c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:13.973950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23554c3-444c-4202-80a0-fb38dc25796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:14.018908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c23554c3-444c-4202-80a0-fb38dc25796c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:14.022324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c23554c3-444c-4202-80a0-fb38dc25796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:14.143785 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 871/1743] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:14.340019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:14.343440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:14.486952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b46b-2444-4edc-8186-d92289f24134 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:14.495130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:14.500075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:14.508131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:14.509020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:14.549977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:14.549977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:14.577050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 873/1744] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:57:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:57:14.591156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:14.591689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:14.591689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:14.688920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] MFA Rules not processed for user `426f586d73984530bb8d8bd726154bce`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:14.693856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:14.916278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 872/1745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:14 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:14.917594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:14.935701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1f6-07be-47b9-81b2-aeb166c7ee28 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:14.945620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:14.946436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:14.947080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:14.947517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:14.948265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:14.950384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.029330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 874/1746] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:14 2021] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:15.033822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:15.052507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae9d6-bf5e-4c21-8183-f57fdf2431e2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:15.257187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:15.257808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:15.258792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:15.259077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:15.259819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:15.264728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.336064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:15.342977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 873/1747] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:15 2021] POST /identity/v3/users => generated 308 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:15.355320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efd11-d71e-4aae-929b-d3cb3be85e47 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:15.370504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:15.375579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:15.376425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:15.378426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:15.381373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:15.386109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.440440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:15.454315 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 875/1748] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:15.456930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d554b97-2df0-41ae-a007-6a5f96639bd6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:15.476091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:15.480486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:15.481885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:15.482179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] PATH_INFO: `/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861/users/f27de5999d5344c5865925df5014bcc9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:15.535136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9c5c51933442c4a784e5bdbc3c5861, user_id=f27de5999d5344c5865925df5014bcc9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:15.537822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.583851 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 874/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:15 2021] PUT /identity/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861/users/f27de5999d5344c5865925df5014bcc9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:15.588004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:15.606041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3b8f-71c3-42ea-a3bb-f82ffc06c30f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:15.727585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:15.729587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:15.731183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:15.731627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:15.732891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:15.734706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a144ac-c63f-4447-8d5a-19676d4c9115 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.754507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 876/1750] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:15.756120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:15.771010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65254104-ff06-496e-b720-6f0ec69aa4b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:15.781633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:15.782576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:15.782855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:15.783126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] PATH_INFO: `/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861/users/f27de5999d5344c5865925df5014bcc9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:15.793972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9c5c51933442c4a784e5bdbc3c5861, user_id=f27de5999d5344c5865925df5014bcc9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:15.793972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:15.827352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 875/1751] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:15 2021] PUT /identity/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861/users/f27de5999d5344c5865925df5014bcc9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:16.888695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d9bf-88f9-48c4-9677-9ef53f57de7b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:16.889765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d9bf-88f9-48c4-9677-9ef53f57de7b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:16.889765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d9bf-88f9-48c4-9677-9ef53f57de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:16.920248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3973d9bf-88f9-48c4-9677-9ef53f57de7b None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:16.921377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3973d9bf-88f9-48c4-9677-9ef53f57de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:17.043614 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 877/1752] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:17.060563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:17.208882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173811-730d-4ca1-adaa-a6480b18a99c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:17.216142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:17.216938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:17.217391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:17.217692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:17.227746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:17.229704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dc4fe-1d81-4c92-92c3-9adba53f9849 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:17.266794 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 876/1753] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:57:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:57:18.683911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:18.685082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:18.685488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:18.750031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] MFA Rules not processed for user `f27de5999d5344c5865925df5014bcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:18.751238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:18.912702 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 878/1754] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:18 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:19.040823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bc8c-6567-41cc-b6f7-5ad2365ad3c1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:19.042276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bc8c-6567-41cc-b6f7-5ad2365ad3c1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:19.043200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bc8c-6567-41cc-b6f7-5ad2365ad3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:19.133124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a518bc8c-6567-41cc-b6f7-5ad2365ad3c1 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:19.134445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a518bc8c-6567-41cc-b6f7-5ad2365ad3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:19.309662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 877/1755] 10.222.0.21 () {58 vars in 1015 bytes} [Wed Nov 10 03:57:19 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:19.368147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:19.374526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:19.409800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83abc-cc89-428e-ba2e-2f99879213bf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:19.421677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:19.424113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:19.424885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:19.425267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:19.466539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:19.474875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:19.531236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 879/1756] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:20.081195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce230-3c8d-436e-9583-24a5d0e3ff71 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:20.081832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce230-3c8d-436e-9583-24a5d0e3ff71 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:20.081832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce230-3c8d-436e-9583-24a5d0e3ff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:20.134950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-437ce230-3c8d-436e-9583-24a5d0e3ff71 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:20.136536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-437ce230-3c8d-436e-9583-24a5d0e3ff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:20.173141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 878/1757] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 10 03:57:20 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:20.330343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:20.343724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4c041-fa1b-45fb-a11e-40040ed94f11 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:20.361225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:20.365544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:20.366414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:20.367140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:20.386549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:20.389784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b4af0-8f48-4d8a-af94-40d4907e6c13 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:20.414800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 880/1758] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:22.047552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83304-8f6f-415a-897c-ea9eea98cf11 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:22.048474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83304-8f6f-415a-897c-ea9eea98cf11 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:22.048917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83304-8f6f-415a-897c-ea9eea98cf11 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:22.050900 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 879/1759] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:22.133763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:22.134326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:22.134414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:22.167008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:22.168303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:22.337829 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 881/1760] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:57:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:22.809162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f83304-8f6f-415a-897c-ea9eea98cf11 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:22.828241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f83304-8f6f-415a-897c-ea9eea98cf11 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:22.849460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:22.850821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:22.851109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:22.851428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:22.865268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:22.867076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197192-5e2e-4b16-951b-25e8f6b22c66 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:22.897415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 880/1761] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:23.734125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:23.737547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:23.984792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438f7a-55b2-4c9e-a5d1-89fd4efe89ce None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:23.996426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:24.001122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:24.002047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:24.002572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] PATH_INFO: `/v3/users/74511ad1ae17476da98d701fae8fde7a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:24.006970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74511ad1ae17476da98d701fae8fde7a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:24.010863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:24.107464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74511ad1ae17476da98d701fae8fde7a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:24.125134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74511ad1ae17476da98d701fae8fde7a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:24.126479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74511ad1ae17476da98d701fae8fde7a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:24.166583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74511ad1ae17476da98d701fae8fde7a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:24.177753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74511ad1ae17476da98d701fae8fde7a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:24.190789 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 882/1762] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:23 2021] DELETE /identity/v3/users/74511ad1ae17476da98d701fae8fde7a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:24.196285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805c2d-3e31-4f79-8186-7575757248ed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:24.197870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805c2d-3e31-4f79-8186-7575757248ed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:24.199206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805c2d-3e31-4f79-8186-7575757248ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:24.250240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-56805c2d-3e31-4f79-8186-7575757248ed None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:24.255223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-56805c2d-3e31-4f79-8186-7575757248ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:24.414126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 881/1763] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:24.553052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:24.557504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:24.778897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0cdb-3af0-424b-a769-898fa40eccd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:24.781369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7fa77-d669-45eb-aa0b-cfa1d83c46da None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:24.781503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7fa77-d669-45eb-aa0b-cfa1d83c46da None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:24.781721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7fa77-d669-45eb-aa0b-cfa1d83c46da None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:24.783862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 882/1764] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:57:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:24.791799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:24.792714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:24.792869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:24.796123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:24.824654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:24.828700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:24.872039 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 883/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:24.949691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:24.950023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:24.950466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:25.010982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:25.018964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:25.193996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 883/1766] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:57:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:25.578803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:25.581430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:25.611768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:25.613909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:25.619666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd094cb-218a-4601-bfd4-d5e76d4e3869 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:25.636322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e04b8-632d-499f-a313-444f5e68f43a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:25.638092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:25.638755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:25.647320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:25.647610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:25.649263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:25.650421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:25.652118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:25.652602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] PATH_INFO: `/v3/users/426f586d73984530bb8d8bd726154bce` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:25.655124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426f586d73984530bb8d8bd726154bce)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:25.662066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:25.679103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:25.688431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:25.750965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 884/1767] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:25.780326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426f586d73984530bb8d8bd726154bce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:25.798011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426f586d73984530bb8d8bd726154bce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:25.799001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426f586d73984530bb8d8bd726154bce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:25.799827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426f586d73984530bb8d8bd726154bce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:25.849779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426f586d73984530bb8d8bd726154bce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:25.904370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 884/1768] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:25 2021] DELETE /identity/v3/users/426f586d73984530bb8d8bd726154bce => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:26.249079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:26.266834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:26.305291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f5793-5714-4e37-acc8-778753867e49 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:26.468083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:26.468975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:26.469702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:26.469702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] PATH_INFO: `/v3/projects/cadaeb821aab443d8c32e727d3f34abc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:26.478842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadaeb821aab443d8c32e727d3f34abc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:26.481002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:26.623926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadaeb821aab443d8c32e727d3f34abc', 'request_id': 'req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:26.644029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadaeb821aab443d8c32e727d3f34abc', 'request_id': 'req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:26.661679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadaeb821aab443d8c32e727d3f34abc', 'request_id': 'req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:26.687880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] The token cache is being invalidate because project cadaeb821aab443d8c32e727d3f34abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:26.688204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:26.689990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:26.692974 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 885/1769] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:26 2021] DELETE /identity/v3/projects/cadaeb821aab443d8c32e727d3f34abc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:26.697290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:26.698910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:26.730944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ac30-f8ba-4da9-983e-fb2b12db7f46 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:27.030782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:27.052165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:27.052511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:27.052839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] PATH_INFO: `/v3/users/0a126964513c4107a5d9ddbf510fcce3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:27.054659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a126964513c4107a5d9ddbf510fcce3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:27.060010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:27.204499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a126964513c4107a5d9ddbf510fcce3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.223766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a126964513c4107a5d9ddbf510fcce3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.224867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a126964513c4107a5d9ddbf510fcce3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.225748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a126964513c4107a5d9ddbf510fcce3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.257691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a126964513c4107a5d9ddbf510fcce3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.345623 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 885/1770] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:26 2021] DELETE /identity/v3/users/0a126964513c4107a5d9ddbf510fcce3 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:27.573848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:27.575959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:27.636130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47e7b-b985-4368-acb3-7c1d82fbadd0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:27.758435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:27.759298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:27.759605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:27.761932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] PATH_INFO: `/v3/projects/5047437050b54d1c9edd93fdd58f2667` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:27.765415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5047437050b54d1c9edd93fdd58f2667)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:27.767403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:27.887826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5047437050b54d1c9edd93fdd58f2667', 'request_id': 'req-845ff473-8a78-4943-a8b3-6d7c022d7363'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.900625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5047437050b54d1c9edd93fdd58f2667', 'request_id': 'req-845ff473-8a78-4943-a8b3-6d7c022d7363'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.914885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5047437050b54d1c9edd93fdd58f2667', 'request_id': 'req-845ff473-8a78-4943-a8b3-6d7c022d7363'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.943185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] The token cache is being invalidate because project 5047437050b54d1c9edd93fdd58f2667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:27.943591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.944295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:27.946641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 886/1771] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:27 2021] DELETE /identity/v3/projects/5047437050b54d1c9edd93fdd58f2667 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:27.950714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:27.952372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:27.974766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3dd20-c231-438a-819c-f1b149bd68b1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:28.020363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:28.022043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:28.206743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:28.211342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:28.212099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:28.212817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] PATH_INFO: `/v3/users/f27de5999d5344c5865925df5014bcc9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:28.219529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27de5999d5344c5865925df5014bcc9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:28.228716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:28.359785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff473-8a78-4943-a8b3-6d7c022d7363 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:28.375166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27de5999d5344c5865925df5014bcc9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.375476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:28.376510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:28.376896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:28.377155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] PATH_INFO: `/v3/projects/a89add0df6c9484db927b4cd801398e5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:28.380006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89add0df6c9484db927b4cd801398e5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:28.386122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:28.399182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27de5999d5344c5865925df5014bcc9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.402221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27de5999d5344c5865925df5014bcc9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.405343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27de5999d5344c5865925df5014bcc9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.432520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eccf6e1-cce7-4c8f-b915-0dee96d5cf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27de5999d5344c5865925df5014bcc9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.471951 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 886/1772] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:27 2021] DELETE /identity/v3/users/f27de5999d5344c5865925df5014bcc9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:28.581347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89add0df6c9484db927b4cd801398e5', 'request_id': 'req-25b992f2-8a62-49a9-90eb-1fa41225f7d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.599053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89add0df6c9484db927b4cd801398e5', 'request_id': 'req-25b992f2-8a62-49a9-90eb-1fa41225f7d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.617543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89add0df6c9484db927b4cd801398e5', 'request_id': 'req-25b992f2-8a62-49a9-90eb-1fa41225f7d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.646712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] The token cache is being invalidate because project a89add0df6c9484db927b4cd801398e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:28.649230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.652130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b992f2-8a62-49a9-90eb-1fa41225f7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:28.653933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 887/1773] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:28 2021] DELETE /identity/v3/projects/a89add0df6c9484db927b4cd801398e5 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:28.661132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99cb7a-ac84-47c4-bc1c-90f5f8c80ac7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:28.661401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99cb7a-ac84-47c4-bc1c-90f5f8c80ac7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:28.661670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99cb7a-ac84-47c4-bc1c-90f5f8c80ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:28.695534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-be99cb7a-ac84-47c4-bc1c-90f5f8c80ac7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:28.699460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be99cb7a-ac84-47c4-bc1c-90f5f8c80ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:28.773056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:28.773347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:28.773634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:28.845158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] MFA Rules not processed for user `ebb77877fd9f4a398e15837f80b60bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:28.848194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:28.875970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 887/1774] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:28.933675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:28.934044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:28.934224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:28.970403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:28.973532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:28.996277 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 888/1775] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:29.000482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.004601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:29.026623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd341b4-9da0-4a32-8de2-c1cc82aed6a7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.039171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.040160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.040445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.040754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] PATH_INFO: `/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.042013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9c5c51933442c4a784e5bdbc3c5861)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.048120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.121501 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 888/1776] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:28 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:29.121501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.137373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0035e-a9c7-43e3-93d0-075093ac9638 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.144086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9c5c51933442c4a784e5bdbc3c5861', 'request_id': 'req-64f73693-ec1b-44e5-a06a-07700c134bc8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:29.158715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9c5c51933442c4a784e5bdbc3c5861', 'request_id': 'req-64f73693-ec1b-44e5-a06a-07700c134bc8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:29.165744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9c5c51933442c4a784e5bdbc3c5861', 'request_id': 'req-64f73693-ec1b-44e5-a06a-07700c134bc8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:29.194015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] The token cache is being invalidate because project 6b9c5c51933442c4a784e5bdbc3c5861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:29.194390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:29.195243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:29.197709 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 889/1777] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:28 2021] DELETE /identity/v3/projects/6b9c5c51933442c4a784e5bdbc3c5861 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:29.198627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.200114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:29.283459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.284287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.284928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.285244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.286147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:29.286546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.288228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a82c-108f-43d6-9344-97c345f6fe2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.308111 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 889/1778] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:29.308111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.308111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.308111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.311753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73693-ec1b-44e5-a06a-07700c134bc8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.316691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.317571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.318261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.318680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.320479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.322880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663ce7-709c-4f8d-83c7-cbaccbc25849 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.334999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:29.337394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:29.356600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 890/1779] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:29.356600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.356600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:29.365147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 890/1780] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:29.366819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.367268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.368488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.374446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac7ec4-e5f1-43a9-acf8-32d219d25d8f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.391554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:29.393129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:29.464313 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 891/1781] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:29.469796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.484386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a32c8-d60e-472b-8dfd-07b21450a1de None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.497798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.498669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.500328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.500752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.504903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.507043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.515467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.516308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.517442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.518247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.518978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.525082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.550813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 892/1782] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/users => generated 307 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:29.551655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.578557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f01c0-c8ee-4d19-8641-16ff408d0222 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.584159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.584991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.585326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.585601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.586354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:29.586710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.588356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.599743 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 891/1783] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:29.599743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.610224 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 893/1784] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:29.610224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.629022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7d957-d0cc-4288-b706-31dc52f9ffa8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.737635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9207d-78cc-468a-b785-302932ae91cd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.740888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.741927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.742453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.742881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.743053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.743852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.744369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.744648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.744865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.745693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.747626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.750505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.762118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 892/1785] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:29 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:29.763087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.794709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b206d3-3991-473b-9286-01ccbb81b472 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.800757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.802660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.803042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.803419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.804284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.806730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.825650 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 894/1786] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:29.825650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.848008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b298-9ad0-4e52-9bfb-93cbd708c475 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:29.868253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 893/1787] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:29.870455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.872034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:29.874588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:29.875248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:29.876294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] PATH_INFO: `/v3/projects/048bb58bfab9450d97da70ab258ed111/users/48c93cb93c354ac390a3d31c2f8df61f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:29.899111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048bb58bfab9450d97da70ab258ed111, user_id=48c93cb93c354ac390a3d31c2f8df61f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:29.902053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:29.926074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 895/1788] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:29 2021] PUT /identity/v3/projects/048bb58bfab9450d97da70ab258ed111/users/48c93cb93c354ac390a3d31c2f8df61f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:29.927335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:29.965515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583773-feae-43f3-a030-5ca74590facd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.018574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f9eb-6645-42af-b034-ddf82c578ff5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.027243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.027924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.028202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.028475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.029431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.031469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.046977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.047813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.048186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.048580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.049468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.051577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.053534 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 896/1789] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:29 2021] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:30.054406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.066669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189de77-4a64-40d4-8523-2453455995dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.073360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 894/1790] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:29 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:30.073360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.075863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.077448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.077925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.078337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.079237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.081025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.092019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 897/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:30.105019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.105197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ef81-d1a9-4f55-b6ea-3185a073d7c0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.112593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912554-da44-422c-aabe-50358a8b91a4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.113874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.114024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.114424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.114534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.115529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.117406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.125255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.125925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.126202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.126474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.127226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.132741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.145863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 895/1792] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:30.146908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.154058 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 898/1793] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:30.157647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a395-043f-4c93-8fe1-f51ddc646a47 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.163821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.164897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.165061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.165211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.165492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] PATH_INFO: `/v3/projects/048bb58bfab9450d97da70ab258ed111/users/48c93cb93c354ac390a3d31c2f8df61f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.168794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048bb58bfab9450d97da70ab258ed111, user_id=48c93cb93c354ac390a3d31c2f8df61f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.172300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.187857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9fb56-57da-47d7-92c1-2180efade168 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.189609 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 896/1794] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:30 2021] PUT /identity/v3/projects/048bb58bfab9450d97da70ab258ed111/users/48c93cb93c354ac390a3d31c2f8df61f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:30.193944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.333246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.334181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a33697-f39d-4595-8268-e1a041d9f755 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.334312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.334588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.334918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.335877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.337617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.339886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.341311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.341848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.342139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] PATH_INFO: `/v3/projects/3aea8cf3e80e446ca97c8be63746c2b9/users/d317cac37eb346d2981026fa63267a13/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.372812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 899/1795] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:30.378021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.392989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aea8cf3e80e446ca97c8be63746c2b9, user_id=d317cac37eb346d2981026fa63267a13, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.395956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e976998-75d2-4530-bb26-cd7af607717b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.403494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed450914-7e43-4e11-a1c3-37bcaee59c6a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.415450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.417682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.428450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.428450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] PATH_INFO: `/v3/projects/a17b8439aab5416baf5623b3adedbb8c/users/25402f2151994aaa812407c629812b2c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.429177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 897/1796] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:30 2021] PUT /identity/v3/projects/3aea8cf3e80e446ca97c8be63746c2b9/users/d317cac37eb346d2981026fa63267a13/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:30.430934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.431445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.431937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.449552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17b8439aab5416baf5623b3adedbb8c, user_id=25402f2151994aaa812407c629812b2c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.453273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc088f74-4df5-4fe7-98bd-50cde05ce994 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.481277 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 900/1797] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:30 2021] PUT /identity/v3/projects/a17b8439aab5416baf5623b3adedbb8c/users/25402f2151994aaa812407c629812b2c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:30.483600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] MFA Rules not processed for user `d317cac37eb346d2981026fa63267a13`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:30.484929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:30.492458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.492773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.493052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.551907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] MFA Rules not processed for user `25402f2151994aaa812407c629812b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:30.553524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:30.635437 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 898/1798] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:30 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:30.652589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.659939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:30.703269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 901/1799] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:30.709632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.818063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc8e5-6961-49ba-b48e-001664d58d98 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.824395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.825515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.827290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.827726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.837273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb0a9-aab2-456e-81ee-0af9d232b123 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:30.838660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.840894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.842367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:30.843160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:30.843847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:30.844409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:30.846180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:30.849788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:30.870766 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 899/1800] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:30 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:30.925989 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 902/1801] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:30 2021] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:30.927596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:30.942358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce66af-060d-49b2-9624-129bb3edd819 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.055702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.056632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.057118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.057452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.058308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.060558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.119327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.131298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b36f-180d-46b7-974e-b98f60080eed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.134258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 900/1802] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:30 2021] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:31.143443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.144574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.145107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.145529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.146421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.148139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.163892 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 903/1803] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:31 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:31.164786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.182385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6173-c945-4cb5-8716-d21237ca4870 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.195011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.195915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.196190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.196460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] PATH_INFO: `/v3/projects/c825532346c84fa890836f19a09533c0/users/fc5365fa60df4c64b8137280228d7b99/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.244905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c825532346c84fa890836f19a09533c0, user_id=fc5365fa60df4c64b8137280228d7b99, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.247549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.277331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 901/1804] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:31 2021] PUT /identity/v3/projects/c825532346c84fa890836f19a09533c0/users/fc5365fa60df4c64b8137280228d7b99/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:31.278957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.292760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5b0e-7df3-44d4-9215-bcc47562ec5e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.386720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.387521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.387903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.388278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.389182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.391593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d059b-4f3c-4317-bdde-04d52cbe68f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.408652 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 904/1805] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:31 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:31.411434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.425433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac380b29-62d8-4774-94f7-6b2775a64ebd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.431151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.432699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.433050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.433289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] PATH_INFO: `/v3/projects/c825532346c84fa890836f19a09533c0/users/fc5365fa60df4c64b8137280228d7b99/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.438464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c825532346c84fa890836f19a09533c0, user_id=fc5365fa60df4c64b8137280228d7b99, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.441789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832dea-a048-42da-9a26-829dde02148b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.464908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 902/1806] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:31 2021] PUT /identity/v3/projects/c825532346c84fa890836f19a09533c0/users/fc5365fa60df4c64b8137280228d7b99/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:31.469976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.470281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.470563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.503013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] MFA Rules not processed for user `fc5365fa60df4c64b8137280228d7b99`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:31.505572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:31.597522 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 905/1807] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:31 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:31.609187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.609485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.609729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.631581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] MFA Rules not processed for user `25402f2151994aaa812407c629812b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:31.632810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:31.663686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.742706 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 903/1808] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:31.782511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d49bf5-ee7b-4d91-b9a2-edb009ba8dcc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.788053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:31.789120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.789414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.789670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] PATH_INFO: `/v3/users/d317cac37eb346d2981026fa63267a13` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.791604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d317cac37eb346d2981026fa63267a13)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:31.796024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:31.837860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:31.839613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:31.858352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd317cac37eb346d2981026fa63267a13'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:31.865535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd317cac37eb346d2981026fa63267a13'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:31.866853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd317cac37eb346d2981026fa63267a13'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:31.867523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd317cac37eb346d2981026fa63267a13'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:31.876366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-93dbc06a-e15b-4508-811a-c76769d41889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd317cac37eb346d2981026fa63267a13'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:31.902229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 906/1809] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:31 2021] DELETE /identity/v3/users/d317cac37eb346d2981026fa63267a13 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:31.908630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:31.909001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:31.909345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:31.927880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928eee2-6109-43fd-ab34-6e6fa9f23795 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:31.931690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:31.933052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:32.012402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:32.013429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:32.014436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:32.014898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:32.017039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:32.017165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 907/1810] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:32.027230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:32.029116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:32.094902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:32.096834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:32.107676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 904/1811] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:57:32.127264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af6a8-21b5-429d-b595-d76a72533166 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:32.135939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:32.136653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:32.136907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:32.137282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:32.149512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:32.151140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082b756-5f77-49ed-87e3-6f2d7e942974 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:32.163063 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 908/1812] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:57:33.037526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.039964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:33.078532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b80c38-7bbd-4085-b534-896218c27169 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.098018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.112412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.114178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.114685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] PATH_INFO: `/v3/projects/3aea8cf3e80e446ca97c8be63746c2b9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.117563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aea8cf3e80e446ca97c8be63746c2b9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.121623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.234680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aea8cf3e80e446ca97c8be63746c2b9', 'request_id': 'req-9c24f571-9ac3-47c5-a352-1f770ba21c0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:33.249920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aea8cf3e80e446ca97c8be63746c2b9', 'request_id': 'req-9c24f571-9ac3-47c5-a352-1f770ba21c0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:33.310062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aea8cf3e80e446ca97c8be63746c2b9', 'request_id': 'req-9c24f571-9ac3-47c5-a352-1f770ba21c0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:33.350971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] The token cache is being invalidate because project 3aea8cf3e80e446ca97c8be63746c2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:33.351463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:33.352452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c24f571-9ac3-47c5-a352-1f770ba21c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:33.356716 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 905/1813] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:33 2021] DELETE /identity/v3/projects/3aea8cf3e80e446ca97c8be63746c2b9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:33.365591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.366462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.366739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.423658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:33.428762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:33.538453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 909/1814] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:33.552103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.552103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.552103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.598490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:33.599823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:33.610918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 906/1815] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:33.615213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.626666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3104c01-2711-41d5-a613-f793f1c06609 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.632084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.633156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.633785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.634242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.635180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:33.635674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.637767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.652232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 910/1816] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:33.657253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.669431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1cb09-8fbb-49c1-94d9-1a7796f75f72 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.675110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.675847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.676131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.676599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.677369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.679925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.721181 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 907/1817] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:33 2021] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:33.725201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.736907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2355-d8b9-4a98-8844-b7cfd10bd11d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.840544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.841261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.841584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.842519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.843368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.845353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.869832 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 911/1818] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:33 2021] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:57:33.873972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.894627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27ae99-4caa-4460-a6ec-6d39399b3f26 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.900143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.901671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.901671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.901671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.902917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.905444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.918382 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 908/1819] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:33.922292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.934821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a02a6-b736-48e6-b561-e5be2aeb9f53 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.940549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.941289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.941612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.941901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:33.942693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:33.944583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547d858-c01b-4e05-825c-7ff3df4aff27 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:33.959945 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 912/1820] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:33.964320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:33.975667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e01da-8f5e-4242-b8ae-814cb54b543c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:33.980876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:33.981779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:33.982055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:33.982359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] PATH_INFO: `/v3/projects/1f1d6495f2f64f639c00e139f25c8348/users/eaff022e70ea499dbd08210a7e54d15f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:34.002371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d6495f2f64f639c00e139f25c8348, user_id=eaff022e70ea499dbd08210a7e54d15f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:34.005298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:34.033710 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 909/1821] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:33 2021] PUT /identity/v3/projects/1f1d6495f2f64f639c00e139f25c8348/users/eaff022e70ea499dbd08210a7e54d15f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:34.045777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:34.045777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:34.046062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:34.091903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] MFA Rules not processed for user `eaff022e70ea499dbd08210a7e54d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:34.093490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:34.203494 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 913/1822] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:34 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:34.216488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:34.219966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:34.376118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1167cd-c643-4320-933e-5478f1f0b936 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:34.383711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:34.384689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:34.385155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:34.385593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:34.417278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:34.419646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1261ad-f746-406a-b1b3-07a5a80abb0f service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:34.449072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 910/1823] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:34 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:34.982089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:35.075356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a07314-114e-4b68-af79-7af7b3a956ed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:35.083658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:35.085090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:35.085660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:35.086536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] PATH_INFO: `/v3/users/eaff022e70ea499dbd08210a7e54d15f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:35.087960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaff022e70ea499dbd08210a7e54d15f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:35.090795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:35.164412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaff022e70ea499dbd08210a7e54d15f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:35.174727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaff022e70ea499dbd08210a7e54d15f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:35.176404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaff022e70ea499dbd08210a7e54d15f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:35.177600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaff022e70ea499dbd08210a7e54d15f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:35.194212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaff022e70ea499dbd08210a7e54d15f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:35.238835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 914/1824] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:34 2021] DELETE /identity/v3/users/eaff022e70ea499dbd08210a7e54d15f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:35.243335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178edd-8568-468b-8cfd-93c7fc6f1cd2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:35.243854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178edd-8568-468b-8cfd-93c7fc6f1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:35.243929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178edd-8568-468b-8cfd-93c7fc6f1cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:35.279383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f2178edd-8568-468b-8cfd-93c7fc6f1cd2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:35.280474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f2178edd-8568-468b-8cfd-93c7fc6f1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:35.368512 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 911/1825] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:35.391935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:35.393639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:35.534187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b39afa-989a-45c3-a0b2-19a73731f16c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:35.547319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:35.548345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:35.548641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:35.548960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:35.573796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:35.575479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab03d8-4638-4580-8302-bee7377e5112 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:35.593212 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 915/1826] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:36.150182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:36.150442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:36.150887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:36.153219 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 912/1827] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:57:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:36.170567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:36.171525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:36.171960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:36.226126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:36.227700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:36.416763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 916/1828] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:57:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:36.698770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:36.701836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:36.725171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c8d0-3e35-4ba4-9beb-9784fb9b942e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:36.754222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:36.756380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:36.757896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:36.758194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:36.770661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:36.772249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3b60-58dc-4648-91c1-f6cfaefeb948 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:36.785361 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 913/1829] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:37.163866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:37.170618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:37.196245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4292038-63a2-4312-b14b-71ec15c75813 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:37.229533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:37.231293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.231779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.234337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] PATH_INFO: `/v3/projects/1f1d6495f2f64f639c00e139f25c8348` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.237329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1d6495f2f64f639c00e139f25c8348)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:37.249737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:37.355913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1d6495f2f64f639c00e139f25c8348', 'request_id': 'req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:37.374266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1d6495f2f64f639c00e139f25c8348', 'request_id': 'req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:37.388349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1d6495f2f64f639c00e139f25c8348', 'request_id': 'req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:37.417617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] The token cache is being invalidate because project 1f1d6495f2f64f639c00e139f25c8348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:37.418097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:37.418790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94995da1-5bc1-43c0-89b8-8f0ec4cc4e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:37.423644 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 917/1830] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:37 2021] DELETE /identity/v3/projects/1f1d6495f2f64f639c00e139f25c8348 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:37.430637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60fbc-e2f9-44b8-8d0c-0b27d92edb04 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.430637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60fbc-e2f9-44b8-8d0c-0b27d92edb04 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.431024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60fbc-e2f9-44b8-8d0c-0b27d92edb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.470681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62b60fbc-e2f9-44b8-8d0c-0b27d92edb04 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:37.472757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62b60fbc-e2f9-44b8-8d0c-0b27d92edb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:37.679577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 914/1831] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:37.688470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.691215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.694315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.749557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.750588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.751045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.782286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:37.783894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:37.815927 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 918/1832] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:37.819693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:37.823677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] MFA Rules not processed for user `48c93cb93c354ac390a3d31c2f8df61f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:37.824906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:37.839663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef0ff4-c6f6-49a5-9e97-1c5c25a39b79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:37.846681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:37.847514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.847894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.848290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.849397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:37.849959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:37.852998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:37.874007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 919/1833] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:37.885576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:37.905735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e558-7c87-400d-b83c-aa7bb107134a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:37.927517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:37.928447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:37.928874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:37.929260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:37.930567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:37.933567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.003123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 920/1834] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:37 2021] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:38.008199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.023571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 915/1835] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:37 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:38.132229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.133736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb30b-1d65-473d-8db5-aa89b38877ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.133868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:38.139865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.140488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.140822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.141099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.141825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.144266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.169219 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 921/1836] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:38 2021] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:38.173233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.186752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b96c56-7c79-4a2c-b0c9-bf673fef4b01 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.191939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.192634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.192991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.193217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.193958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.197568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.209654 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 922/1837] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:38.213998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.226455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f949-668a-4247-b3b7-69da10aace43 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.231561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.232304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.232673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.233004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.233942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.235555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.239124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511ccb-36bc-428d-a070-12d2f9800e2b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.246010 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 923/1838] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:38.250841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.262667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdab1-5695-40f6-8ad7-d5cacca2657d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.271467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.272373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.272740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.273057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] PATH_INFO: `/v3/projects/9957f52b323e40be9cec54e6b1bc062f/users/a6936f0a5ca0493db3a199c411df9da0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.306276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9957f52b323e40be9cec54e6b1bc062f, user_id=a6936f0a5ca0493db3a199c411df9da0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.310877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0ef12-7d8d-4d73-b7fe-248532a7682b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.330860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 924/1839] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:38 2021] PUT /identity/v3/projects/9957f52b323e40be9cec54e6b1bc062f/users/a6936f0a5ca0493db3a199c411df9da0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:38.335468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.335856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.336250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.336385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.337083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.337674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.337947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.339970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:38.356179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:38.358313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:38.423421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.425649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.437054 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 916/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:38 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:57:38.463631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 925/1841] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:38.470143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.475000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:38.479298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:38.485831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01790-daf7-4a4c-8434-b9b7811cabad service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.571182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d34a50-8c94-47d7-9c9a-bf45d6f5be53 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:38.576019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.576826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.577195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.577562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.588033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.589583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5cb11-1aff-4371-80f1-3e72a0731a40 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.606294 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 926/1842] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:38.651604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91289-295e-402e-a763-70ffada26000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:38.652379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91289-295e-402e-a763-70ffada26000 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:38.652642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91289-295e-402e-a763-70ffada26000 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:38.652946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91289-295e-402e-a763-70ffada26000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:38.746638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91289-295e-402e-a763-70ffada26000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:38.748575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91289-295e-402e-a763-70ffada26000 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:38.760872 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 917/1843] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:38 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:40.098708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39094-75b9-49cb-a19b-c9074fa61934 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:40.099611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39094-75b9-49cb-a19b-c9074fa61934 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:40.100586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39094-75b9-49cb-a19b-c9074fa61934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:40.155282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7cd39094-75b9-49cb-a19b-c9074fa61934 None None] MFA Rules not processed for user `a6936f0a5ca0493db3a199c411df9da0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:40.156859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7cd39094-75b9-49cb-a19b-c9074fa61934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:40.307817 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 927/1844] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:40 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:40.315591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91289-295e-402e-a763-70ffada26000 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:40.317887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37f91289-295e-402e-a763-70ffada26000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:40.393932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91289-295e-402e-a763-70ffada26000 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:40.400470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:40.401413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:40.401914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:40.402388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:40.413375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:40.414962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a841-3c38-4bb8-8b7f-952c816cca49 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:40.425082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 918/1845] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:40 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:41.863369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:41.863811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:41.863896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:41.882673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321a9ce-3827-4d6e-b7f1-64178dc87459 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:41.883222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321a9ce-3827-4d6e-b7f1-64178dc87459 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:41.883222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321a9ce-3827-4d6e-b7f1-64178dc87459 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:41.885576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 919/1846] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:57:41.889807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] MFA Rules not processed for user `ebb77877fd9f4a398e15837f80b60bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:41.890761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:41.891046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:41.891327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:41.891664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:41.910353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:41.911564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:41.967716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 928/1847] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:41 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:41.994823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:42.021413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:42.022892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:42.040165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94528-0853-47be-9823-a3eee64ccce3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:42.047215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:42.047886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:42.048170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:42.048501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:42.057657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:42.059241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b99710-9d4d-44a0-b592-6f9ecd4f9cfa service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:42.071257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 929/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:42.113825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:42.141947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acccd88-a5c0-4de6-805a-0399b146dfb4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:42.148970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:42.149660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:42.149920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:42.150183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:42.152278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:42.216812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:42.218384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a229-1d18-49c7-a289-665aa44d3835 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:42.228150 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 921/1850] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:42 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:42.636146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a977-2a8e-4688-969b-9603706e2f20 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:42.636452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a977-2a8e-4688-969b-9603706e2f20 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:42.636762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a977-2a8e-4688-969b-9603706e2f20 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:42.638635 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 930/1851] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:42.644774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:42.645148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:42.645419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:42.676308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:42.677786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:42.694434 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 922/1852] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:42 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:42.706343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a977-2a8e-4688-969b-9603706e2f20 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:42.717501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a977-2a8e-4688-969b-9603706e2f20 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:42.721045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:42.721673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:42.721949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:42.722218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:42.729312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:42.730698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:42.738854 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 931/1853] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:46.187058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:46.201389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7971-1bbd-485b-9069-23e3f1cb81fd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:46.208901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:46.209806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:46.210234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:46.210682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:46.212757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:46.299530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:46.301613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617689a0-704c-4d1c-8ef1-54b449bf2058 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:46.312059 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 923/1854] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:46 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:46.691620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:46.693856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:46.773775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443356-db37-4dfd-bb7c-8e63b191eaa3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:46.774067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443356-db37-4dfd-bb7c-8e63b191eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:46.774369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443356-db37-4dfd-bb7c-8e63b191eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:46.790722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf06fc7-6857-4c35-b3e5-e0b74bd34dd5 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:46.801194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a8443356-db37-4dfd-bb7c-8e63b191eaa3 None None] MFA Rules not processed for user `3369baa68ddd4eb0a5df5923a1974fed`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:46.802887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a8443356-db37-4dfd-bb7c-8e63b191eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:46.807557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:46.809047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:46.809644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:46.810791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] PATH_INFO: `/v3/users/340283bb618c43c1bb1b03a2f12b0717` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:46.813556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=340283bb618c43c1bb1b03a2f12b0717)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:46.820624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:46.930187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340283bb618c43c1bb1b03a2f12b0717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:46.960528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340283bb618c43c1bb1b03a2f12b0717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:46.962566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340283bb618c43c1bb1b03a2f12b0717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:46.963513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340283bb618c43c1bb1b03a2f12b0717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:46.969997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 924/1855] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:46 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:46.983351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340283bb618c43c1bb1b03a2f12b0717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.029515 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 932/1856] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:46 2021] DELETE /identity/v3/users/340283bb618c43c1bb1b03a2f12b0717 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:47.033979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:47.034466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:47.035069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:47.102860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:47.106587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:47.114755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:47.119403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:47.225677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894775d6-a994-44a4-9b17-e59076c3ee8a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:47.230823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:47.232817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:47.233406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:47.233969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] PATH_INFO: `/v3/users/a6936f0a5ca0493db3a199c411df9da0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:47.235742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6936f0a5ca0493db3a199c411df9da0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:47.237964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:47.243012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 925/1857] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:47.300419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:47.302068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:47.331498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6936f0a5ca0493db3a199c411df9da0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.343568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6936f0a5ca0493db3a199c411df9da0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.344315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6936f0a5ca0493db3a199c411df9da0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.345009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6936f0a5ca0493db3a199c411df9da0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.361321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6936f0a5ca0493db3a199c411df9da0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.395234 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 933/1858] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:47 2021] DELETE /identity/v3/users/a6936f0a5ca0493db3a199c411df9da0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:47.424498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1e7e6-4a1f-413e-bbe4-1147dab0419e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:47.499403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:47.505542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:47.505840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:47.506330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:47.509093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:47.658243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:47.659985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05344708-1fa0-4255-bcf8-fc45cb4aab76 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:47.675023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 926/1859] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:47.719475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:47.721602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:47.746480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9401e6-8003-4c79-890f-0fed4c6f06a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:47.788218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:47.790892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:47.791179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:47.792838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] PATH_INFO: `/v3/projects/9957f52b323e40be9cec54e6b1bc062f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:47.798076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9957f52b323e40be9cec54e6b1bc062f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:47.804943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:47.924009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9957f52b323e40be9cec54e6b1bc062f', 'request_id': 'req-fdcbd217-2970-4a9f-b062-69623049524f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.946254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9957f52b323e40be9cec54e6b1bc062f', 'request_id': 'req-fdcbd217-2970-4a9f-b062-69623049524f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.965338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9957f52b323e40be9cec54e6b1bc062f', 'request_id': 'req-fdcbd217-2970-4a9f-b062-69623049524f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.993192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] The token cache is being invalidate because project 9957f52b323e40be9cec54e6b1bc062f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:47.994227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:47.995502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.000135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 934/1860] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:47 2021] DELETE /identity/v3/projects/9957f52b323e40be9cec54e6b1bc062f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:48.005749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d533cb-0154-4b8d-bf3a-e381ad04bfe0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.006010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d533cb-0154-4b8d-bf3a-e381ad04bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.006392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d533cb-0154-4b8d-bf3a-e381ad04bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.087758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-95d533cb-0154-4b8d-bf3a-e381ad04bfe0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:48.089220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-95d533cb-0154-4b8d-bf3a-e381ad04bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.138455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.140323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.226873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 927/1861] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:48.229205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.229537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.229974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.257598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:48.260173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.264849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbd217-2970-4a9f-b062-69623049524f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.278158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.279242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.279705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.279998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] PATH_INFO: `/v3/users/9ce74759f04041d3aff19617232e66c8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.283735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce74759f04041d3aff19617232e66c8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.288352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.288480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 928/1862] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:48.289644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.314544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f826ba3-99c2-4dce-aa19-ffd80dd3f7d5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.322813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.323966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.324508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.325061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.326352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:48.333904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.335622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.358295 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 929/1863] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:57:48.360168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.373136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e255c37-9828-4b72-9f98-1bffc2126d83 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.405424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.407509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.407774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.408935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.410078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce74759f04041d3aff19617232e66c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.412076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.416270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.436414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce74759f04041d3aff19617232e66c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.438150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce74759f04041d3aff19617232e66c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.444134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce74759f04041d3aff19617232e66c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.462617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce74759f04041d3aff19617232e66c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.503590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 935/1865] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:48 2021] DELETE /identity/v3/users/9ce74759f04041d3aff19617232e66c8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:48.504621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.504724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 930/1865] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:48 2021] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:48.507540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.509600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.519729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.649886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb7b5-a194-4101-b51f-0b4d6de1a1f6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.652426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a8ad-d8f7-4a90-9334-b65a25492658 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.665684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.666359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.666645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.666966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.675042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.777474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.778335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.779147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.779457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] PATH_INFO: `/v3/projects/ab88bff9418941ccb7f2042cc8b2080e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.782005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab88bff9418941ccb7f2042cc8b2080e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.783884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.812474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.816123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.839185 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 936/1866] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:48 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:48.840024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.844086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.874265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb522-ace7-4176-a818-dbfdcd1d6452 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:48.890557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab88bff9418941ccb7f2042cc8b2080e', 'request_id': 'req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.903719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab88bff9418941ccb7f2042cc8b2080e', 'request_id': 'req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.918723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab88bff9418941ccb7f2042cc8b2080e', 'request_id': 'req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.938548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] The token cache is being invalidate because project ab88bff9418941ccb7f2042cc8b2080e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:48.939133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.939947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67e8cd36-00e0-4b2b-93cf-74ab6a8ceb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:48.941993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 931/1867] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:48 2021] DELETE /identity/v3/projects/ab88bff9418941ccb7f2042cc8b2080e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:48.945631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.946165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.946587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.965044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:48.966997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:48.967500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:48.968176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:48.969224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:48.969673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:48.970523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:48.972626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:48.981801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 932/1868] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:48.982747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:48.985133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.002290 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 937/1869] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:48 2021] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:49.003522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b0864-92cc-4bb3-999f-1cfa1e262069 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.006558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.008743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.009266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.009677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.009958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.010296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] PATH_INFO: `/v3/users/d900351de0054c81baac94f55a98b955` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.011955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d900351de0054c81baac94f55a98b955)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.014574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.025391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867595ab-cc26-4f2f-962f-8b82a7c3a303 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.044742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.048209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.048794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.049250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.054260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.057421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.075001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 938/1870] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:49 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:49.078614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.081264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.095905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd900351de0054c81baac94f55a98b955'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:49.106975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd900351de0054c81baac94f55a98b955'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:49.107953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd900351de0054c81baac94f55a98b955'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:49.122675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd900351de0054c81baac94f55a98b955'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:49.133382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd900351de0054c81baac94f55a98b955'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:49.155743 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 933/1871] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:48 2021] DELETE /identity/v3/users/d900351de0054c81baac94f55a98b955 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:49.158821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.161645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.199071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbccac-d2a0-490a-9953-766fc23b1302 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.273139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.273805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.274089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.274365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.280417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.313102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a364c6-fd0b-4556-b14e-0411d29f28ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.331567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.332621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.332785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.333030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.333778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.336410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.349847 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 934/1872] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:49 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:49.353710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.381285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b11e-6199-42a7-8745-9fd17efe454d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.393745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.396027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.397117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.397932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] PATH_INFO: `/v3/projects/47dde7e7b75546528abdc1597a46d061/users/59542a32ba22426da5aaccaec682086d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.399278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.406662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a85be-5eb3-40fe-8904-1f19194de2e5 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.449395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 939/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:49.453415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47dde7e7b75546528abdc1597a46d061, user_id=59542a32ba22426da5aaccaec682086d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.458819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b96af1-6602-478c-96fc-1651d9bf842b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.477651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 935/1874] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:49 2021] PUT /identity/v3/projects/47dde7e7b75546528abdc1597a46d061/users/59542a32ba22426da5aaccaec682086d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:49.489392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.489704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.489956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.532157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] MFA Rules not processed for user `59542a32ba22426da5aaccaec682086d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:49.535420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.653889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 940/1875] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:49 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:49.668737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.669137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.670240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.671476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.673092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.691297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:49.692760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.748451 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 936/1876] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:49 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:49.767364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b8f8e-608e-4bd2-a3eb-0f0834cb5baf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.773706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.774966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.775558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.776009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.785486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.786558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.787858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:49.788380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.801276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 941/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:49 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:49.819799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845b8c1-8029-4c28-87ff-5c84456fa48c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:49.825073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:49.831171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.831171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.831171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.844022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:49.846637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f0de-3ba8-4e93-aa25-3c8d9804af50 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:49.862537 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 937/1878] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:57:49.868033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:49.942776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c9e4-fe7a-437d-a2b3-864ca66f5d34 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.943385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c9e4-fe7a-437d-a2b3-864ca66f5d34 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.943837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c9e4-fe7a-437d-a2b3-864ca66f5d34 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:49.960252 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 938/1879] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:57:49 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:49.967530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:49.969105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:49.969444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.009395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2e1b-c9ee-409c-9ee7-601263f41d1d service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.021161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:50.022625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.022903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.023174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] PATH_INFO: `/v3/users/59542a32ba22426da5aaccaec682086d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.024519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59542a32ba22426da5aaccaec682086d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:50.026446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:50.046754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:50.047974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.130297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59542a32ba22426da5aaccaec682086d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.140819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59542a32ba22426da5aaccaec682086d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.141869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59542a32ba22426da5aaccaec682086d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.142585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59542a32ba22426da5aaccaec682086d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.153239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ed723ea-8911-45e1-b208-027993f506b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59542a32ba22426da5aaccaec682086d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.161457 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 939/1880] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:57:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:50.163038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.166912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.185823 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 942/1881] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:49 2021] DELETE /identity/v3/users/59542a32ba22426da5aaccaec682086d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:50.190541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.191182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.192956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.207636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee85a25-e66e-4ec9-8628-2fa7a9c62a91 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.219196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:50.220577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.286020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:50.288036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.288547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.289082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] PATH_INFO: `/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.291154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbad3a0c439401ea9505edb4bfc7cc2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:50.295519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:50.303012 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 943/1882] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:50.304101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.305851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.387830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbad3a0c439401ea9505edb4bfc7cc2', 'request_id': 'req-6c948a2c-da64-4cec-b811-d6980bf90502'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.394307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbad3a0c439401ea9505edb4bfc7cc2', 'request_id': 'req-6c948a2c-da64-4cec-b811-d6980bf90502'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.404459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbad3a0c439401ea9505edb4bfc7cc2', 'request_id': 'req-6c948a2c-da64-4cec-b811-d6980bf90502'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.415053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab63d-66d8-4d07-8875-01fdb9925c78 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.433850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] The token cache is being invalidate because project 7bbad3a0c439401ea9505edb4bfc7cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:50.434148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.435141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.438795 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 940/1883] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:50 2021] DELETE /identity/v3/projects/7bbad3a0c439401ea9505edb4bfc7cc2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:50.439413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.443349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.512223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:50.514027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.514892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.515166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.517092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.559113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:50.563682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:50.573204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948a2c-da64-4cec-b811-d6980bf90502 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.583104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:50.584472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.585722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.586559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] PATH_INFO: `/v3/projects/a80ba1af7939454d9e27540022b25f3c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.588493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80ba1af7939454d9e27540022b25f3c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:50.590840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:50.595816 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 944/1884] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:50.597715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.602823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.672009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d697-85cb-4526-89e4-068a6bfdb87b service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.676750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:50.677662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.678172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.678573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.680847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.699853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:50.702455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecca7a-17f6-4ab6-8813-4e1bb36acae2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:50.718688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 945/1885] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:50.720411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9573faa-3f38-4158-aa2d-b979a62b3824 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.721051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9573faa-3f38-4158-aa2d-b979a62b3824 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.721470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9573faa-3f38-4158-aa2d-b979a62b3824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.727081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80ba1af7939454d9e27540022b25f3c', 'request_id': 'req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.743487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80ba1af7939454d9e27540022b25f3c', 'request_id': 'req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.745645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d9573faa-3f38-4158-aa2d-b979a62b3824 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:50.748322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9573faa-3f38-4158-aa2d-b979a62b3824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.758444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80ba1af7939454d9e27540022b25f3c', 'request_id': 'req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.791462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] The token cache is being invalidate because project a80ba1af7939454d9e27540022b25f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:50.792166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.793386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:50.813705 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 941/1886] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:50 2021] DELETE /identity/v3/projects/a80ba1af7939454d9e27540022b25f3c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:50.814756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.818680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.901148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 946/1887] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:50.909060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369456-639d-4293-9e29-c59f60249535 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:50.909341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369456-639d-4293-9e29-c59f60249535 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:50.909763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369456-639d-4293-9e29-c59f60249535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:50.942410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-27369456-639d-4293-9e29-c59f60249535 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:50.951351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-27369456-639d-4293-9e29-c59f60249535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:50.967815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ba54-a8a5-4f04-83e7-ff2a5159f5be admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:50.973723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 947/1888] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:50.979627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27369456-639d-4293-9e29-c59f60249535 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:50.988135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.005533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.006008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.006376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] PATH_INFO: `/v3/users/916e27d4e40447c1b10385466fba2148` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.009520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916e27d4e40447c1b10385466fba2148)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.012154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.015300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27369456-639d-4293-9e29-c59f60249535 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.033094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.034609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.035461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.036057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.037922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:51.039963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.042900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86bbd-a411-4403-98c8-97c7c44eb1af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.082066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 948/1889] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:51.084230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0248e-88f2-4673-9702-e3002fd17c5c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.084737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0248e-88f2-4673-9702-e3002fd17c5c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.085181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0248e-88f2-4673-9702-e3002fd17c5c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.089975 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 949/1890] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:57:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:51.091180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0248e-88f2-4673-9702-e3002fd17c5c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.107690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0248e-88f2-4673-9702-e3002fd17c5c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.114018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.115031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.115409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.115836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.116903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.123854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041d72a-293a-4d0c-a951-2a1abd5314c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.153857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916e27d4e40447c1b10385466fba2148'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.156639 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 950/1891] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:51.158140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.158524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.158896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.180947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:51.186234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.210639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916e27d4e40447c1b10385466fba2148'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.211836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916e27d4e40447c1b10385466fba2148'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.245533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916e27d4e40447c1b10385466fba2148'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.266379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916e27d4e40447c1b10385466fba2148'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.276480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 942/1892] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:50 2021] DELETE /identity/v3/users/916e27d4e40447c1b10385466fba2148 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:51.277696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.282513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.289021 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 951/1893] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:51.319787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.321487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.335423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e7d9-9076-48d2-ad96-4a3a2593385f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.364885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21e29-f947-418d-aadf-6785b592fdd6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.370694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.371703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.372129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.372576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.373455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.376283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.404772 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 943/1894] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:51.408910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.424866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81e2a3-5644-4d9e-a98a-ef3d80584200 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.433288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.435644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.436082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.436762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.438108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.442178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.454749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.455431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.455715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.456000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.462123 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 944/1895] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:51 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:51.465209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.489331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.492348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.494822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ea72-0847-4133-bb8f-4222375842c7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.509956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.512049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.513238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.514691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.515742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 952/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:51.516897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.521379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.530290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.532371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.548531 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 945/1897] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:51 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:51.552189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.566236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89702-4224-4e25-8494-8d6e737b4481 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.581618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e893a8-b6cc-4f03-b488-e7d2f4b60a4a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.583925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.584822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.585106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.585388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] PATH_INFO: `/v3/projects/47dde7e7b75546528abdc1597a46d061` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.587889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.589019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.589542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.590104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] PATH_INFO: `/v3/projects/8abc1591b2d3476996683587fb4f4e5b/users/9429fa20b71d4312af00eb34fbc41e81/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.594317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47dde7e7b75546528abdc1597a46d061)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.596806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.612741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abc1591b2d3476996683587fb4f4e5b, user_id=9429fa20b71d4312af00eb34fbc41e81, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.620196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a16b50-8467-4257-83f0-50fe1e14870f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:51.645997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 946/1898] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:51 2021] PUT /identity/v3/projects/8abc1591b2d3476996683587fb4f4e5b/users/9429fa20b71d4312af00eb34fbc41e81/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:51.708870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663fd03-d175-4239-8e42-bfe74e300a30 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.709269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663fd03-d175-4239-8e42-bfe74e300a30 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.709649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663fd03-d175-4239-8e42-bfe74e300a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.741421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47dde7e7b75546528abdc1597a46d061', 'request_id': 'req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.749187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47dde7e7b75546528abdc1597a46d061', 'request_id': 'req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.756101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47dde7e7b75546528abdc1597a46d061', 'request_id': 'req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.767357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5663fd03-d175-4239-8e42-bfe74e300a30 None None] MFA Rules not processed for user `9429fa20b71d4312af00eb34fbc41e81`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:51.768776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5663fd03-d175-4239-8e42-bfe74e300a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.774239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] The token cache is being invalidate because project 47dde7e7b75546528abdc1597a46d061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:51.774572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.775245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a6a7e04a-a96c-46ee-96d5-2ee6090644f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:51.782964 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 953/1899] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:51 2021] DELETE /identity/v3/projects/47dde7e7b75546528abdc1597a46d061 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:51.782964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c418-174a-4bab-b801-2f8e37212f44 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.782964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c418-174a-4bab-b801-2f8e37212f44 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.782964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c418-174a-4bab-b801-2f8e37212f44 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.799968 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 954/1900] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:57:51 2021] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:57:51.807373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.807706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.808084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.848140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:51.849425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.924669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 947/1901] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:51.926370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.926757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.927138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.954862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 955/1902] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:51.954862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:51.954862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.963684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dad1a-99bb-4964-86f2-4a787e6c2967 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:51.966085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:51.970529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:51.970981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:51.971368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:51.971657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:51.971936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:51.972742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:51.975074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874f735-c967-4577-ab83-d3fd3f541948 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.028395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 956/1903] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:52.036919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.037218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.037498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.076900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:52.078756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.108225 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 948/1904] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:52.109507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.144082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bee73d-aff0-4d3b-8fba-04646c80a587 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.223141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 957/1905] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:52.226856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.235857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.235857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.236348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.236766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.237460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.237780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.240657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.263973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a908-ff0d-49ff-850c-ea0f4fa98ed3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.270643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.272401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.273309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.273589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 949/1906] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:52 2021] POST /identity/v3/users => generated 301 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:52.274042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] PATH_INFO: `/v3/users/5cf45a07294245c9bf0cf8bc554d6385` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.275846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf45a07294245c9bf0cf8bc554d6385)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.275964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.279062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.279673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.355497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf45a07294245c9bf0cf8bc554d6385'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.372105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf45a07294245c9bf0cf8bc554d6385'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.372105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf45a07294245c9bf0cf8bc554d6385'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.373034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf45a07294245c9bf0cf8bc554d6385'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.390172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf45a07294245c9bf0cf8bc554d6385'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.399333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330db84-4e16-4bda-9c37-4ce64b0054aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.417828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.418456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.421220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.421220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.435907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.437098 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 958/1907] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:52 2021] DELETE /identity/v3/users/5cf45a07294245c9bf0cf8bc554d6385 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:52.438009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.441918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.456485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.458803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.472756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 950/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:52.476721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.478629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.495054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6777-ae66-4f2b-98df-4b6a023c4521 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.595231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.596030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.596578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.596990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.597860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.599535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.612210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 951/1909] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:52 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:52.613294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.615335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.631028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccac69-6b8c-4505-a1ef-b230357ba355 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.637143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.638696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.639102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.639482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] PATH_INFO: `/v3/projects/7a916eb456a64773ae0abf746e32e1b6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.640866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a916eb456a64773ae0abf746e32e1b6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.643158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.659250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40f20-5f37-4f60-9e13-4f7a073ba3ff admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.667400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.668002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.668291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.668646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.670648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:52.670960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.672590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47456e-e425-4b23-979e-2d6196d2128c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.700173 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 959/1910] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:52.700173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.700173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.700173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.722680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a916eb456a64773ae0abf746e32e1b6', 'request_id': 'req-9ee9b205-1c6c-40a8-9523-b35571065489'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.728773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a916eb456a64773ae0abf746e32e1b6', 'request_id': 'req-9ee9b205-1c6c-40a8-9523-b35571065489'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.733007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:52.734218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.741632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a916eb456a64773ae0abf746e32e1b6', 'request_id': 'req-9ee9b205-1c6c-40a8-9523-b35571065489'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.761297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] The token cache is being invalidate because project 7a916eb456a64773ae0abf746e32e1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:52.761764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.762680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:52.765335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 952/1911] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:52 2021] DELETE /identity/v3/projects/7a916eb456a64773ae0abf746e32e1b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:52.771081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.772685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.838509 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 960/1912] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:52.839135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:52.843359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.857082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472557-ba72-4afc-9a27-2c9f6fd6c3ec None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:52.862224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:52.863124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.863508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.863905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.864926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:52.867513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc73235-a8cf-49d2-942f-319755f0d9ff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:52.927399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 961/1913] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:52 2021] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:52.929523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:52.929993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:52.930370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:52.953950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:52.955545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:52.959592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b205-1c6c-40a8-9523-b35571065489 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.097338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.098255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.098675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.098780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] PATH_INFO: `/v3/projects/bf60fb6381ce41a9bc324a3c090986df/users/fca8a6989dae45b99bdb231324719d6b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.123871 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 962/1914] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:53.124906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.127806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:53.138864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf60fb6381ce41a9bc324a3c090986df, user_id=fca8a6989dae45b99bdb231324719d6b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.143540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.190337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 953/1915] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:52 2021] PUT /identity/v3/projects/bf60fb6381ce41a9bc324a3c090986df/users/fca8a6989dae45b99bdb231324719d6b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:53.191158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.235904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e495503-5d59-4c5a-8c05-a0160491fab0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.328278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcc0ad-6a16-4c92-b8d4-69aeb7ee9a70 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.336449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.337266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.337623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.337961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.338748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.340781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d3ee-f921-4ecc-88ee-919970293c39 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.356043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.359072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.359370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.359754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.380337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.382842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.384824 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 954/1916] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:53 2021] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:53.387174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.387469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.387748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.400721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 963/1917] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:53.402022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.424833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:53.426062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:53.428283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bebed6-a862-4359-a411-3f8a9bbe8120 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.439280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 955/1918] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:53.440246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.447136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.451561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.451871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.452153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.452964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.456576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5e94-0a11-43c4-955e-1bc6bf79ac1f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.459306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.494921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.495767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.495881 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 964/1919] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:53.496226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.496623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.496727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.498321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.500151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.523831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dd0d-1d36-4437-bf07-59e1b387c3fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.528290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 956/1920] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:53.529323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.539926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.541778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.542083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.543025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.545098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:53.545443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.548493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.550426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b6ef-f720-4466-84b1-e9097a8a1484 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.565843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.566925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.567127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.567338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] PATH_INFO: `/v3/projects/bf60fb6381ce41a9bc324a3c090986df/users/fca8a6989dae45b99bdb231324719d6b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.573926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf60fb6381ce41a9bc324a3c090986df, user_id=fca8a6989dae45b99bdb231324719d6b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.576152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.587554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 965/1921] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:53.589351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.603436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ef75a-4f01-4778-b42a-4aecb97b6a8a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.627236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 957/1922] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:53 2021] PUT /identity/v3/projects/bf60fb6381ce41a9bc324a3c090986df/users/fca8a6989dae45b99bdb231324719d6b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:53.628248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.733827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150b35-7c15-4071-9e99-c41dee26682d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:53.735967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.737310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.738298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.739076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.741342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.744442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71695b3e-c8ce-48be-b13d-b23951dd5d09 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.748798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:53.749580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.750112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.750913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.751987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:53.758395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:53.776455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 966/1923] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:53.776900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:53.777192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:53.777467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:53.877690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 958/1924] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:53 2021] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:53.883778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:53.906078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] MFA Rules not processed for user `fca8a6989dae45b99bdb231324719d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:53.908217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.037335 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 967/1925] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:53 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:54.037335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.065318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ceb84-d18d-43cd-ab25-8fbabeacbd9d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.066795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777da6-deac-4d0b-a653-3bae89861f40 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.076511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.077229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.077502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.077773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.080379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.081511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.084580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.085444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.085729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] PATH_INFO: `/v3/projects/f44752ec82c74a28aa4dac2a2f8f88d3/users/18d81f586d0a4e8ea083ba207b9f905e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.087133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.120479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44752ec82c74a28aa4dac2a2f8f88d3, user_id=18d81f586d0a4e8ea083ba207b9f905e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.129925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6d15-e336-4cfb-9d09-ee2bc6c433f5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.141976 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 968/1926] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:54 2021] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:54.145811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.170544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 959/1927] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:53 2021] PUT /identity/v3/projects/f44752ec82c74a28aa4dac2a2f8f88d3/users/18d81f586d0a4e8ea083ba207b9f905e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:54.172494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.172850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.173408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.189967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d1ce-48ac-478c-8fde-efc855f23dfd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.193414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:54.195509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.273469 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 960/1928] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:54.274285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.279764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.315850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.316802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.317456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.317930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.319259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.322144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.334783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 969/1929] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:54 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:54.336129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.361297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574177d-aedc-4a6b-9fc4-103ab4e8918f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.367914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.368375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.368595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.368895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.404950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39e499-1def-443f-b277-b7c6c0d1fcec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.409383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.410547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.410831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.411098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.421254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.422679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.428113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.429728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.434196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 970/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:54.435730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.440656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 961/1931] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:54 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:54.449631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2629-f95d-4682-b4fc-a0297bc6dfed service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.472639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.473368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.473649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.473973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.480389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.487236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.499210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.500888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.502560 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 971/1932] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:54 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:54.507508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.509923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.521933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea964a43-2baf-4514-b628-32971c998a79 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.528580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.529748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.530053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.530389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] PATH_INFO: `/v3/projects/2b50d34b9bae42878e3fc0ebe3018c95` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.531629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b50d34b9bae42878e3fc0ebe3018c95)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.534132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370895fa-f2d9-4d51-8bdb-a786c963a3e0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.534308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.542534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.544046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.544343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.545063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.548117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.605736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b50d34b9bae42878e3fc0ebe3018c95', 'request_id': 'req-562c5846-13b1-4386-a565-8696ef50443a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.612966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b50d34b9bae42878e3fc0ebe3018c95', 'request_id': 'req-562c5846-13b1-4386-a565-8696ef50443a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.623322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b50d34b9bae42878e3fc0ebe3018c95', 'request_id': 'req-562c5846-13b1-4386-a565-8696ef50443a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.631076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.633390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.642508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] The token cache is being invalidate because project 2b50d34b9bae42878e3fc0ebe3018c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:54.643234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.644683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.647227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 962/1933] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:54 2021] DELETE /identity/v3/projects/2b50d34b9bae42878e3fc0ebe3018c95 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:57:54.648298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.650056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.666418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 972/1934] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:54 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:54.668096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.691454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79af8-538b-4659-816d-29734584aad5 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.810819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.812124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.812401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.813348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] PATH_INFO: `/v3/users/a25d6ef4e6c844f59aa5750fa33796f1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.815327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25d6ef4e6c844f59aa5750fa33796f1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.817286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.834853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5846-13b1-4386-a565-8696ef50443a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:54.844837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:54.845492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.846611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.846994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] PATH_INFO: `/v3/projects/bcc326f1e98540f29ec499bdce7f7122/users/7c319e6a54644dd5b25f8a435c68923d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.870160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc326f1e98540f29ec499bdce7f7122, user_id=7c319e6a54644dd5b25f8a435c68923d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:54.873806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771f3da-6329-40bd-b3c0-0e6c036b03c0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:54.898330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25d6ef4e6c844f59aa5750fa33796f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.901300 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 963/1935] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:54 2021] PUT /identity/v3/projects/bcc326f1e98540f29ec499bdce7f7122/users/7c319e6a54644dd5b25f8a435c68923d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:54.913703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:54.914257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:54.914634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:54.917072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25d6ef4e6c844f59aa5750fa33796f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.917938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25d6ef4e6c844f59aa5750fa33796f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.918711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25d6ef4e6c844f59aa5750fa33796f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.931600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25d6ef4e6c844f59aa5750fa33796f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:54.962650 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 973/1936] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:54 2021] DELETE /identity/v3/users/a25d6ef4e6c844f59aa5750fa33796f1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:54.962650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:54.962916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] MFA Rules not processed for user `7c319e6a54644dd5b25f8a435c68923d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:54.963156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:54.964649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.080192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b4fa9-6abc-4444-88f8-44323e2acce2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.087839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.088652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 964/1937] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:55.089745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.090047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.090438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.091119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] PATH_INFO: `/v3/users/1bd1c783ebc8445fbb2ce7e519fc5e9f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.091781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.093605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd1c783ebc8445fbb2ce7e519fc5e9f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.096350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.122034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b372eb-7aaf-4a95-872e-33c3f4d5534c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.131014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.132161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.132652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.133068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] PATH_INFO: `/v3/users/9429fa20b71d4312af00eb34fbc41e81` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.134630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9429fa20b71d4312af00eb34fbc41e81)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.136660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.173066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd1c783ebc8445fbb2ce7e519fc5e9f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.192572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd1c783ebc8445fbb2ce7e519fc5e9f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.195421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd1c783ebc8445fbb2ce7e519fc5e9f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.196256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd1c783ebc8445fbb2ce7e519fc5e9f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.217821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd1c783ebc8445fbb2ce7e519fc5e9f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.226239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9429fa20b71d4312af00eb34fbc41e81'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.250497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9429fa20b71d4312af00eb34fbc41e81'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.257172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9429fa20b71d4312af00eb34fbc41e81'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.269646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 974/1938] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:54 2021] DELETE /identity/v3/users/1bd1c783ebc8445fbb2ce7e519fc5e9f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:55.271808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.274201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.276778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9429fa20b71d4312af00eb34fbc41e81'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.288999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27de412f-6c94-42c4-8ee3-25b5e132e74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9429fa20b71d4312af00eb34fbc41e81'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:55.298097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 965/1939] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:55 2021] DELETE /identity/v3/users/9429fa20b71d4312af00eb34fbc41e81 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:55.300005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1350-e925-4d21-9ad3-0d3f426cb970 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.300574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1350-e925-4d21-9ad3-0d3f426cb970 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.301925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1350-e925-4d21-9ad3-0d3f426cb970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.326687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-085a1350-e925-4d21-9ad3-0d3f426cb970 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:55.328576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-085a1350-e925-4d21-9ad3-0d3f426cb970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.426584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247819-cf9e-43ce-ae4e-a1e9a2bd9f7b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.449058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 966/1940] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:55.452665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.452665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.452665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.499074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:55.501253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.522195 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 967/1941] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:55.527744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.530850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.564763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.565448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.566670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.567057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.567883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.570359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.611638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9b05-3ad7-4d8d-ad04-e0da1c8500b8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.613508 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 975/1942] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:55 2021] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:55.614854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.666364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.667563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.667947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.668885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.695215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c930-aabf-4cef-bd0f-adb12f24efc6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.702295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.704331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.704898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.705246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.796089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.799014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.825180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 968/1943] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:55.826972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.828512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.850915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857be1-f4bc-4a6f-881c-d51a42f96293 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.860593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.861426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.861765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.862154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.862927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.866024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.894338 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 969/1944] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:55 2021] POST /identity/v3/users => generated 295 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:55.895246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.897294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:55.917113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c597a8-d147-4b29-979d-cbb9784e7e9c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.923340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.924201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.924563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.924774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] PATH_INFO: `/v3/projects/129fd04869494cf59aed6dbd71b4d984` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.927052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] RBAC: Authorizing `identity:delete_project(project_id=129fd04869494cf59aed6dbd71b4d984)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.928898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.933547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:55.935402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:55.953406 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 976/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:55.954398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:55.978772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede4fb-1dba-4229-8654-a5712a8ec866 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:55.993208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:55.994220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:55.994507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:55.994907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:55.995788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.007126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.024680 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 977/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:56.032715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.042897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129fd04869494cf59aed6dbd71b4d984', 'request_id': 'req-85ee40ed-d46d-4ebb-8989-e9a29564a04c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.051292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a6f5a-f385-4ab1-9cf3-b92f4d801d13 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.052805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129fd04869494cf59aed6dbd71b4d984', 'request_id': 'req-85ee40ed-d46d-4ebb-8989-e9a29564a04c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.070136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129fd04869494cf59aed6dbd71b4d984', 'request_id': 'req-85ee40ed-d46d-4ebb-8989-e9a29564a04c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.095003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] The token cache is being invalidate because project 129fd04869494cf59aed6dbd71b4d984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:56.095420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.097156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85ee40ed-d46d-4ebb-8989-e9a29564a04c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.104739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 970/1947] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:55 2021] DELETE /identity/v3/projects/129fd04869494cf59aed6dbd71b4d984 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:56.107104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c63a-1191-484d-8052-b9b67f7e6429 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.107485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c63a-1191-484d-8052-b9b67f7e6429 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.107999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c63a-1191-484d-8052-b9b67f7e6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.131881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.133027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.133387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.134426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] PATH_INFO: `/v3/projects/2944986e3cf94aa2a5a9db2c128d0389/users/b4f95cf540d14ebda98e0acbb29a3790/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.156735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2944986e3cf94aa2a5a9db2c128d0389, user_id=b4f95cf540d14ebda98e0acbb29a3790, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.160221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.169788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4071c63a-1191-484d-8052-b9b67f7e6429 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:56.176003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4071c63a-1191-484d-8052-b9b67f7e6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.179759 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 978/1948] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:56 2021] PUT /identity/v3/projects/2944986e3cf94aa2a5a9db2c128d0389/users/b4f95cf540d14ebda98e0acbb29a3790/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:56.185365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.187791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.286008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd014-5103-46eb-8bf8-6329ca7aba3a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.299824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.300918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.301206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.301739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.302502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.304383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.323166 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 971/1949] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:56.332957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.333434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.333747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.338866 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 979/1950] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:56 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:56.339941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.350610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000912-efc0-4052-bd22-248d0db198cd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.355882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.357423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.357858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.358135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] PATH_INFO: `/v3/projects/2944986e3cf94aa2a5a9db2c128d0389/users/b4f95cf540d14ebda98e0acbb29a3790/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.361336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2944986e3cf94aa2a5a9db2c128d0389, user_id=b4f95cf540d14ebda98e0acbb29a3790, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.364231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f92f1c-3028-4982-b0c8-44c6886952a4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.376321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 980/1951] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:56 2021] PUT /identity/v3/projects/2944986e3cf94aa2a5a9db2c128d0389/users/b4f95cf540d14ebda98e0acbb29a3790/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:56.388384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.388775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.389058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.395065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:56.399058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.422981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] MFA Rules not processed for user `b4f95cf540d14ebda98e0acbb29a3790`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:56.424501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.526353 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 981/1952] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:56 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:56.538484 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 972/1953] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:56.542032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.543790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.544897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.564762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6537ac-53c5-4902-a297-b7ce9a5092e2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.577642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.578734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.579303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.580854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.581809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:56.583695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.594658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.630140 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 973/1954] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:56.635460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.658436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff3b05-b341-4428-a017-a7f628a8b6d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.671992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.673020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.674473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.675520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.677005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.682101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.721813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc4ee3-d2b9-4df0-ab66-326754c6d49a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.730065 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 974/1955] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:56 2021] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:56.731115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.733977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.737260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.738084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.752652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.758330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.784747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.788780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.828796 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 982/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:56 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:56.828796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.829793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:56.832769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddb89-d45e-42da-98d4-9c66b730ae58 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.839538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.840413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.842168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.842452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] PATH_INFO: `/v3/projects/8abc1591b2d3476996683587fb4f4e5b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.845277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abc1591b2d3476996683587fb4f4e5b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.850553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.858418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5b019-e92e-4aa1-af4b-d2e4650b07df service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:56.865000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:56.866025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:56.866310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:56.866622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] PATH_INFO: `/v3/projects/461dfa2013f345e7a5363c5a3ec3dcd7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:56.868070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=461dfa2013f345e7a5363c5a3ec3dcd7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:56.870546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:56.938720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461dfa2013f345e7a5363c5a3ec3dcd7', 'request_id': 'req-ded4db29-3f67-4c3f-9df0-51920ea226dd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.946040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461dfa2013f345e7a5363c5a3ec3dcd7', 'request_id': 'req-ded4db29-3f67-4c3f-9df0-51920ea226dd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.953694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abc1591b2d3476996683587fb4f4e5b', 'request_id': 'req-f54db512-d7ad-45e1-a821-e9ba871f3746'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.955867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461dfa2013f345e7a5363c5a3ec3dcd7', 'request_id': 'req-ded4db29-3f67-4c3f-9df0-51920ea226dd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.960966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abc1591b2d3476996683587fb4f4e5b', 'request_id': 'req-f54db512-d7ad-45e1-a821-e9ba871f3746'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.975126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abc1591b2d3476996683587fb4f4e5b', 'request_id': 'req-f54db512-d7ad-45e1-a821-e9ba871f3746'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.975754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] The token cache is being invalidate because project 461dfa2013f345e7a5363c5a3ec3dcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:56.976054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.976814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:56.979641 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 983/1957] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:56 2021] DELETE /identity/v3/projects/461dfa2013f345e7a5363c5a3ec3dcd7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:56.980473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:56.982752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.003888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] The token cache is being invalidate because project 8abc1591b2d3476996683587fb4f4e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:57.004293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.005619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.010901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 975/1958] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:56 2021] DELETE /identity/v3/projects/8abc1591b2d3476996683587fb4f4e5b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:57.017024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.019306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.116275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4db29-3f67-4c3f-9df0-51920ea226dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.122156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.122846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.123162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.123434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.124203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.126323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.139010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db512-d7ad-45e1-a821-e9ba871f3746 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.155878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.156970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.157235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.157640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] PATH_INFO: `/v3/users/37116e7eca5d40ed9abe470334be0602` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.160207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=37116e7eca5d40ed9abe470334be0602)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.162639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.167981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 984/1959] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:56 2021] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:57.167981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.173809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.190535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf415d2-abfc-4860-897d-ba525ae399f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.199081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.201930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.203381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.203814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] PATH_INFO: `/v3/users/fca8a6989dae45b99bdb231324719d6b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.205317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca8a6989dae45b99bdb231324719d6b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.207357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.242404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37116e7eca5d40ed9abe470334be0602'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.253115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37116e7eca5d40ed9abe470334be0602'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.254580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37116e7eca5d40ed9abe470334be0602'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.281679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca8a6989dae45b99bdb231324719d6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.283424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37116e7eca5d40ed9abe470334be0602'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.291786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca8a6989dae45b99bdb231324719d6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.292773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca8a6989dae45b99bdb231324719d6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.294153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca8a6989dae45b99bdb231324719d6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.295372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37116e7eca5d40ed9abe470334be0602'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.305215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 976/1960] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:57 2021] DELETE /identity/v3/users/37116e7eca5d40ed9abe470334be0602 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:57.306124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.307767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.310112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca8a6989dae45b99bdb231324719d6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:57.337913 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 985/1961] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:57 2021] DELETE /identity/v3/users/fca8a6989dae45b99bdb231324719d6b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:57.388710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea8b1-cb74-46b9-b40c-430df4ec2bdf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.499808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.500492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.500808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.501292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.501825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.503442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.523184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 977/1962] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:57 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:57.527357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.529820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.552750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3e4d7-1e67-4a49-9fbc-12ea8d0db6ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.575525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.576157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.576440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.576746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.577502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.579105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fca86-e30f-46c2-9ac5-360b8665a2a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.616596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 986/1963] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:57 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:57.621437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.636960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf24db-75cb-42df-ba3a-b0ed40451ed0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.647893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.648927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.649296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.649651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] PATH_INFO: `/v3/projects/f5cd8f33ba6942d78beb4c56d5464e5b/users/c41ca9aa826f45b69e8ab36bfb87678f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.697966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cd8f33ba6942d78beb4c56d5464e5b, user_id=c41ca9aa826f45b69e8ab36bfb87678f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.701037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.730840 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 978/1964] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:57 2021] PUT /identity/v3/projects/f5cd8f33ba6942d78beb4c56d5464e5b/users/c41ca9aa826f45b69e8ab36bfb87678f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:57.787642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.787642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.787642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.787915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.789318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.848905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] MFA Rules not processed for user `c41ca9aa826f45b69e8ab36bfb87678f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:57.851216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:57.907696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992939c7-89d8-4f2d-94ac-55a800c0f516 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.914066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.914908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.915181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.915607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] PATH_INFO: `/v3/projects/a6ffd10bef4647a88193c928734c21e6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.917372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ffd10bef4647a88193c928734c21e6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.919512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:57.966799 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 987/1965] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:57 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:57.968517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:57.980517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8463f5-c296-4c72-854b-37d756f53333 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:57.988250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:57.989317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:57.989748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:57.990173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:57.991070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:57.993327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.021273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ffd10bef4647a88193c928734c21e6', 'request_id': 'req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:58.031512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 988/1966] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:57 2021] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:57:58.032720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.039861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ffd10bef4647a88193c928734c21e6', 'request_id': 'req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:58.053959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ffd10bef4647a88193c928734c21e6', 'request_id': 'req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:58.076305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] The token cache is being invalidate because project a6ffd10bef4647a88193c928734c21e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:58.076927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:58.080670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e643c2b8-29dd-4e14-bb07-d4e9eea89a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:58.090028 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 979/1967] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:57 2021] DELETE /identity/v3/projects/a6ffd10bef4647a88193c928734c21e6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:58.096350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f61d7-eed5-4496-8830-cc4a8840b13a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.096671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f61d7-eed5-4496-8830-cc4a8840b13a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.096951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f61d7-eed5-4496-8830-cc4a8840b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.124664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5429f-8c5f-42c8-a303-527bb4f24f9f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.145411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.146273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.146681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.147035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.147837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.150129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.194142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe8f61d7-eed5-4496-8830-cc4a8840b13a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:58.195842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe8f61d7-eed5-4496-8830-cc4a8840b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:58.202075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 989/1968] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/users => generated 303 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:58.205886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.228836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:58.229044 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 980/1969] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:58.248728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa193-167b-40b2-ad15-3a734189ba38 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.263292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.263979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.264256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.264525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.265295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.267018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.267797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.268091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.268372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.291898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:58.293212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:58.294019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 990/1970] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:58.297858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.311491 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 981/1971] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:57:58.312757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.319441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acd364-f33e-43c0-83fb-c588189111e2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.324776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac177-9b3f-4d8e-9b77-a8814be3b554 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.328559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.329599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.329876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.330148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] PATH_INFO: `/v3/projects/fe3cc2f488b24004a879846b62686c1e/users/26a194423873444e9b06ccafd08321f3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.331915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.332989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.333323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.333700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.334461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:57:58.334861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.336559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.355109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 982/1972] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:57:58.356054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.367507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3cc2f488b24004a879846b62686c1e, user_id=26a194423873444e9b06ccafd08321f3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.367890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5b31-2daa-4d73-9c35-e4ab8a272b87 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.370182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.381567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.382047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.382335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.383789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.384699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.392136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.398503 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 991/1973] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:58 2021] PUT /identity/v3/projects/fe3cc2f488b24004a879846b62686c1e/users/26a194423873444e9b06ccafd08321f3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:58.402193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.481158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 983/1974] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:58.482228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.485853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:58.539891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378192-83be-4b57-82c7-4544eea0ba5f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.645352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9bd15-7b22-45cb-abaa-da76b3d2c048 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.652342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.654836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.655110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.655396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.659679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:58.667015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.667841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.669084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.669377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.670135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.672025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.690772 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 992/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:57:58.691649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.715213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4fdf-9d12-4a8f-a16d-b3d467afbf5f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.731932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.732655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.732944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.733223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.737138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.741591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.790539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 993/1976] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:58.794369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.796397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.801611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.829129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fde68-7e41-45cf-8dba-488767bd1a1d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.834150 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 984/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:57:58.837061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.845844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.846872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.847159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.847432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] PATH_INFO: `/v3/projects/fe3cc2f488b24004a879846b62686c1e/users/26a194423873444e9b06ccafd08321f3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.850238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3cc2f488b24004a879846b62686c1e, user_id=26a194423873444e9b06ccafd08321f3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.854625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f972a29-80c6-4827-b9e7-a30107fa8214 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.863179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26c5c-eaff-4b26-bf86-f58d05fb9cda service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.873274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:58.873947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.876269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.876737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.877494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:58.879109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:58.884644 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 994/1978] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:58 2021] PUT /identity/v3/projects/fe3cc2f488b24004a879846b62686c1e/users/26a194423873444e9b06ccafd08321f3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:58.895038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:58.895754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:58.896175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:58.907317 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 985/1979] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:58.907317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:58.916196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fa67-89e2-42ed-aa6b-b3b191130ac7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:58.956044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] MFA Rules not processed for user `26a194423873444e9b06ccafd08321f3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:58.958791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:59.016534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.016534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.016534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.016534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.031333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.033034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.071330 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 995/1980] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:58 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:59.079148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 986/1981] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:57:58 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:57:59.079357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.086623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.087344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55948c4-a369-4fc8-b207-439a7a2b625a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.096412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.097659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.098784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.099293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] PATH_INFO: `/v3/projects/56b0b7f56c15438ba7cbf4c6ea73ab62/users/44bc7050004e4ad79c392cfdbf0cf979/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.118394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b0b7f56c15438ba7cbf4c6ea73ab62, user_id=44bc7050004e4ad79c392cfdbf0cf979, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.123162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039d8e3-796d-4c75-ab04-fd61cf81eca6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.159469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 996/1982] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:57:59 2021] PUT /identity/v3/projects/56b0b7f56c15438ba7cbf4c6ea73ab62/users/44bc7050004e4ad79c392cfdbf0cf979/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:59.161280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.161449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.161719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.216213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] MFA Rules not processed for user `44bc7050004e4ad79c392cfdbf0cf979`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:57:59.218756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:59.250920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617773b-efa7-4738-9fcc-ff16a3e75f05 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.383042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.383705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.383983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.384254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.404166 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 997/1983] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:59 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:57:59.408281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.474986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.477138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.507872 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 987/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:57:59 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:57:59.509752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.514835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:59.524498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbaa68-d3fc-4173-bd44-e15dc51c76b6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.537334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.538774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.539358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.539639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.541898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.546486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.551872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5d05-a5d9-49f4-8878-12868d30f3d8 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.564653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.565573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.565862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.566136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] PATH_INFO: `/v3/projects/bf60fb6381ce41a9bc324a3c090986df` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.579830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf60fb6381ce41a9bc324a3c090986df)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.587777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.647446 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 998/1985] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:57:59 2021] POST /identity/v3/projects => generated 401 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:59.647446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.708113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf60fb6381ce41a9bc324a3c090986df', 'request_id': 'req-91843e48-c00c-4e0d-8fbd-389cffbfa591'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:59.714668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf60fb6381ce41a9bc324a3c090986df', 'request_id': 'req-91843e48-c00c-4e0d-8fbd-389cffbfa591'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:59.723148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf60fb6381ce41a9bc324a3c090986df', 'request_id': 'req-91843e48-c00c-4e0d-8fbd-389cffbfa591'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:59.753155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] The token cache is being invalidate because project bf60fb6381ce41a9bc324a3c090986df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:57:59.753647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:59.754368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a162c0-e982-4187-abe2-f8c3af2a0cab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.756537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:57:59.758513 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 988/1986] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:57:59 2021] DELETE /identity/v3/projects/bf60fb6381ce41a9bc324a3c090986df => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:57:59.759507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:57:59.763573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:57:59.881578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.882473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.882751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.883025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] PATH_INFO: `/v3/users/c41ca9aa826f45b69e8ab36bfb87678f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.891904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41ca9aa826f45b69e8ab36bfb87678f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.894839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.904286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91843e48-c00c-4e0d-8fbd-389cffbfa591 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:57:59.920650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:57:59.921425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.922033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.922336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:57:59.923273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:57:59.925477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224cbe5-54f2-4c97-a781-3feffc461c82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:57:59.980262 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 989/1987] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:57:59 2021] POST /identity/v3/users => generated 307 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:57:59.986256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:57:59.987934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:57:59.988450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.003608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41ca9aa826f45b69e8ab36bfb87678f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.024234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41ca9aa826f45b69e8ab36bfb87678f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.027131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41ca9aa826f45b69e8ab36bfb87678f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.028121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41ca9aa826f45b69e8ab36bfb87678f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.040275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:00.042287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.046476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9618a3b-5c40-4999-9c8c-e0a022c0b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41ca9aa826f45b69e8ab36bfb87678f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.075696 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 990/1988] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:57:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:00.083455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.086283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.090665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 999/1989] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:57:59 2021] DELETE /identity/v3/users/c41ca9aa826f45b69e8ab36bfb87678f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:00.093169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.093458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.093874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.101012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4a442-16e2-4156-b738-1c4c442f7ba1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.119591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:00.132418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.187122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.187957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.188314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.188851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.190205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.194278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcaba3-c44f-411b-8944-c0c73a35620c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.210738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 991/1990] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:00 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:00.212156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.212439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.213022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.236522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:00.238098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.241442 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1000/1991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:00.242662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.251921 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 992/1992] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:00.251921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.253317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e36a-9064-47f9-84ee-36c898b2a019 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.261758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975de8a2-a088-4d36-bade-beadfdbd0149 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.265417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.266378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.266661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.266930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] PATH_INFO: `/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a/users/ad3e26339704419383f8051a4a6ba8e0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.268323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.269103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.269482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.269830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.270871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:00.271243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.275357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.295790 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 993/1993] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:00.295790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.296180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.302285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8f125c860a482ca7fa1ea6536cb43a, user_id=ad3e26339704419383f8051a4a6ba8e0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.309182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.342867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1001/1994] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:00 2021] PUT /identity/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a/users/ad3e26339704419383f8051a4a6ba8e0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:00.342867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.373442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e09d-7cbe-4e94-bfc3-18406af5303e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.459458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5ce3-5c29-4982-8b90-7f3531c629c3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.470198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.471655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.472665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.473078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.473720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.473999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.474270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.474989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.476939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.478158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.495591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.497716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.537100 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 994/1995] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:00.538262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.551102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1002/1996] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:00 2021] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:00.555192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.571642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5ca19-6c8e-45af-bbec-8ae3d4c48dec service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.687866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bc4b-e0ac-450c-836c-06c0460de202 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.688571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.689283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.689594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.689838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.690688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.692275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.707279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.708426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.709133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.709676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.710625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.712959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.715461 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 995/1997] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:00 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:00.717149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.719228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:00.736665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576bac5-1c39-4a6e-9a01-e7d290b19ac0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.744020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.745349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.746108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.746552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] PATH_INFO: `/v3/users/7c319e6a54644dd5b25f8a435c68923d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.748075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c319e6a54644dd5b25f8a435c68923d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.752911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.763999 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1003/1998] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:00 2021] POST /identity/v3/users => generated 281 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:00.764743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.780822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d66bf-141e-4b6c-a8cb-5553d826d642 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.790627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:00.792787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.793457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.795596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] PATH_INFO: `/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a/users/ad3e26339704419383f8051a4a6ba8e0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.799150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8f125c860a482ca7fa1ea6536cb43a, user_id=ad3e26339704419383f8051a4a6ba8e0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:00.803356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:00.824672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1004/1999] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:00 2021] PUT /identity/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a/users/ad3e26339704419383f8051a4a6ba8e0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:00.826898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:00.852983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c319e6a54644dd5b25f8a435c68923d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.860410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c319e6a54644dd5b25f8a435c68923d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.861124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c319e6a54644dd5b25f8a435c68923d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.877968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c319e6a54644dd5b25f8a435c68923d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.886942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b7ad240-2d5a-405c-9b2d-2e9c8f571756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c319e6a54644dd5b25f8a435c68923d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:00.899236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 996/2000] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:00 2021] DELETE /identity/v3/users/7c319e6a54644dd5b25f8a435c68923d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:00.904427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:00.904600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:00.905025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:00.940965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075626-5198-46af-a670-35d9a274a07a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:00.954632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] MFA Rules not processed for user `ad3e26339704419383f8051a4a6ba8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:00.955751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.016871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.017712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.018195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.018702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.019663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.021400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3c94-162c-4660-9656-c92d45bc6c40 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.034424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1005/2001] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:00 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:01.034424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.034424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.034424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.037003 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 997/2002] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:00 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:01.037990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.039357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.057586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:01.058882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.058993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a949cd6-3ee0-466b-a58d-29d9213be14b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.064272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.065145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.065414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.065689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] PATH_INFO: `/v3/projects/f5cd8f33ba6942d78beb4c56d5464e5b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.067310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cd8f33ba6942d78beb4c56d5464e5b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.067775 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1006/2003] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:01.068636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.069822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.073797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.095869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed2a2-8e35-44c2-8f69-dd96b3a40151 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.101152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.101823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.102110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.102377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.103120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.104735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.118458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1007/2004] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:01 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:01.119336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.123484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.160998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cd8f33ba6942d78beb4c56d5464e5b', 'request_id': 'req-dc8274db-6705-4a84-809d-f67addf28107'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.171931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cd8f33ba6942d78beb4c56d5464e5b', 'request_id': 'req-dc8274db-6705-4a84-809d-f67addf28107'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.179945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cd8f33ba6942d78beb4c56d5464e5b', 'request_id': 'req-dc8274db-6705-4a84-809d-f67addf28107'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.200029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] The token cache is being invalidate because project f5cd8f33ba6942d78beb4c56d5464e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:01.200537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.201313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.206540 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 998/2005] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:01 2021] DELETE /identity/v3/projects/f5cd8f33ba6942d78beb4c56d5464e5b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:01.206540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.208380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.273731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620ad7a-4f9d-41d0-8db7-1487c517a245 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.320997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8274db-6705-4a84-809d-f67addf28107 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.325081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.325826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.326135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.326410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.328333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.393308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.394755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.406533 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 999/2006] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:01.407565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.409576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.419991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.420867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.421212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.421407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.423498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.433501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e4bc-5919-4709-8e05-7b2ba469da9c service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.439187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.440081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.440358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.440669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] PATH_INFO: `/v3/projects/48d960bfde8b41d2ac1bff9cc13a1328/users/e04f263f894346bd82a33910827294e3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.458158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d960bfde8b41d2ac1bff9cc13a1328, user_id=e04f263f894346bd82a33910827294e3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.460529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.482447 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1000/2007] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:01 2021] PUT /identity/v3/projects/48d960bfde8b41d2ac1bff9cc13a1328/users/e04f263f894346bd82a33910827294e3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:01.492507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.492507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.537277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.543290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9aeca-a22c-4374-b7e4-853b1a733147 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.566877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1008/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:01 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:01.568914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b04d-2db3-4ceb-a064-53133cda01f4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.569619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.570716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.571143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.576409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.577665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.578172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.578661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] PATH_INFO: `/v3/users/26a194423873444e9b06ccafd08321f3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.580164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a194423873444e9b06ccafd08321f3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.582463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:01.609692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] MFA Rules not processed for user `e04f263f894346bd82a33910827294e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:01.611765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.660572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a194423873444e9b06ccafd08321f3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.676403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a194423873444e9b06ccafd08321f3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.678136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a194423873444e9b06ccafd08321f3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.709243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a194423873444e9b06ccafd08321f3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.722894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a194423873444e9b06ccafd08321f3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:01.736481 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1001/2009] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:01 2021] DELETE /identity/v3/users/26a194423873444e9b06ccafd08321f3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:01.737381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.764288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.787943 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1009/2010] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:01 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:01.790868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:01.793633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.842138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c0ab-2ac7-4e74-9518-7050788bf3ac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.917889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3846-9d78-4d76-a7be-a21bbf9463b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:01.927479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.928215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.928505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.928790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.937779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:01.987215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:01.987967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:01.988232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:01.988782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:01.989486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:01.995628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.058998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.060671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.061723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1010/2011] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:01 2021] POST /identity/v3/projects => generated 359 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:02.062631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.081422 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1002/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:01 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:02.277688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2e21-553d-4049-aba0-6398a244ac0c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.295476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.296168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.296440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.296738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.297452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.300392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.343417 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1011/2013] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:02 2021] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:02.347271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.367955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858678-64e1-4a68-a331-fe1baf549b4d service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.393436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.394143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.394418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.394870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.395757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.400313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.426223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1003/2014] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:02.430879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.445970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2dbe5-f328-4b58-8669-33f429605a72 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.461763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.462690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.462964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.463235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] PATH_INFO: `/v3/projects/a828f72c67da492593b93243d7803752/users/94b8f6175e1f492b8968d2c61146ed8d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.495763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a828f72c67da492593b93243d7803752, user_id=94b8f6175e1f492b8968d2c61146ed8d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.502260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.533935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1012/2015] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:02 2021] PUT /identity/v3/projects/a828f72c67da492593b93243d7803752/users/94b8f6175e1f492b8968d2c61146ed8d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:02.537972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.564880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de025a5-c7ee-4d86-b958-e11bf4f13734 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.619061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.620871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:02.672769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.673686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.674065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.674436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.675351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.677873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.708541 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1004/2016] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:02.712316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:02.741637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20331b64-9d5d-4606-9a40-60166ff672b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.751014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.752079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.753544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.753933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] PATH_INFO: `/v3/projects/a828f72c67da492593b93243d7803752/users/94b8f6175e1f492b8968d2c61146ed8d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.756346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a828f72c67da492593b93243d7803752, user_id=94b8f6175e1f492b8968d2c61146ed8d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.760281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01edaf-d83a-46be-91ec-91e126749d37 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:02.775756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1005/2017] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:02 2021] PUT /identity/v3/projects/a828f72c67da492593b93243d7803752/users/94b8f6175e1f492b8968d2c61146ed8d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:02.787206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.787631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.788014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.834078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc26e8-ae7e-4a41-9038-81f4111461f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:02.863884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] MFA Rules not processed for user `94b8f6175e1f492b8968d2c61146ed8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:02.872838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:02.953788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:02.954918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:02.955254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:02.955528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] PATH_INFO: `/v3/projects/fe3cc2f488b24004a879846b62686c1e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:02.957049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3cc2f488b24004a879846b62686c1e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:02.959447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.054503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3cc2f488b24004a879846b62686c1e', 'request_id': 'req-eb7680a2-f693-42e8-8599-b4495cf21cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.070759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1006/2018] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:02 2021] POST /identity/v3/auth/tokens => generated 3293 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:03.070759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.071057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3cc2f488b24004a879846b62686c1e', 'request_id': 'req-eb7680a2-f693-42e8-8599-b4495cf21cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.071149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.089128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de492c-e378-4c05-8cca-5559290bdd63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.091275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3cc2f488b24004a879846b62686c1e', 'request_id': 'req-eb7680a2-f693-42e8-8599-b4495cf21cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.113734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] The token cache is being invalidate because project fe3cc2f488b24004a879846b62686c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:03.114013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.115840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.118383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1013/2019] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:02 2021] DELETE /identity/v3/projects/fe3cc2f488b24004a879846b62686c1e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:03.119089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.121544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.218480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.219769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.221161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.221639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] PATH_INFO: `/v3/projects/bcc326f1e98540f29ec499bdce7f7122` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.223839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc326f1e98540f29ec499bdce7f7122)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.225986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.229548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7680a2-f693-42e8-8599-b4495cf21cc3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.236791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.238005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.238288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.238562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] PATH_INFO: `/v3/users/44bc7050004e4ad79c392cfdbf0cf979` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.239800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bc7050004e4ad79c392cfdbf0cf979)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.242229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.316295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bc7050004e4ad79c392cfdbf0cf979'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.325241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc326f1e98540f29ec499bdce7f7122', 'request_id': 'req-4116a5d7-a133-4247-9495-519882eed4b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.328723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bc7050004e4ad79c392cfdbf0cf979'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.329605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bc7050004e4ad79c392cfdbf0cf979'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.330363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bc7050004e4ad79c392cfdbf0cf979'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.336631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc326f1e98540f29ec499bdce7f7122', 'request_id': 'req-4116a5d7-a133-4247-9495-519882eed4b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.342035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bc7050004e4ad79c392cfdbf0cf979'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.349162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc326f1e98540f29ec499bdce7f7122', 'request_id': 'req-4116a5d7-a133-4247-9495-519882eed4b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.364766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1014/2020] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:03 2021] DELETE /identity/v3/users/44bc7050004e4ad79c392cfdbf0cf979 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:03.365812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.367991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.377319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] The token cache is being invalidate because project bcc326f1e98540f29ec499bdce7f7122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:03.377681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.378901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4116a5d7-a133-4247-9495-519882eed4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.388043 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1007/2021] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:03 2021] DELETE /identity/v3/projects/bcc326f1e98540f29ec499bdce7f7122 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:03.391534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92490-15b1-43c1-a6d8-b94302ea6956 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.392439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92490-15b1-43c1-a6d8-b94302ea6956 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.394295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92490-15b1-43c1-a6d8-b94302ea6956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.418519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1ba92490-15b1-43c1-a6d8-b94302ea6956 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:03.420307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1ba92490-15b1-43c1-a6d8-b94302ea6956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.473390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ed0e-e28b-4dcf-b3c3-b965896796a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.480349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.482415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.482771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.484327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.486423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.509043 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1008/2022] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:03.510466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.510756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.511028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.533320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:03.534414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.543654 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1009/2023] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:03.545369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.549507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.568530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9634b5-5cb5-4884-ae02-1d8531d67f55 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.575206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.576306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.576430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.576830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] PATH_INFO: `/v3/users/b4f95cf540d14ebda98e0acbb29a3790` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.578135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f95cf540d14ebda98e0acbb29a3790)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.580161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.593538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.596061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58a049-7d46-460f-8fcd-8de06a0b4f87 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.614388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1015/2024] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:03 2021] GET /identity/v3/auth/tokens => generated 3293 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:03.616567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.616927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.617292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.646731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:03.648672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.655480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f95cf540d14ebda98e0acbb29a3790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.660685 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1016/2025] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:03.662053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.664307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.665506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f95cf540d14ebda98e0acbb29a3790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.666249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f95cf540d14ebda98e0acbb29a3790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.686384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f95cf540d14ebda98e0acbb29a3790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.697951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f95cf540d14ebda98e0acbb29a3790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:03.712398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1010/2026] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:03 2021] DELETE /identity/v3/users/b4f95cf540d14ebda98e0acbb29a3790 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:03.714294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:03.717747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.840218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cba85-c3a1-413c-a9a9-9f3932a0cb81 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.933307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d3a6-e6ac-447b-8334-1411e224858e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:03.937188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.937886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.938232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.938525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.951326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:03.951769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:03.952793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:03.953534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:03.955009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:03.957272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:03.961143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.963011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.966839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:03.968451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:03.980021 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1017/2027] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:03.984055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1011/2028] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:03.985173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.004924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60525b-7c87-49ef-a48d-fb4750d29b43 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.016970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.017992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.018364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.018729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.019616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.022728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.071103 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1018/2029] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:03 2021] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:04.076744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.093843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dbeae-74b8-4013-8fe5-067b2b90afd3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.200955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.202022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.202022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.202304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.203539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.205568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.235371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.235476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1012/2030] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:04 2021] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:04.255445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2b22-14cc-4874-ad75-b571063ea367 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.260547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.261652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.262013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.262368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.263853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.265761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.280047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1019/2031] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:04 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:04.284478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.296688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053906-9f68-4789-9404-fcd8b4658ddf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.302653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.303728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.304139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.304492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.305405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.307224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff9ef-7b1e-411f-bb69-0547f4d4d917 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.327808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.328319 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1013/2032] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:04 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:04.339178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50815-3a83-4301-b007-df30617f7576 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.345192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.346694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.346992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.347232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] PATH_INFO: `/v3/projects/24ad1ba6fa5d4499b822779bd61d165e/users/9c69cc6d1fa34f34a67a711ceac91423/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.373953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ad1ba6fa5d4499b822779bd61d165e, user_id=9c69cc6d1fa34f34a67a711ceac91423, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.376775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.402830 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1020/2033] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:04 2021] PUT /identity/v3/projects/24ad1ba6fa5d4499b822779bd61d165e/users/9c69cc6d1fa34f34a67a711ceac91423/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:04.413960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.414245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.414521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.475456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.479045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:04.515076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] MFA Rules not processed for user `9c69cc6d1fa34f34a67a711ceac91423`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:04.516691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:04.598889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41673-89a7-4e66-8684-f28b89a65d70 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.612133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.613230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.613533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.613771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] PATH_INFO: `/v3/projects/56b0b7f56c15438ba7cbf4c6ea73ab62` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.615356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b0b7f56c15438ba7cbf4c6ea73ab62)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.618249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.671280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1014/2034] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:04 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:04.672461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.695637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9f370-12f8-41c7-8af1-4fe576aacf8e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.708804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.710169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.714008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.714387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.715202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.718351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.729002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b0b7f56c15438ba7cbf4c6ea73ab62', 'request_id': 'req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:04.741326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b0b7f56c15438ba7cbf4c6ea73ab62', 'request_id': 'req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:04.757908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b0b7f56c15438ba7cbf4c6ea73ab62', 'request_id': 'req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:04.758616 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1015/2035] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:04 2021] POST /identity/v3/projects => generated 391 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:04.762628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.792688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] The token cache is being invalidate because project 56b0b7f56c15438ba7cbf4c6ea73ab62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:04.793035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:04.798944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:04.801075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1021/2036] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:04 2021] DELETE /identity/v3/projects/56b0b7f56c15438ba7cbf4c6ea73ab62 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:04.804734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.806256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:04.907234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584de52-df24-49fd-9376-ed5dcb60c9dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.921008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.923643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.924844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.925206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.926591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67e6ff-ea7f-46ab-88eb-d596925ec4e4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:04.926950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.933807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:04.934198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.935411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:04.936289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:04.936501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] PATH_INFO: `/v3/users/ad3e26339704419383f8051a4a6ba8e0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:04.938884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e26339704419383f8051a4a6ba8e0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:04.941028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:04.984297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1016/2037] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:04 2021] POST /identity/v3/users => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:04.987986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:04.989870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.004188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50025486-c16b-461f-952c-888a8f8684bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.007515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e26339704419383f8051a4a6ba8e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.010345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.011310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.011575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.011900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.012937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.014556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.015842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e26339704419383f8051a4a6ba8e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.016485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e26339704419383f8051a4a6ba8e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.017409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e26339704419383f8051a4a6ba8e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.026945 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1017/2038] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:04 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:05.030032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e26339704419383f8051a4a6ba8e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.031978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.035551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.067498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d4e3-6a64-4cf6-9c35-8fe8d2fbf5ec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.077624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.080262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.081599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.082094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] PATH_INFO: `/v3/projects/f101603cd1a34ab788746ffd77bbd39c/users/57c9afaa7f7743129107c58c52e67a7b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.107356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1022/2039] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:04 2021] DELETE /identity/v3/users/ad3e26339704419383f8051a4a6ba8e0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:05.109228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.114286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.137629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f101603cd1a34ab788746ffd77bbd39c, user_id=57c9afaa7f7743129107c58c52e67a7b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.149137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.193404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1018/2040] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:05 2021] PUT /identity/v3/projects/f101603cd1a34ab788746ffd77bbd39c/users/57c9afaa7f7743129107c58c52e67a7b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:05.199582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.211259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321e1-d3e5-4d89-96ab-0fdf42759011 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.311980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.313558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.314068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.314538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] PATH_INFO: `/v3/users/e04f263f894346bd82a33910827294e3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.316949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04f263f894346bd82a33910827294e3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.326107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.360646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de9ce-a5b2-4f92-b7c2-a5f411111901 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.374309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.376617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.381480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.381480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.382136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.385540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.426703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04f263f894346bd82a33910827294e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.438432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1019/2041] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:05 2021] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:05.441340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04f263f894346bd82a33910827294e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.442670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04f263f894346bd82a33910827294e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.443716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04f263f894346bd82a33910827294e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.445060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.458362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4e1fbc9b-aa60-4a21-b2e2-ef467cd1c1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04f263f894346bd82a33910827294e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.460522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.493682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3619-0300-4bf9-815f-14d336bc24aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.496824 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1023/2042] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:05 2021] DELETE /identity/v3/users/e04f263f894346bd82a33910827294e3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:05.502947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c4fe-9878-4704-a8bf-b3eb75100ef4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.503290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c4fe-9878-4704-a8bf-b3eb75100ef4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.503574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c4fe-9878-4704-a8bf-b3eb75100ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.550338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5131c4fe-9878-4704-a8bf-b3eb75100ef4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:05.553053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5131c4fe-9878-4704-a8bf-b3eb75100ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.603837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.607449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.607925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.608132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] PATH_INFO: `/v3/projects/f101603cd1a34ab788746ffd77bbd39c/users/57c9afaa7f7743129107c58c52e67a7b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.610470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f101603cd1a34ab788746ffd77bbd39c, user_id=57c9afaa7f7743129107c58c52e67a7b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.620712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.641885 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1020/2043] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:05 2021] PUT /identity/v3/projects/f101603cd1a34ab788746ffd77bbd39c/users/57c9afaa7f7743129107c58c52e67a7b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:05.642731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.644561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.687164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1024/2044] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:05.690205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.691865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.692143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.731980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] MFA Rules not processed for user `57c9afaa7f7743129107c58c52e67a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:05.733129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.758748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a369-0ad5-4b22-af48-b7bc0486ea49 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.766233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:05.767130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.767626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.767906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] PATH_INFO: `/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.769627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8f125c860a482ca7fa1ea6536cb43a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:05.772393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:05.843445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1025/2045] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:05 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:05.849748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:05.851433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:05.871163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8f125c860a482ca7fa1ea6536cb43a', 'request_id': 'req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.884184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8f125c860a482ca7fa1ea6536cb43a', 'request_id': 'req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.897101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8f125c860a482ca7fa1ea6536cb43a', 'request_id': 'req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.915460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] The token cache is being invalidate because project 3b8f125c860a482ca7fa1ea6536cb43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:05.915748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.918770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c0c5ef7b-ea2a-45e5-8af6-73b46563d3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:05.924771 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1021/2046] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:05 2021] DELETE /identity/v3/projects/3b8f125c860a482ca7fa1ea6536cb43a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:05.926154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ad84-068e-448f-8a5d-5c93ae4f0c1a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:05.926599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ad84-068e-448f-8a5d-5c93ae4f0c1a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:05.926878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ad84-068e-448f-8a5d-5c93ae4f0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:05.945975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa3cc-9730-4794-8344-34a4c00024f7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:05.952964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-13d7ad84-068e-448f-8a5d-5c93ae4f0c1a None None] MFA Rules not processed for user `9c69cc6d1fa34f34a67a711ceac91423`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:05.954189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-13d7ad84-068e-448f-8a5d-5c93ae4f0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.001150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.001823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.002102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.002371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.004418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.033823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1022/2047] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:05 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:06.034940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.035221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.035686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.056129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:06.057376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.083028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.086302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.097686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1026/2048] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:06.123469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.132287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.165177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1023/2049] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:06.166179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.167999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.185405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a098ba-ffcb-4014-8149-838b2d4d9635 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.190786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.191891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.192911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.192911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] PATH_INFO: `/v3/projects/2944986e3cf94aa2a5a9db2c128d0389` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.195288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2944986e3cf94aa2a5a9db2c128d0389)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.197841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.248295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ff1-0b74-4f1f-8080-2cc0acbfc723 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.256851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.257629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.257907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.258182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.261450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.275446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.277328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af231-a9df-4791-a3e6-61a83518dba7 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.289688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1027/2050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:06 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:06.290680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.290962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.291231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.314777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:06.316299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.327916 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1028/2051] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:06.331823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.346273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a24cb-a629-4ea5-9c2c-436a98ea5458 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.353564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.354319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.354666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.355002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.355823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:06.356774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.359467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.393158 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1029/2052] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:06.395401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.442631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a871-f112-4081-b0ca-3d62354c253b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.449203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2944986e3cf94aa2a5a9db2c128d0389', 'request_id': 'req-d232bd28-265e-41aa-b86f-25f54b1dd721'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:06.482254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2944986e3cf94aa2a5a9db2c128d0389', 'request_id': 'req-d232bd28-265e-41aa-b86f-25f54b1dd721'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:06.510686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2944986e3cf94aa2a5a9db2c128d0389', 'request_id': 'req-d232bd28-265e-41aa-b86f-25f54b1dd721'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:06.537719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] The token cache is being invalidate because project 2944986e3cf94aa2a5a9db2c128d0389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:06.539856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:06.541500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d232bd28-265e-41aa-b86f-25f54b1dd721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:06.557453 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1024/2053] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:06 2021] DELETE /identity/v3/projects/2944986e3cf94aa2a5a9db2c128d0389 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:06.563808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43640-7a7a-43e0-9720-86014f3e1d0c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.564093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43640-7a7a-43e0-9720-86014f3e1d0c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.564366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43640-7a7a-43e0-9720-86014f3e1d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.599372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.600003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.600282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.600558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.600943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1bc43640-7a7a-43e0-9720-86014f3e1d0c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:06.601317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.602593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1bc43640-7a7a-43e0-9720-86014f3e1d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.603268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.623105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1025/2054] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:06.625497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.625796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.626279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.658782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:06.659769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.664633 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1030/2055] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/projects => generated 391 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:06.668682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.670429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:06.744345 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1026/2056] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:06.749541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.760542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12961b1-5735-4094-a9de-afbf58930b2c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.761002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528f64-1d4d-456e-ac9d-3266bfac18e6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.768116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.768743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.768979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.769259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.769529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.769799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.769900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.770072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.770560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:06.770798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.770897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.772783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.773526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.804008 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1027/2057] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:58:06.805281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.809124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1031/2058] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:06.813684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.826409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ef8e-c2d3-4c6d-983a-66b4ca1a1f34 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.840013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d774868-6c6a-4462-9e2d-354f16d87bc6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.840239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.841067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.841531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.841862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.842729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.847552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.851337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.852594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.853689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.856910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.857889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.859892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.880594 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1032/2059] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:06 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:06.881828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.892918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af139d1-15ad-4dd0-a653-1e3cfefcedf3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.893891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1028/2060] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/projects => generated 395 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:06.895202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.971985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:06.972694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:06.972977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:06.973251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:06.973993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:06.975701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:06.988402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f5ede-0f37-4684-9e9f-e424d8747132 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:06.992445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1033/2061] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:06 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:06.993335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:06.998771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.001090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.001544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.001953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.003238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.005405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccc87-d398-42db-bc1f-485b2c7f611a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.006370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.010156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.011177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.011298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.011577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] PATH_INFO: `/v3/projects/364d355e87df40bc86e01a77cdc2a5c2/users/5739a6be8cf94e768d7cf6b046d53939/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.029949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364d355e87df40bc86e01a77cdc2a5c2, user_id=5739a6be8cf94e768d7cf6b046d53939, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.032494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.035561 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1029/2062] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:06 2021] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:07.036933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.040182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.058587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46706-0df0-4ebd-a40c-5309c1df6475 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.065173 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1034/2063] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:06 2021] PUT /identity/v3/projects/364d355e87df40bc86e01a77cdc2a5c2/users/5739a6be8cf94e768d7cf6b046d53939/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:07.066456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.179192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a03d0-97d0-450a-847f-9b2f2cf837a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.199161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.199871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.200183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.200449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.204341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.205966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ed34c-86ba-45ef-a885-82b09ef51e98 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.229493 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1035/2064] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:07.233165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.234328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.235839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.240861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.241874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.242254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.242623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] PATH_INFO: `/v3/projects/48d960bfde8b41d2ac1bff9cc13a1328` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.245406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d960bfde8b41d2ac1bff9cc13a1328)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.247572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.314535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] MFA Rules not processed for user `5739a6be8cf94e768d7cf6b046d53939`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:07.317899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.342567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d960bfde8b41d2ac1bff9cc13a1328', 'request_id': 'req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.359075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d960bfde8b41d2ac1bff9cc13a1328', 'request_id': 'req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.370379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d960bfde8b41d2ac1bff9cc13a1328', 'request_id': 'req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.396360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] The token cache is being invalidate because project 48d960bfde8b41d2ac1bff9cc13a1328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:07.397060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.398789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ce5e4efa-e2e1-4482-8b11-bd3ec10f8329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.402261 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1030/2065] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:07 2021] DELETE /identity/v3/projects/48d960bfde8b41d2ac1bff9cc13a1328 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:07.406373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.407179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.407568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.475326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] MFA Rules not processed for user `18d81f586d0a4e8ea083ba207b9f905e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:07.477948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.486405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1036/2066] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:07 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:07.489427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.490906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.626806 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1031/2067] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:07.628207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.634037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.651509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b37b-ef32-495c-badd-1420d4525be5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.652185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cede0b-db96-4c2c-bd1c-e3c03f456212 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.658943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.659117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.659456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.659938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.660308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.661339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.663386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.666823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.666823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.668412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] PATH_INFO: `/v3/users/94b8f6175e1f492b8968d2c61146ed8d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.671921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b8f6175e1f492b8968d2c61146ed8d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.673933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.681102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1037/2068] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:07.681102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.681527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.704010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d7ed-9dfd-4f65-97be-9bc6f3cf4d77 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.710838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.711732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.712180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.712661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.713494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:07.715992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:07.754982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b8f6175e1f492b8968d2c61146ed8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.763749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b8f6175e1f492b8968d2c61146ed8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.765054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b8f6175e1f492b8968d2c61146ed8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.777691 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1038/2069] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:07 2021] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:07.778967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.781234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.787930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b8f6175e1f492b8968d2c61146ed8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.808112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b8f6175e1f492b8968d2c61146ed8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:07.818833 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1032/2070] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:07 2021] DELETE /identity/v3/users/94b8f6175e1f492b8968d2c61146ed8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:07.819761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:07.822731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:07.929018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7781-d9ad-4559-9cd3-16e1933d6061 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.966570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe9319-b4e0-45e2-a13d-d9367a924c77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:07.973983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.976770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.977115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.977400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460/users/76259eed8da64b38998266cf107f0127/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.984485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:07.985311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:07.985617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:07.986169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:07.988566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:08.009511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f83737b8fe94ae9a93ed34a4b4ff460, user_id=76259eed8da64b38998266cf107f0127, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.015558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.044645 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1033/2071] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:07 2021] PUT /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460/users/76259eed8da64b38998266cf107f0127/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:08.045531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.052959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:08.079218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.084768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6cf4a-5463-404f-9848-2ab1eb79dd0c service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.098983 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1039/2072] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:07 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:08.100660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.101086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.101454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.163230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363280e-b546-4c06-9edd-254feaa05bdb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.173166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.175666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.176247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.176704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.177614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.178730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] MFA Rules not processed for user `76259eed8da64b38998266cf107f0127`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:08.180680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.199646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:08.209025 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1034/2073] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:08 2021] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:08.213729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.229224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122534b3-4ddd-49ec-9aa9-f4364c32aed5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.236120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.237060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.237340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.237612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.238355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.239983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.254827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1035/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:08.259946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.274506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c677b-89c0-4d0c-8e9e-6145f617cd09 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.283848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.285478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.285886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.286257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] PATH_INFO: `/v3/projects/24254c4b84354a0a963fe912785826ae/users/ac96ba0011b949fbba024a586fcc5ee0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.329431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24254c4b84354a0a963fe912785826ae, user_id=ac96ba0011b949fbba024a586fcc5ee0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.332323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.359419 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1036/2075] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:08 2021] PUT /identity/v3/projects/24254c4b84354a0a963fe912785826ae/users/ac96ba0011b949fbba024a586fcc5ee0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:08.370394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.381955 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1040/2076] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:08 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:08.382617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.388277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:08.416116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ace0-3cbc-4294-9fc6-f114d9a3fba8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.522173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b5eb-b4ea-4080-8635-1428bb499b3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.527635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.529004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.529284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.529602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.530338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.532000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.546421 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1037/2077] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:08.547274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.576066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688dbd-7f4c-4eae-881a-906cbc360a0d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.589963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.598144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.599586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.601089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.604222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.613531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.613797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.614812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.616404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.616756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] PATH_INFO: `/v3/projects/a828f72c67da492593b93243d7803752` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.619142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a828f72c67da492593b93243d7803752)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.632475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.694363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1038/2078] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:08 2021] POST /identity/v3/projects => generated 395 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:08.695217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:08.861898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf95c-c301-4400-89cf-df23fd5b94f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:08.877805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:08.878859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:08.879237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:08.879605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] PATH_INFO: `/v3/projects/24254c4b84354a0a963fe912785826ae/users/ac96ba0011b949fbba024a586fcc5ee0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:08.885565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24254c4b84354a0a963fe912785826ae, user_id=ac96ba0011b949fbba024a586fcc5ee0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:08.893197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:08.927286 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1039/2079] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:08 2021] PUT /identity/v3/projects/24254c4b84354a0a963fe912785826ae/users/ac96ba0011b949fbba024a586fcc5ee0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:08.928381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.028228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a828f72c67da492593b93243d7803752', 'request_id': 'req-39336fe5-d576-4c86-a25f-38fffa5072e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.043308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a828f72c67da492593b93243d7803752', 'request_id': 'req-39336fe5-d576-4c86-a25f-38fffa5072e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.057521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a828f72c67da492593b93243d7803752', 'request_id': 'req-39336fe5-d576-4c86-a25f-38fffa5072e0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.084283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] The token cache is being invalidate because project a828f72c67da492593b93243d7803752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:09.084584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.086542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39336fe5-d576-4c86-a25f-38fffa5072e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.093123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83850134-8b49-48e8-b68e-aaa9e52df272 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.098422 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1041/2080] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:08 2021] DELETE /identity/v3/projects/a828f72c67da492593b93243d7803752 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:09.102106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3528-4b9a-4595-9790-84166ad6b30f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.103991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3528-4b9a-4595-9790-84166ad6b30f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.104459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3528-4b9a-4595-9790-84166ad6b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.174009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a0fb3528-4b9a-4595-9790-84166ad6b30f None None] MFA Rules not processed for user `ac96ba0011b949fbba024a586fcc5ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:09.176125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0fb3528-4b9a-4595-9790-84166ad6b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.201898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.202890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.203226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.203506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.204213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.206179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.237811 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1040/2081] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:08 2021] POST /identity/v3/users => generated 304 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:09.237811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.242318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.270456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532251-3d70-4298-aa38-5eebb8303aa9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.280510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.282740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.285057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.285642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] PATH_INFO: `/v3/users/3369baa68ddd4eb0a5df5923a1974fed` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.287150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3369baa68ddd4eb0a5df5923a1974fed)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.290459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.329257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1042/2082] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:09 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:09.329257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.329257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.329257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.350765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:09.352318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.375154 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1043/2083] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:09.376407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.379438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3369baa68ddd4eb0a5df5923a1974fed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.380863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.387305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3369baa68ddd4eb0a5df5923a1974fed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.388018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3369baa68ddd4eb0a5df5923a1974fed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.405820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d522355-fbcf-40e6-bb30-0a6c98e1e4bc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.406874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3369baa68ddd4eb0a5df5923a1974fed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.412551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.413466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.413739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.414068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.414814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.416439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e6db5-5a3d-41c7-84e2-0eedaee6296f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.419592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3369baa68ddd4eb0a5df5923a1974fed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:09.428721 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1041/2084] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:09 2021] DELETE /identity/v3/users/3369baa68ddd4eb0a5df5923a1974fed => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:09.428989 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1044/2085] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:09 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:09.432784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.433292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a394-2f70-447d-bdae-130634266b3c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.433691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a394-2f70-447d-bdae-130634266b3c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.434067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a394-2f70-447d-bdae-130634266b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.434234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.468489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1d6a394-2f70-447d-bdae-130634266b3c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:09.472467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1d6a394-2f70-447d-bdae-130634266b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.567686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1045/2086] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:09.570200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.572640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.573023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.612619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:09.614404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.643183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1046/2087] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:09.644543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.647510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.665047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c6a3-a266-4543-a131-621b0a7c4201 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.677737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.678623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc448-c6d1-4ca7-80ce-8afa2e1c0b3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.678816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.678909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.679636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] PATH_INFO: `/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63/users/64e39b2819e94c8bb2050c7109fd7334/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.711511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.711734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.712198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.712493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.716755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b720d82cbbb45c0afc72a9cd2b1fc63, user_id=64e39b2819e94c8bb2050c7109fd7334, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.723303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.724668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.752539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1047/2088] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:09 2021] PUT /identity/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63/users/64e39b2819e94c8bb2050c7109fd7334/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:09.753393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.837628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.839282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.865592 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1042/2089] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:09 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:09.866789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.868410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:09.932663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2edb0-24e1-45a5-a9b6-d8760334e4e9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:09.949751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:09.950416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:09.950690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:09.951047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:09.951751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:09.952156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:09.953662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:09.984036 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1048/2090] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:09.986071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:09.986808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057ec12-ed20-4688-8b5b-c82e5c5b88d8 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.014775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f13a7d-1636-4956-8118-68b034bee980 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.031424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.034376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.034868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.035290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.036819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.041282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.080769 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1049/2091] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:09 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:10.080769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.100104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.101374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.101795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.102346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.104148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0bd7a-b1d3-4890-8fca-e4a14d955098 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.116302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.117881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.119177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.119466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.120204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.125509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.126151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.127732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.146346 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1043/2092] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:10.147413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.169370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043b265-86d3-497b-83f0-8f16e922e3fd service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.176174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.185451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.185776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.186192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] PATH_INFO: `/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63/users/64e39b2819e94c8bb2050c7109fd7334/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.193210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b720d82cbbb45c0afc72a9cd2b1fc63, user_id=64e39b2819e94c8bb2050c7109fd7334, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.193774 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1050/2093] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:10 2021] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:10.195879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4415a5f-aeb8-48de-9e6d-08dc36797754 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.198616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.220670 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1044/2094] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:10 2021] PUT /identity/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63/users/64e39b2819e94c8bb2050c7109fd7334/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:10.230851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.231953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.232413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.311985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] MFA Rules not processed for user `64e39b2819e94c8bb2050c7109fd7334`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:10.314721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:10.337924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d27-947e-457f-bd74-2a49d308ca16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.469924 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1045/2095] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:10 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:10.483019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.534334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.535137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.535518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.535893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.537863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.547081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.595866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98a59-4f2a-4320-97f0-1c150bfc728d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.603008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.603963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.603963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.604222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.604942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.607420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.610383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1051/2096] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:10 2021] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:10.614362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.644024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126e8a-1898-4455-a83a-54f161c12b24 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.655511 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1046/2097] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:10 2021] POST /identity/v3/projects => generated 395 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:10.656824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.657965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.658595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.659023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.659975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.662083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.683118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.687138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1052/2098] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:10.689166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.702422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:10.736643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101a895-252e-4cfe-8363-149b6921c6f6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.879380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e71b8a-7ca8-4cc1-92f9-51f023797a6e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.885196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.886079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.886360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.886896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] PATH_INFO: `/v3/users/5739a6be8cf94e768d7cf6b046d53939` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.889009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.889905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.890138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5739a6be8cf94e768d7cf6b046d53939)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.890575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.891038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.891948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.892625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.894712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.920485 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1053/2099] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:10 2021] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:10.920485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.939854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb154-29f4-422f-891e-1d5c96bfe44f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:10.949726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:10.951050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:10.951331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:10.951603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:10.952351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:10.958428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:10.977522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5739a6be8cf94e768d7cf6b046d53939'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:10.991761 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1054/2100] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:10.993711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5739a6be8cf94e768d7cf6b046d53939'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:10.994203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:10.994945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5739a6be8cf94e768d7cf6b046d53939'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.000215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.023077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5739a6be8cf94e768d7cf6b046d53939'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.028832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325fa8a-5fb7-49c0-b23d-4c0ba8fbed3e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.037743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.039663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5739a6be8cf94e768d7cf6b046d53939'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.046170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.046454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.046728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] PATH_INFO: `/v3/projects/717e5841788344e89e8d073b02bd2e75` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.048816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1047/2101] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:10 2021] DELETE /identity/v3/users/5739a6be8cf94e768d7cf6b046d53939 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:11.049727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.050873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717e5841788344e89e8d073b02bd2e75)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.053413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.053547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.125713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717e5841788344e89e8d073b02bd2e75', 'request_id': 'req-e841ace7-305e-4c34-bee9-b7bc2a1163f0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.134746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717e5841788344e89e8d073b02bd2e75', 'request_id': 'req-e841ace7-305e-4c34-bee9-b7bc2a1163f0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.145769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717e5841788344e89e8d073b02bd2e75', 'request_id': 'req-e841ace7-305e-4c34-bee9-b7bc2a1163f0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.173725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] The token cache is being invalidate because project 717e5841788344e89e8d073b02bd2e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:11.174306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.175191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.175758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9289e17-faa2-44d5-8981-9ac3764f4266 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.177657 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1055/2102] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:10 2021] DELETE /identity/v3/projects/717e5841788344e89e8d073b02bd2e75 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:11.179075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.181605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.267177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.268114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.268550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.268859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.269622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.271425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad318f-7d47-4560-8dad-3be80ecf7ad5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.290743 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1048/2103] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:11 2021] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:11.292553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ace7-305e-4c34-bee9-b7bc2a1163f0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.294660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.295293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.295784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.303989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.305774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.305895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.306108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] PATH_INFO: `/v3/projects/52aceacc37564af39ed760d7d4c3291e/users/f5a88944e82e4cc4a3df303f87b8946b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.323295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:11.326406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.331043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52aceacc37564af39ed760d7d4c3291e, user_id=f5a88944e82e4cc4a3df303f87b8946b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.334639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.342036 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1049/2104] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:11.342741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.344234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.360791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1056/2105] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:11 2021] PUT /identity/v3/projects/52aceacc37564af39ed760d7d4c3291e/users/f5a88944e82e4cc4a3df303f87b8946b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:11.362037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.363167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a073b-bb4f-4370-b9b4-1a3b4476f832 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.363982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.455430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.456225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.456514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.456792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] PATH_INFO: `/v3/users/b3d86aeee15a4620b640e7bbca8926bf` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.458070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d86aeee15a4620b640e7bbca8926bf)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.459961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.498886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de890-dea2-4b28-82f0-e266045dc758 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.507126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.508352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.509094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.509631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.510596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.513244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.531981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1057/2106] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:11 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:11.532942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.535722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.541237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d86aeee15a4620b640e7bbca8926bf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.554914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d86aeee15a4620b640e7bbca8926bf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.556481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d86aeee15a4620b640e7bbca8926bf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.577128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d86aeee15a4620b640e7bbca8926bf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.599224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9bce7f7b-ca4d-4c34-ad07-9516a269a679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d86aeee15a4620b640e7bbca8926bf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:11.617231 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1050/2107] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:11 2021] DELETE /identity/v3/users/b3d86aeee15a4620b640e7bbca8926bf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:11.617231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.617231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.636099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.654887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2494e-a9b0-45f2-a2be-b05613b29af6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.752830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] MFA Rules not processed for user `f5a88944e82e4cc4a3df303f87b8946b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:11.754697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.765512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:11.766183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:11.766476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:11.766756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:11.781071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.957945 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1051/2108] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:11.962023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:11.962618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.964551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:11.966645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:11.994881 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1058/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:11.995435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c6c8-aedd-48fe-a409-f3d622865106 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:11.995739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:11.997269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:12.003570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.004635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.005017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.005381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] PATH_INFO: `/v3/projects/25352644a7504d6eae86e0e9cf801385/users/9ced44c4ebbb428b92509d30395b80cd/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.019116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215bb20-580f-4b36-8513-1e73cf84bbcd service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.029929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.030701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.031069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.031937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.032773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.040006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.062492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25352644a7504d6eae86e0e9cf801385, user_id=9ced44c4ebbb428b92509d30395b80cd, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.065412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4abc2-c690-4328-b342-e6f21399e98c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.090356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1059/2110] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:11 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:12.096123 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1052/2111] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:11 2021] PUT /identity/v3/projects/25352644a7504d6eae86e0e9cf801385/users/9ced44c4ebbb428b92509d30395b80cd/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:12.097983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.110351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.110741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.111108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.162957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] MFA Rules not processed for user `9ced44c4ebbb428b92509d30395b80cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:12.164323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:12.339967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797933-7f74-46e1-b2d0-4e48cd3f341e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.362824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.363581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.363866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.364162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.364882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.367551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.376346 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1053/2112] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:12 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:12.425604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.426495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1060/2113] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:12 2021] POST /identity/v3/users => generated 295 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:12.444407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2c017-84a1-44d8-8111-00b42b9a3be5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.466418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.467452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.467885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.468313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.469640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.470278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.472389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:12.477234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.502494 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1054/2114] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:12 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:12.507272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.529424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61263d1c-8023-43d5-9bf4-e18bdb59c074 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.538466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.539460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.539836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.540205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] PATH_INFO: `/v3/projects/958e2ef03d294319b4d64e30be137757/users/669793fa663a4e7f84c3669333bb5d21/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.570094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] RBAC: Authorizing `identity:create_grant(project_id=958e2ef03d294319b4d64e30be137757, user_id=669793fa663a4e7f84c3669333bb5d21, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.575616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.607125 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1055/2115] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:12 2021] PUT /identity/v3/projects/958e2ef03d294319b4d64e30be137757/users/669793fa663a4e7f84c3669333bb5d21/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:12.610818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.688340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ff22-b041-45d9-ba94-00e44d1e375f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.738331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d2d33-6f9e-45f8-9df1-73762967032b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.751439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.752390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.752850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.753785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.755957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.759646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.789651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1056/2116] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:12 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:12.794302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.815699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff08e1-d5de-4935-8b22-b0e892b5bdce admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:12.832318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.833350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.834198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.834294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] PATH_INFO: `/v3/projects/958e2ef03d294319b4d64e30be137757/users/669793fa663a4e7f84c3669333bb5d21/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.840121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958e2ef03d294319b4d64e30be137757, user_id=669793fa663a4e7f84c3669333bb5d21, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.844413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.868798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:12.869725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:12.870116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:12.870489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:12.873435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:12.893007 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1057/2117] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:12 2021] PUT /identity/v3/projects/958e2ef03d294319b4d64e30be137757/users/669793fa663a4e7f84c3669333bb5d21/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:12.901439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:12.911101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:12.955518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:12.970744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9232-916c-4d88-b87e-7cf8f7863e80 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:12.979585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1061/2118] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:12 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:13.003985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.005364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.005644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.055382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352864-8581-41e6-a809-a79d2928df77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.065418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.066734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.067236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.067722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] PATH_INFO: `/v3/projects/809c01c2567444ecba6a29f7e9646f93` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.070125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809c01c2567444ecba6a29f7e9646f93)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.072553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.078453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] MFA Rules not processed for user `669793fa663a4e7f84c3669333bb5d21`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:13.079703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.144780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809c01c2567444ecba6a29f7e9646f93', 'request_id': 'req-8ed74cbc-daeb-4932-9974-14da7b5f3159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.152943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809c01c2567444ecba6a29f7e9646f93', 'request_id': 'req-8ed74cbc-daeb-4932-9974-14da7b5f3159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.162144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809c01c2567444ecba6a29f7e9646f93', 'request_id': 'req-8ed74cbc-daeb-4932-9974-14da7b5f3159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.171542 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1062/2119] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:12 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:13.172421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.173776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.180554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] The token cache is being invalidate because project 809c01c2567444ecba6a29f7e9646f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:13.181019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.181897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ed74cbc-daeb-4932-9974-14da7b5f3159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.189585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1058/2120] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:12 2021] DELETE /identity/v3/projects/809c01c2567444ecba6a29f7e9646f93 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:13.189585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.189585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.189585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.190362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1059/2121] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:13.190471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f1b4-4831-4586-956c-7b8bacaaadc1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.190986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.192956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.265088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.265954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.266269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.266544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] PATH_INFO: `/v3/projects/364d355e87df40bc86e01a77cdc2a5c2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.267929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=364d355e87df40bc86e01a77cdc2a5c2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.270464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.290666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e5493-ec70-40bf-9886-9a7d7b4e4b14 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.301120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.301120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.301120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.301120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.301959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.345308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364d355e87df40bc86e01a77cdc2a5c2', 'request_id': 'req-5c3e3cce-4239-471c-9807-06f94dab4f1e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.351412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364d355e87df40bc86e01a77cdc2a5c2', 'request_id': 'req-5c3e3cce-4239-471c-9807-06f94dab4f1e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.360653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364d355e87df40bc86e01a77cdc2a5c2', 'request_id': 'req-5c3e3cce-4239-471c-9807-06f94dab4f1e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.378843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] The token cache is being invalidate because project 364d355e87df40bc86e01a77cdc2a5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:13.379133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.379856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c3e3cce-4239-471c-9807-06f94dab4f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.382388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.383570 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1063/2122] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:13 2021] DELETE /identity/v3/projects/364d355e87df40bc86e01a77cdc2a5c2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:13.384008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.388584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.389668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.389668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.407974 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1060/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:13 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:13.408955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:13.411262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.413669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:13.414974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.443977 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 10 03:58:13.446443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.451799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.502059 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1064/2124] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:13.502059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.502059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.515616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b903c-2513-4085-9f46-1a88f69fe916 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.521568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.524968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.525443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.525862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] PATH_INFO: `/v3/users/ac96ba0011b949fbba024a586fcc5ee0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.527393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac96ba0011b949fbba024a586fcc5ee0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.530619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.584648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e925a-2029-402b-9a42-7a24f2a61f5d service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.597373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac96ba0011b949fbba024a586fcc5ee0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.607200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac96ba0011b949fbba024a586fcc5ee0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.608725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac96ba0011b949fbba024a586fcc5ee0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.609627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac96ba0011b949fbba024a586fcc5ee0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.625102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e04c5ce-7160-4e54-857a-4a601e5bab0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac96ba0011b949fbba024a586fcc5ee0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:13.655029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1065/2125] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:13 2021] DELETE /identity/v3/users/ac96ba0011b949fbba024a586fcc5ee0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:13.656759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed082-46f8-4419-8ea9-d386fe0405ca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.657049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed082-46f8-4419-8ea9-d386fe0405ca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.657626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed082-46f8-4419-8ea9-d386fe0405ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.684368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e67ed082-46f8-4419-8ea9-d386fe0405ca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:13.686427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e67ed082-46f8-4419-8ea9-d386fe0405ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.698379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.700709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.701832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.703022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.705285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.709992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.720792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1061/2126] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:13 2021] GET /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 395 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:13.784403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1066/2127] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:13.785507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.799575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874bfe2-c668-423d-a8cf-5eac5122761c tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.805805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.806556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.806905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.807253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.808088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:13.808517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.810379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.831147 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1062/2128] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:13.831705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.832091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.832705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.834469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.837473 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1067/2129] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:13.845624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:13.847631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:13.859474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6500339-24c5-47df-95ee-c2602562c513 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:13.876477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:13.877341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:13.877628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:13.877895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:13.879178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:13.880796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:13.938692 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1063/2130] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:13 2021] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:13.942642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.957469 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 10 03:58:13.957863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:13.959465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.069309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7629bf-e7b0-4340-aa5d-64ce35702b9f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.075750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.076428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.076738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.077014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.077726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.079719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.080083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6e36f-cb8c-4538-8d1f-9a5f024f76c3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.115752 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1064/2131] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:13 2021] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:14.117724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.123075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.164641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c9df-f85c-4f3b-acdd-34ef016390d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.169943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.170997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.171495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.171843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] PATH_INFO: `/v3/projects/24254c4b84354a0a963fe912785826ae` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.173551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24254c4b84354a0a963fe912785826ae)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.175577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.183128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.184724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.186676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.186968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.190315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.193411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.198581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1068/2132] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:13 2021] GET /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 395 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:58:14.201045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.225729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f8bb-1108-4509-923b-0530330736b3 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.241024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.242940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.243220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.243495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.244238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.247287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a47777-1287-4111-a172-3ae1aab0234f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.257235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24254c4b84354a0a963fe912785826ae', 'request_id': 'req-4bf84996-d03f-4fb7-a698-18180ba4056a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.260652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24254c4b84354a0a963fe912785826ae', 'request_id': 'req-4bf84996-d03f-4fb7-a698-18180ba4056a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.266543 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1069/2133] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:14 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:14.266543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.266543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.266543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.267710 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1070/2134] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:14.268410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.270132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.271507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24254c4b84354a0a963fe912785826ae', 'request_id': 'req-4bf84996-d03f-4fb7-a698-18180ba4056a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.286179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] The token cache is being invalidate because project 24254c4b84354a0a963fe912785826ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:14.286728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.289004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.291502 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1065/2135] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:14 2021] DELETE /identity/v3/projects/24254c4b84354a0a963fe912785826ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:14.292659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.300982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.352039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae6b29-2c74-4f7d-a423-12b1a567cae9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.359182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.360122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.360405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.360713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] PATH_INFO: `/v3/users/f5a88944e82e4cc4a3df303f87b8946b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.361948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a88944e82e4cc4a3df303f87b8946b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.363885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.373442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf84996-d03f-4fb7-a698-18180ba4056a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.389470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.389470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.389470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.389470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.390365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.391054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.404337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1066/2136] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:14 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:14.405350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:14.407266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.421917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a88944e82e4cc4a3df303f87b8946b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.429831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a88944e82e4cc4a3df303f87b8946b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.430537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a88944e82e4cc4a3df303f87b8946b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.431211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a88944e82e4cc4a3df303f87b8946b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.442949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83563161-4fc9-4318-b4e3-4a98a5978439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a88944e82e4cc4a3df303f87b8946b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:14.461457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1071/2137] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:14 2021] DELETE /identity/v3/users/f5a88944e82e4cc4a3df303f87b8946b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:14.465938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.466207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.466503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.491445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:14.492844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.492998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.496105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.563146 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1072/2138] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:14.565533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.566752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489564-2c18-43fa-aebc-8a2417ec766a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.566887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.579573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ce0e9-98d6-4633-99c9-15bf10e5d251 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.584537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.585440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.585717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.585990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] PATH_INFO: `/v3/projects/ce12def5645f416db03154eb161062ad/users/82c95b2472314860a594ea23b236d817/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.602065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce12def5645f416db03154eb161062ad, user_id=82c95b2472314860a594ea23b236d817, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.604890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef56a-ab00-4404-880f-65236e1b03cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.623009 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1073/2139] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:14 2021] PUT /identity/v3/projects/ce12def5645f416db03154eb161062ad/users/82c95b2472314860a594ea23b236d817/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:14.624470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.624776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.625052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.634483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.639099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.639099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.639099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.639099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.640564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2260a22-1a1a-4216-a34e-ac232160d663 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.642979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1067/2140] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:14 2021] GET /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 395 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:14.643353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:14.644386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307faaf6-b0a7-473a-a5b0-081c085bb4b6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.644578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.644718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307faaf6-b0a7-473a-a5b0-081c085bb4b6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.644966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307faaf6-b0a7-473a-a5b0-081c085bb4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.667109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-307faaf6-b0a7-473a-a5b0-081c085bb4b6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:14.668868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-307faaf6-b0a7-473a-a5b0-081c085bb4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.743679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1068/2141] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:14.745049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.745331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.745600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.800727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] MFA Rules not processed for user `82c95b2472314860a594ea23b236d817`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:14.802444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.810396 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1074/2142] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:14.811083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.827447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6ec47-85b6-41b1-97c1-d87b31016693 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.836354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.837139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.837423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.837701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.838453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:14.838798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.841016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.864939 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1075/2143] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:14.864939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.880333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:14.905471 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1069/2144] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:14.908330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.924554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d718-546c-4f04-8727-bba2bdc52bc2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.929124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.929809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.930083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.930352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.931047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.932948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.948291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135106e5-15dd-4c7a-8749-2f03fb07e5e8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:14.955706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:14.956750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:14.957062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:14.957538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:14.968821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1070/2145] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:14.969312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:14.969692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:14.970792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:14.993619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1076/2146] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:14.994569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.015711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeccf1-f2dc-4b02-8aa6-b07766c8b22e service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.060566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e745858-5203-46c7-a235-186d0fecdfc5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.067300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.068208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.068565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.068960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.069738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.072485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.101261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.101944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.102195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.102466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.103162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.107410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.112666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1071/2147] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:15.112666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.113442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.132318 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1077/2148] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:14 2021] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:15.139770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.152691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12079-d7ac-4306-9e27-8b21ab1e855c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.235554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161938-05bd-41f4-b1fa-ed26141df7f3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.253089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.253754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.256665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.256665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.266496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.266897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.267588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.267869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.268142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.268898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.270818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.320858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1078/2149] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:15 2021] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:15.321952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.333178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f6dd9-1f8e-4707-8f20-aa57838628bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.340824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.341509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.341786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.342055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.343094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.344708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.359791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1079/2150] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:15.361329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.378084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.379939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.392291 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1072/2151] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:15.393368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.401617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148372-f291-4de2-8774-47bd40b64ecb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.410993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60416-3340-4131-a7d0-4046344a5e59 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.422732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.429259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.430041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.430323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.431267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.431405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.432754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.434865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.438284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.439271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.440267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.441980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.453091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1080/2152] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:15.453916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.457551 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1073/2153] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:15.457551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.459350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.469063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964352df-102f-4b3f-84e1-a86d84bcb346 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.474476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd744e-29a2-49f3-9bdc-8f2fa33f4977 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.476250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.477159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.479450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.479634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.479779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] PATH_INFO: `/v3/projects/d73d7b6d93814b7db9913e3367871736/users/e0eefbe0ace34860ae817893cf1958d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.480762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.481299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.481745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] PATH_INFO: `/v3/projects/52aceacc37564af39ed760d7d4c3291e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.483063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52aceacc37564af39ed760d7d4c3291e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.485085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.504841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73d7b6d93814b7db9913e3367871736, user_id=e0eefbe0ace34860ae817893cf1958d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.507888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.526548 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1074/2154] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:15 2021] PUT /identity/v3/projects/d73d7b6d93814b7db9913e3367871736/users/e0eefbe0ace34860ae817893cf1958d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:15.527576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.551503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aceacc37564af39ed760d7d4c3291e', 'request_id': 'req-19b528a5-1531-4933-a0fa-914d6ac14ce7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.558762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aceacc37564af39ed760d7d4c3291e', 'request_id': 'req-19b528a5-1531-4933-a0fa-914d6ac14ce7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.567295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aceacc37564af39ed760d7d4c3291e', 'request_id': 'req-19b528a5-1531-4933-a0fa-914d6ac14ce7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.583095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] The token cache is being invalidate because project 52aceacc37564af39ed760d7d4c3291e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:15.583318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.584280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.585835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1081/2155] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:15 2021] DELETE /identity/v3/projects/52aceacc37564af39ed760d7d4c3291e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:15.586587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.587863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.596837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07747742-a57b-4170-a55d-5c14b623a2b7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.668433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.668708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b528a5-1531-4933-a0fa-914d6ac14ce7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.669620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.669891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.670162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] PATH_INFO: `/v3/projects/188b18d111ad429387d64424998c4b8e/users/7c1eae878e46492d9800ec8c3405ad79/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.674571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.675320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.675667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.676037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.676880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.678793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4ae0-0f56-4cda-81ce-6393d2c6a67e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.693119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1082/2156] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:15.694491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.694771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.695041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.697084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1083/2157] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:15.697634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.699394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.701506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b18d111ad429387d64424998c4b8e, user_id=7c1eae878e46492d9800ec8c3405ad79, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.704358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.718327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb249a-5e67-440b-a9a1-8ca5c2737b73 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.721847 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1075/2158] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:15 2021] PUT /identity/v3/projects/188b18d111ad429387d64424998c4b8e/users/7c1eae878e46492d9800ec8c3405ad79/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:15.722844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.779107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.780393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.780719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.780987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] PATH_INFO: `/v3/users/669793fa663a4e7f84c3669333bb5d21` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.782195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=669793fa663a4e7f84c3669333bb5d21)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.784227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.786421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018acb4-2d42-4fed-b1fe-3c5533098a01 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:15.791955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:15.792869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.793168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.793503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] PATH_INFO: `/v3/projects/d73d7b6d93814b7db9913e3367871736/users/e0eefbe0ace34860ae817893cf1958d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.795519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73d7b6d93814b7db9913e3367871736, user_id=e0eefbe0ace34860ae817893cf1958d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:15.798429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:15.816186 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1076/2159] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:15 2021] PUT /identity/v3/projects/d73d7b6d93814b7db9913e3367871736/users/e0eefbe0ace34860ae817893cf1958d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:15.830252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:15.832419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.840850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669793fa663a4e7f84c3669333bb5d21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.849194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669793fa663a4e7f84c3669333bb5d21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.850381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669793fa663a4e7f84c3669333bb5d21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.851133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669793fa663a4e7f84c3669333bb5d21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.859613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b4191fa7-e754-47bc-9e87-77fe1b68b29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669793fa663a4e7f84c3669333bb5d21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:15.887084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1084/2160] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:15 2021] DELETE /identity/v3/users/669793fa663a4e7f84c3669333bb5d21 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:15.887084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f44f-0298-43a6-9330-2b1fa4237ffa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:15.887084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f44f-0298-43a6-9330-2b1fa4237ffa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:15.887084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f44f-0298-43a6-9330-2b1fa4237ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:15.921984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2119f44f-0298-43a6-9330-2b1fa4237ffa None None] MFA Rules not processed for user `7c1eae878e46492d9800ec8c3405ad79`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:15.923246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2119f44f-0298-43a6-9330-2b1fa4237ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:15.929821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:15.931123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.003521 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1085/2161] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:15 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:16.005093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.005389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.005843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.043037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] MFA Rules not processed for user `e0eefbe0ace34860ae817893cf1958d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:16.047326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.061376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4ea7-f5c1-4f20-a078-10fbd570b7bd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.156668 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1086/2162] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:16 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:16.156668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.157888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.174361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.175367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.175731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.176075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.177466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.179874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.181850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1077/2163] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:15 2021] GET /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 395 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:16.192629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.195790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.264489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b01e-f3dc-44ec-babc-7ab9bf3e24de None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.272260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.274341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.274647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.274931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.275656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.278142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae72b1-8be0-4b33-bcec-e4081bb546f7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.320287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1087/2164] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:16 2021] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:16.320742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0175-59a9-4921-a96f-95eb89381cb7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.321019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0175-59a9-4921-a96f-95eb89381cb7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.321301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0175-59a9-4921-a96f-95eb89381cb7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.323726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1088/2165] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:16.324346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0175-59a9-4921-a96f-95eb89381cb7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.341354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836027ff-fd3e-46ef-a4fc-d3fd2d0a5284 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.426910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0175-59a9-4921-a96f-95eb89381cb7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.432535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.433363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.433649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.433962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.434682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.434923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.436126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.436399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.436631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.436747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.461038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1089/2166] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:16 2021] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:16.461870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:16.463488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.479451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.481354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.506535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.508242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.523460 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1078/2167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:16.527498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.527498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.545720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441800-8e7f-4eca-8fad-6fdb3e1efef9 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.551654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.552855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.553185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.553724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] PATH_INFO: `/v3/projects/958e2ef03d294319b4d64e30be137757` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.554939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=958e2ef03d294319b4d64e30be137757)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.556938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.561557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290331c-6b48-4fd7-8f45-a21c5705fa35 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.567640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.568778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.569266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.569891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.572632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.576116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.588821 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1090/2168] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 395 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:16.590971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.604495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa40ad-a7be-41b9-87dc-ad9c1ec04de8 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.611322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958e2ef03d294319b4d64e30be137757', 'request_id': 'req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:16.617721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958e2ef03d294319b4d64e30be137757', 'request_id': 'req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:16.624333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958e2ef03d294319b4d64e30be137757', 'request_id': 'req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:16.650260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] The token cache is being invalidate because project 958e2ef03d294319b4d64e30be137757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:16.651029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:16.653898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bfe2bf94-4ee9-4454-b51f-8aae1f07b389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:16.656365 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1079/2169] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:16 2021] DELETE /identity/v3/projects/958e2ef03d294319b4d64e30be137757 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:16.663102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.663469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.663717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.679669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.680467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.681174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.681483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.682286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.683906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.695429 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1091/2170] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:16.700661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.702367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:16.704147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.704283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.714110 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1080/2171] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:16.722721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.724208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.729736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297d1d-e1cc-4da1-a7e0-602c70cb0561 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.740301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.741217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.741491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.742039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] PATH_INFO: `/v3/projects/dadddf339fba4a7492af33ba344122da/users/c8eed1b693344251aa3b0cd5202059b4/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.762595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadddf339fba4a7492af33ba344122da, user_id=c8eed1b693344251aa3b0cd5202059b4, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.765463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3957-ae65-4087-a119-765e0db4a6b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.781328 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1092/2172] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:16 2021] PUT /identity/v3/projects/dadddf339fba4a7492af33ba344122da/users/c8eed1b693344251aa3b0cd5202059b4/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:16.782688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.783037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.783366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.804563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:16.805804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.845107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc6dbc-8db2-4888-80e1-a5036b46a04a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.893521 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1093/2173] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:16.894612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.907100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5144-eee1-4c61-9a9b-3f7eba7e5c5e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.914647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.915314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.915442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.915729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.916010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.916374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.916846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.916949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.917281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.918525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb3299-f7ab-4ac2-9fb1-d02642d5e0ff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.919224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:16.931211 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1094/2174] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:16.932820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2507e-f12f-4984-9f43-1cf99cc7f9e0 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.933104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2507e-f12f-4984-9f43-1cf99cc7f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.933422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2507e-f12f-4984-9f43-1cf99cc7f9e0 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.935891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1095/2175] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:16.936806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2507e-f12f-4984-9f43-1cf99cc7f9e0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.951414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2507e-f12f-4984-9f43-1cf99cc7f9e0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.955968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.956632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.956934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.957206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.957936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:16.958236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.959804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.973225 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1096/2176] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:16.974303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:16.984647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017eb5f-0d34-4815-b312-65a22879f22c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:16.990690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:16.991694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:16.991958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:16.992221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] PATH_INFO: `/v3/projects/dadddf339fba4a7492af33ba344122da/users/c8eed1b693344251aa3b0cd5202059b4/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:16.994299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadddf339fba4a7492af33ba344122da, user_id=c8eed1b693344251aa3b0cd5202059b4, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.994416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:16.996124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:16.997638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.009450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1097/2177] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:16 2021] PUT /identity/v3/projects/dadddf339fba4a7492af33ba344122da/users/c8eed1b693344251aa3b0cd5202059b4/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:17.017067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1081/2178] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:16 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:17.018625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.019922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:17.022649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.035126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d19-8cc8-48cb-a85b-488e53bb6e70 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.110438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.113400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.114374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.115175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.116588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.117957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.118546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.122148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3639-078b-4547-97c9-a8e3803b12e5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.167023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1082/2179] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:17 2021] POST /identity/v3/projects => generated 395 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:17.169810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.170101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.170375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.199358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e998-8c76-4077-877e-a915e3c963e8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.206564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] MFA Rules not processed for user `c8eed1b693344251aa3b0cd5202059b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:17.208020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.259899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e39b2819e94c8bb2050c7109fd7334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.260790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.261069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.261577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] PATH_INFO: `/v3/projects/25352644a7504d6eae86e0e9cf801385` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.263374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorizing `identity:get_project(project_id=25352644a7504d6eae86e0e9cf801385)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.268223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.270074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1098/2180] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:17 2021] GET /identity/v3/projects/25352644a7504d6eae86e0e9cf801385 => generated 395 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:17.270823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.332325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1083/2181] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:17 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:17.364585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d96ae-a358-4647-a390-38f2088a7443 tempest-FlavorsAccessNegativeTestJSON-1309992211 tempest-FlavorsAccessNegativeTestJSON-1309992211-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.383625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.384340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.384653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.384966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.385688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.388087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.415595 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1099/2182] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:17 2021] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:17.416573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.424289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.441127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bd25-dbcb-430e-9046-7f7b8442a600 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.457162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.458084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.458084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.458359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.459106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.460692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.477738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1084/2183] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:17 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:17.479187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.493584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304501-b134-4c9d-b0a5-386a9ff0a417 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.501262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.501996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.502339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.502677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.503869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.505275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.519724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1085/2184] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:17.521007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.537457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd40d-7183-4b5d-bdd7-683e0e876b1b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.542925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.544331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.544602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.544923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] PATH_INFO: `/v3/projects/47c7e664ca304879a6efb959ea708c8e/users/457f51a382cc4eb18cc815a1ca48873e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.569575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c7e664ca304879a6efb959ea708c8e, user_id=457f51a382cc4eb18cc815a1ca48873e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.572751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.589774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1086/2185] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:17 2021] PUT /identity/v3/projects/47c7e664ca304879a6efb959ea708c8e/users/457f51a382cc4eb18cc815a1ca48873e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:17.590680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.592557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.595914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763adb66-2c19-43e7-b6af-eb56a84398ac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.684624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704bab-b0cc-4642-81c6-8073ff62696a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.695517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.697707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.698094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.698372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] PATH_INFO: `/v3/users/76259eed8da64b38998266cf107f0127` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.699909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76259eed8da64b38998266cf107f0127)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.702151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.705419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.706187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.706568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.706920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.774952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76259eed8da64b38998266cf107f0127'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:17.788994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76259eed8da64b38998266cf107f0127'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:17.789891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76259eed8da64b38998266cf107f0127'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:17.814921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76259eed8da64b38998266cf107f0127'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:17.822517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.824534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910daf0-c4e4-462f-bc39-b214c91c4759 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.829576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76259eed8da64b38998266cf107f0127'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:17.839554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1100/2186] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:17 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:17.846776 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1087/2187] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:17 2021] DELETE /identity/v3/users/76259eed8da64b38998266cf107f0127 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:17.847192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbaf3-6894-43e0-920d-edf683df8afe None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.847609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:17.847863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbaf3-6894-43e0-920d-edf683df8afe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.848320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbaf3-6894-43e0-920d-edf683df8afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.850799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.890944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-78bdbaf3-6894-43e0-920d-edf683df8afe None None] MFA Rules not processed for user `457f51a382cc4eb18cc815a1ca48873e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:17.893608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-78bdbaf3-6894-43e0-920d-edf683df8afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:17.946596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51054c-b0e4-4af9-bd2d-dd98b860c1c5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:17.953186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:17.955234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.955661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.955934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] PATH_INFO: `/v3/users/82c95b2472314860a594ea23b236d817` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:17.957589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c95b2472314860a594ea23b236d817)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:17.960070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:17.982143 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1101/2188] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:17 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:17.987236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:17.987531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:17.988590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.016875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:18.018361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.028581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1102/2189] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:18.029439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.030787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.051270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c95b2472314860a594ea23b236d817'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:18.051482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865ff20-e5e0-4a5d-a1aa-91ca9a81d465 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.056368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.057274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.057558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.057834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.058547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.060934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.061381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c95b2472314860a594ea23b236d817'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:18.062446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c95b2472314860a594ea23b236d817'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:18.082468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c95b2472314860a594ea23b236d817'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:18.092319 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1103/2190] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:18 2021] POST /identity/v3/projects => generated 395 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:18.093422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.095201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.101822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c95b2472314860a594ea23b236d817'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:18.115435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1088/2191] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:17 2021] DELETE /identity/v3/users/82c95b2472314860a594ea23b236d817 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:18.119565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.122668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.171986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b006f-962c-4b74-9224-fcb9fac2f02b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.226186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab1db1-6b57-4f5b-b270-2ce3bdd92f97 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.231676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.232488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.233116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.233494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.234407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.236891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.237243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6bb53-31c8-4448-af78-ce460723652d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.237537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.237822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.238097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.240158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.255838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.257505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.278408 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1089/2192] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:18 2021] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:18.279949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.281311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.281824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.285111 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1104/2193] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:18.293800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.308979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:18.310422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.320875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1090/2194] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:18.331867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07c3f-5c3f-4e33-8159-bf7c01601c06 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.332971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.334713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.351632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.352319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.352599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.352896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.353799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.355779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.363903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c37d6e-137a-4574-90f5-d54aa18e9a16 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.378314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.379783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.380785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.381371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.395553 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1105/2195] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:18 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:18.396888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.419170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3ec9e-0b12-403f-9853-c17306ebc292 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.423485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.427143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.428282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.430566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.430942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.431203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] PATH_INFO: `/v3/projects/db74d325faac4b739c7dffedabc3939f/users/d6a87b667ecb4c909c7d18a7506068fa/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.456717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db74d325faac4b739c7dffedabc3939f, user_id=d6a87b667ecb4c909c7d18a7506068fa, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.456899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1091/2196] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:18.462097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.491112 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1106/2197] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:18 2021] PUT /identity/v3/projects/db74d325faac4b739c7dffedabc3939f/users/d6a87b667ecb4c909c7d18a7506068fa/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:18.495309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.519296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d209b-b559-4b1b-8a3e-d7925105d935 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.697726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.698492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.698774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.699058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.700844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.705999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3910ea-4ec9-41ca-8003-3af7db7bad5b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.741001 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1092/2198] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:18 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:18.743060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.755648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d86f4-b2a7-47d8-b143-8dc2333d9f78 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:18.771780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:18.773293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.773582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.773857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] PATH_INFO: `/v3/projects/db74d325faac4b739c7dffedabc3939f/users/d6a87b667ecb4c909c7d18a7506068fa/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.777114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db74d325faac4b739c7dffedabc3939f, user_id=d6a87b667ecb4c909c7d18a7506068fa, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:18.783787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:18.821941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:18.822241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:18.822514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:18.823849 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1107/2199] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:18 2021] PUT /identity/v3/projects/db74d325faac4b739c7dffedabc3939f/users/d6a87b667ecb4c909c7d18a7506068fa/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:18.879276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] MFA Rules not processed for user `d6a87b667ecb4c909c7d18a7506068fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:18.880850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:18.889936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:18.891740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.028656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44336-d33a-4147-a5eb-4c1314780bc0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:19.040470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:19.041535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:19.041810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:19.042083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] PATH_INFO: `/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:19.043978 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1093/2200] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:18 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:19.048953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f83737b8fe94ae9a93ed34a4b4ff460)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:19.051130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:19.130101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f83737b8fe94ae9a93ed34a4b4ff460', 'request_id': 'req-bf61e484-8984-46d4-a539-93790fff6d25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.141546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f83737b8fe94ae9a93ed34a4b4ff460', 'request_id': 'req-bf61e484-8984-46d4-a539-93790fff6d25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.154046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f83737b8fe94ae9a93ed34a4b4ff460', 'request_id': 'req-bf61e484-8984-46d4-a539-93790fff6d25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.179465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:19.180982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.186188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] The token cache is being invalidate because project 3f83737b8fe94ae9a93ed34a4b4ff460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:19.186482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.192786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.198964 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1108/2201] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:18 2021] DELETE /identity/v3/projects/3f83737b8fe94ae9a93ed34a4b4ff460 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:19.203006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:19.204568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.273602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec198-65a4-4bbb-99b1-1bde27a9cca2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:19.286205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e484-8984-46d4-a539-93790fff6d25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:19.305689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:19.306765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:19.308028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:19.308412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] PATH_INFO: `/v3/users/64e39b2819e94c8bb2050c7109fd7334` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:19.310108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e39b2819e94c8bb2050c7109fd7334)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:19.312218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:19.357881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:19.358707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:19.358990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:19.359280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:19.361508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.390081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e39b2819e94c8bb2050c7109fd7334'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.410215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e39b2819e94c8bb2050c7109fd7334'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.411480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e39b2819e94c8bb2050c7109fd7334'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.412249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e39b2819e94c8bb2050c7109fd7334'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.428327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e39b2819e94c8bb2050c7109fd7334'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.446357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:19.449212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:19.462212 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1094/2202] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:19 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:19.463151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:19.464760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.475397 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1109/2203] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:19 2021] DELETE /identity/v3/users/64e39b2819e94c8bb2050c7109fd7334 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:19.482161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d587a7-e772-4b59-b381-165d4611d4f6 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:19.610168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:19.611318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:19.619422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:19.621379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] PATH_INFO: `/v3/projects/ce12def5645f416db03154eb161062ad` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:19.626192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce12def5645f416db03154eb161062ad)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:19.642161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:19.744277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce12def5645f416db03154eb161062ad', 'request_id': 'req-27a1056d-2975-4963-b822-52b1c2eaaa4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.753956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce12def5645f416db03154eb161062ad', 'request_id': 'req-27a1056d-2975-4963-b822-52b1c2eaaa4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.765689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce12def5645f416db03154eb161062ad', 'request_id': 'req-27a1056d-2975-4963-b822-52b1c2eaaa4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.786645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] The token cache is being invalidate because project ce12def5645f416db03154eb161062ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:19.787726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.788507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:19.792659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1095/2204] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:19 2021] DELETE /identity/v3/projects/ce12def5645f416db03154eb161062ad => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:19.799799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:19.808240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:19.832550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b297d-a760-41f2-952b-25c41dcc7ac5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:19.967004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:19.968634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:19.969553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:19.970586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] PATH_INFO: `/v3/users/e0eefbe0ace34860ae817893cf1958d7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:19.973604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0eefbe0ace34860ae817893cf1958d7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:19.979628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:20.057202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0eefbe0ace34860ae817893cf1958d7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.071162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0eefbe0ace34860ae817893cf1958d7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.072736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0eefbe0ace34860ae817893cf1958d7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.073704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0eefbe0ace34860ae817893cf1958d7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.087972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0eefbe0ace34860ae817893cf1958d7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.092060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:20.094121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:20.115835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1110/2205] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:19 2021] DELETE /identity/v3/users/e0eefbe0ace34860ae817893cf1958d7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:20.261040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1056d-2975-4963-b822-52b1c2eaaa4d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:20.468092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:20.469925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:20.470173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:20.470566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:20.477655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:20.587923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:20.589707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:20.600743 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1096/2206] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:20 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:20.620626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:20.624011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:20.763639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed9323-aa59-401c-9832-e0e5cd8c2e81 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:20.778183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:20.779073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:20.779337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:20.779608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] PATH_INFO: `/v3/users/457f51a382cc4eb18cc815a1ca48873e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:20.780895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457f51a382cc4eb18cc815a1ca48873e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:20.784135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:20.828825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:20.835155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:20.866661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26424059-f983-443f-9a10-2366940a1fc3 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:20.879369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:20.880253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:20.880529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:20.880840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] PATH_INFO: `/v3/users/7c1eae878e46492d9800ec8c3405ad79` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:20.882249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1eae878e46492d9800ec8c3405ad79)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:20.888322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:20.916140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457f51a382cc4eb18cc815a1ca48873e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.929503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457f51a382cc4eb18cc815a1ca48873e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.930419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457f51a382cc4eb18cc815a1ca48873e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.931235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457f51a382cc4eb18cc815a1ca48873e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:20.974049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457f51a382cc4eb18cc815a1ca48873e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.004037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1eae878e46492d9800ec8c3405ad79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.013548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1eae878e46492d9800ec8c3405ad79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.015122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1eae878e46492d9800ec8c3405ad79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.020970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1111/2207] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:20 2021] DELETE /identity/v3/users/457f51a382cc4eb18cc815a1ca48873e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:21.023282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:21.028329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.034112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1eae878e46492d9800ec8c3405ad79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.048648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f2d5f950-3cf9-4836-906a-c3600cc55007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1eae878e46492d9800ec8c3405ad79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.060197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1097/2208] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:20 2021] DELETE /identity/v3/users/7c1eae878e46492d9800ec8c3405ad79 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:21.063134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd82e-e343-4e00-8431-2cdd83450890 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.063749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd82e-e343-4e00-8431-2cdd83450890 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.065979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd82e-e343-4e00-8431-2cdd83450890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.104841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a23cd82e-e343-4e00-8431-2cdd83450890 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:21.106636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a23cd82e-e343-4e00-8431-2cdd83450890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.172257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8da4f-ddb1-425d-8ff0-c637b26d72d5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:21.250400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:21.251435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.251714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.252148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] PATH_INFO: `/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.253485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b720d82cbbb45c0afc72a9cd2b1fc63)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:21.255522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:21.258677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1098/2209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:21.266725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.267008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.267284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.306653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:21.308537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.322598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'request_id': 'req-4d2ce496-d763-4047-9126-ed67bce541b8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.328983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'request_id': 'req-4d2ce496-d763-4047-9126-ed67bce541b8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.337425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b720d82cbbb45c0afc72a9cd2b1fc63', 'request_id': 'req-4d2ce496-d763-4047-9126-ed67bce541b8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.357777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] The token cache is being invalidate because project 6b720d82cbbb45c0afc72a9cd2b1fc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:21.358141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.359082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.364290 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1112/2210] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:21 2021] DELETE /identity/v3/projects/6b720d82cbbb45c0afc72a9cd2b1fc63 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:21.365782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:21.367430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.392445 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1099/2211] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:21.393683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:21.395116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.466664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce496-d763-4047-9126-ed67bce541b8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:21.475358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:21.477162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.482849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.482849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] PATH_INFO: `/v3/projects/d73d7b6d93814b7db9913e3367871736` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.483734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73d7b6d93814b7db9913e3367871736)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:21.485669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:21.486872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ae29-2f3a-4dea-b54f-18cda6f14d7b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:21.491276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:21.491924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.492206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.492483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.494606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.507587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:21.509076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:21.522724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1100/2212] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:21.523651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:21.525291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.541249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dea7e1-a88e-46bd-8d79-14eaaf05ee63 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:21.557979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:21.560845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.561152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.563353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73d7b6d93814b7db9913e3367871736', 'request_id': 'req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.564450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] PATH_INFO: `/v3/users/9ced44c4ebbb428b92509d30395b80cd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.570713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73d7b6d93814b7db9913e3367871736', 'request_id': 'req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.579959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73d7b6d93814b7db9913e3367871736', 'request_id': 'req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.580178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ced44c4ebbb428b92509d30395b80cd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:21.582078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:21.602272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] The token cache is being invalidate because project d73d7b6d93814b7db9913e3367871736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:21.602882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.604134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.612429 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1113/2213] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:21 2021] DELETE /identity/v3/projects/d73d7b6d93814b7db9913e3367871736 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:21.614076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:21.615688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.700520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887ac7-d6a8-4ffc-ba26-4a88000dc75b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:21.707265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:21.708135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.708598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.709067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.711940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.714430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ced44c4ebbb428b92509d30395b80cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.729040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ced44c4ebbb428b92509d30395b80cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.733599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ced44c4ebbb428b92509d30395b80cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.785192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ced44c4ebbb428b92509d30395b80cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.814438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b7f0fd5c-723c-424e-89bb-bddbed667fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ced44c4ebbb428b92509d30395b80cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:21.832201 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1101/2214] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:21 2021] DELETE /identity/v3/users/9ced44c4ebbb428b92509d30395b80cd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:21.834021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:21.834310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:21.834582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:21.868634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:21.882058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:21.907600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:21.909802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c6271-9aed-4e20-939a-37e3f6040e5d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:21.921181 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1114/2215] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:21.990877 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1102/2216] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:21.999586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.000185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.000488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.039875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:22.049599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.072245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.073914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.082106 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1115/2217] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:22.086848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.098257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babcc15-74ce-47e5-9038-b03cac285269 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.109325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.110331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.110628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.110871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] PATH_INFO: `/v3/projects/47c7e664ca304879a6efb959ea708c8e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.112091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c7e664ca304879a6efb959ea708c8e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.114643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.128862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73fc3d-403d-425b-b191-db8a81ae7267 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.142498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.143762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.145267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.146384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.148592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:22.150208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.153140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.173372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1116/2218] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:22.187309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.219580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e650fe-e69c-4d1d-b765-7af6ef2c544b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.254652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c7e664ca304879a6efb959ea708c8e', 'request_id': 'req-a4071494-ec57-4fb9-b870-eb53d4f615d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.269960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c7e664ca304879a6efb959ea708c8e', 'request_id': 'req-a4071494-ec57-4fb9-b870-eb53d4f615d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.285573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c7e664ca304879a6efb959ea708c8e', 'request_id': 'req-a4071494-ec57-4fb9-b870-eb53d4f615d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.309877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] The token cache is being invalidate because project 47c7e664ca304879a6efb959ea708c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:22.310708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.311384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.319184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1103/2219] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:22 2021] DELETE /identity/v3/projects/47c7e664ca304879a6efb959ea708c8e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:22.320967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.323534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.341093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.342624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.342912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.343190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.344426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.347152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.399526 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1117/2220] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:22 2021] POST /identity/v3/projects => generated 411 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:22.406256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.409073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4071494-ec57-4fb9-b870-eb53d4f615d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.411688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.484004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.484927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.486187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.486333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] PATH_INFO: `/v3/users/d6a87b667ecb4c909c7d18a7506068fa` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.489309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a87b667ecb4c909c7d18a7506068fa)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.491288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.567273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a87b667ecb4c909c7d18a7506068fa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.567952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca4ce-bbcb-4739-a1c6-70694b3d22d1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.583508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.584188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.584464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.584766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.587652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a87b667ecb4c909c7d18a7506068fa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.588126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.589294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a87b667ecb4c909c7d18a7506068fa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.593055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.637349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a87b667ecb4c909c7d18a7506068fa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.658526 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1118/2221] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:22 2021] POST /identity/v3/users => generated 306 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:22.659638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.667199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a87b667ecb4c909c7d18a7506068fa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.677344 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1104/2222] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:22 2021] DELETE /identity/v3/users/d6a87b667ecb4c909c7d18a7506068fa => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:22.678839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.681701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.683185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589896-e867-4e5f-a268-d2af63f54892 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.788689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.790207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.790585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.790950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.791944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.794436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.813401 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1119/2223] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:22 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:22.814533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.817421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:22.835432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878f43-630c-42fa-9792-aa25dc3e9d77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.839694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726a535-8430-47f6-94c0-69854099f4f0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:22.846692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.848030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:22.848183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.848504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.849184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] PATH_INFO: `/v3/projects/188b18d111ad429387d64424998c4b8e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.849655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:22.849928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:22.851544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=188b18d111ad429387d64424998c4b8e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.851845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] PATH_INFO: `/v3/projects/25352644a7504d6eae86e0e9cf801385` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:22.853895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25352644a7504d6eae86e0e9cf801385)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:22.854299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.857971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:22.926707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188b18d111ad429387d64424998c4b8e', 'request_id': 'req-99a8a88b-1f2e-429e-b586-a0064679a8cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.938540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188b18d111ad429387d64424998c4b8e', 'request_id': 'req-99a8a88b-1f2e-429e-b586-a0064679a8cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.951020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188b18d111ad429387d64424998c4b8e', 'request_id': 'req-99a8a88b-1f2e-429e-b586-a0064679a8cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.982547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] The token cache is being invalidate because project 188b18d111ad429387d64424998c4b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:22.982827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.985087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:22.990784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1120/2224] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:22 2021] DELETE /identity/v3/projects/188b18d111ad429387d64424998c4b8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:22.990784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:22.993434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.012151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25352644a7504d6eae86e0e9cf801385', 'request_id': 'req-625b9017-b1c8-4065-9d3c-003390fdb303'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.025809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25352644a7504d6eae86e0e9cf801385', 'request_id': 'req-625b9017-b1c8-4065-9d3c-003390fdb303'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.049176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25352644a7504d6eae86e0e9cf801385', 'request_id': 'req-625b9017-b1c8-4065-9d3c-003390fdb303'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.072770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] The token cache is being invalidate because project 25352644a7504d6eae86e0e9cf801385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:23.076366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.077773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.082791 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1105/2225] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:22 2021] DELETE /identity/v3/projects/25352644a7504d6eae86e0e9cf801385 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:23.084509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:23.087984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.107591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8a88b-1f2e-429e-b586-a0064679a8cf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:23.186453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9017-b1c8-4065-9d3c-003390fdb303 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:23.198853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:23.200350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.200763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.201132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] PATH_INFO: `/v3/users/c8eed1b693344251aa3b0cd5202059b4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.202113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:23.202605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8eed1b693344251aa3b0cd5202059b4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:23.202773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.203054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.203332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.204073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:23.205688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff9003-6d04-439a-85bb-42e1b17f40d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:23.206246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:23.221135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1121/2226] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:22 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:23.222586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.222873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.223146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.245655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:23.247108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.260772 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1122/2227] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:23.263089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:23.264749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.273825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8eed1b693344251aa3b0cd5202059b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.297992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8eed1b693344251aa3b0cd5202059b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.298371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8eed1b693344251aa3b0cd5202059b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.322825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8eed1b693344251aa3b0cd5202059b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.343779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8eed1b693344251aa3b0cd5202059b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.356880 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1106/2228] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:23 2021] DELETE /identity/v3/users/c8eed1b693344251aa3b0cd5202059b4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:23.357636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:23.360296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.378639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46662e1d-a2a4-47cb-b4cb-f3986f6abd75 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:23.481421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055a5c-620e-4a93-a952-d47d04d21683 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:23.494933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:23.497678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.498274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.498854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] PATH_INFO: `/v3/projects/dde769db6fd2473cb5bb1cf38ac03d27/users/366eaed3c5b94e518097270ef20f962f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.534925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:23.535750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.536172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.537618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.539617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.546349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde769db6fd2473cb5bb1cf38ac03d27, user_id=366eaed3c5b94e518097270ef20f962f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:23.555377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1cc8d-4f53-4373-9769-de33db7952dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:23.581475 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1107/2229] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:23 2021] PUT /identity/v3/projects/dde769db6fd2473cb5bb1cf38ac03d27/users/366eaed3c5b94e518097270ef20f962f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:23.582822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.583114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.583392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.604316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:23.606411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.719287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:23.719794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1108/2230] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:23.720861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:23.722311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.723341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b2454-a0c7-4691-be7b-328442228b71 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:23.736320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd2e42-0820-48c6-9bcf-e4cfddcf47c0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:23.751079 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1123/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:23 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:23.753253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:23.754527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.754869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea16e-3ca8-462f-85c9-8a8b67827451 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.756158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea16e-3ca8-462f-85c9-8a8b67827451 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.756525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea16e-3ca8-462f-85c9-8a8b67827451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.758676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.759489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] PATH_INFO: `/v3/projects/db74d325faac4b739c7dffedabc3939f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.762607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db74d325faac4b739c7dffedabc3939f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:23.765554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:23.834525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-12cea16e-3ca8-462f-85c9-8a8b67827451 None None] MFA Rules not processed for user `366eaed3c5b94e518097270ef20f962f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:23.835223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12cea16e-3ca8-462f-85c9-8a8b67827451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.850051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db74d325faac4b739c7dffedabc3939f', 'request_id': 'req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.856631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db74d325faac4b739c7dffedabc3939f', 'request_id': 'req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.865132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db74d325faac4b739c7dffedabc3939f', 'request_id': 'req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.882991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] The token cache is being invalidate because project db74d325faac4b739c7dffedabc3939f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:23.883284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.883947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:23.889297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1109/2232] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:23 2021] DELETE /identity/v3/projects/db74d325faac4b739c7dffedabc3939f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:23.889297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:23.894465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:23.950371 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1124/2233] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:23 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:23.951972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bfc6f-5150-4768-b048-fea0f21e73d1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:23.952240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bfc6f-5150-4768-b048-fea0f21e73d1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:23.952540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bfc6f-5150-4768-b048-fea0f21e73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:23.980739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f04bfc6f-5150-4768-b048-fea0f21e73d1 None None] MFA Rules not processed for user `9c69cc6d1fa34f34a67a711ceac91423`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:23.981975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f04bfc6f-5150-4768-b048-fea0f21e73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.008088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74cb88-10a4-4ca7-b8c5-0216e7c9325a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.015017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.015671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.015947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.016223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.016985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:24.017285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.018846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.042297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1110/2234] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:24.042297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.044126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.054210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1125/2235] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:23 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:24.055727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.056006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.056280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.067280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7425fe-3bc4-458e-8a97-9b4136d087bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.076856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.077904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.078187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.078458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] PATH_INFO: `/v3/projects/dadddf339fba4a7492af33ba344122da` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.079668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadddf339fba4a7492af33ba344122da)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.081777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.090859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:24.092306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.101155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1126/2236] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:24.102141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.103433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.119440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba5d0-08eb-4d3a-bf68-158cb3da75e2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.126400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.127060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.127335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.127603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.128541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.130956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.163003 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1127/2237] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/projects => generated 411 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.163839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.173340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadddf339fba4a7492af33ba344122da', 'request_id': 'req-5a891128-0f28-49ab-ba73-0858493e275a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:24.181432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadddf339fba4a7492af33ba344122da', 'request_id': 'req-5a891128-0f28-49ab-ba73-0858493e275a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:24.188828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadddf339fba4a7492af33ba344122da', 'request_id': 'req-5a891128-0f28-49ab-ba73-0858493e275a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:24.208196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] The token cache is being invalidate because project dadddf339fba4a7492af33ba344122da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:24.209029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:24.210657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5a891128-0f28-49ab-ba73-0858493e275a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:24.212537 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1111/2238] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:24 2021] DELETE /identity/v3/projects/dadddf339fba4a7492af33ba344122da => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:24.218554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454439d3-5085-41d5-9df1-bc6d4de60142 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.218554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454439d3-5085-41d5-9df1-bc6d4de60142 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.218554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454439d3-5085-41d5-9df1-bc6d4de60142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.237599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-454439d3-5085-41d5-9df1-bc6d4de60142 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:24.238892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-454439d3-5085-41d5-9df1-bc6d4de60142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.257762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902de8e-be78-4cab-80b5-1e725dc59c9a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.262524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.263177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.263459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.263732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.264443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.266511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.300831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1128/2239] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.301296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.303233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.325556 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1112/2240] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:24.328958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.328958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.328958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.347291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:24.348499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.390699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506929-f1f7-448f-912c-acb9b901aa0f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.396260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.397474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.397474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.397474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.398572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.400626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.423746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1129/2241] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/users => generated 312 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.424590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.426491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.427817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1113/2242] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:24.435858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.445613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d0765-a789-4a5f-86f6-44e2887a4212 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.449200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3829-faf5-48f5-a712-1d209c9b9e38 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.453380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.454057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.454343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.455018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.456380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.457875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.458312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149852-871a-4935-806d-c36bb1d7b2f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.460134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.460894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.461201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.462271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:24.462572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.465463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.486206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1114/2243] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:24.488678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1130/2244] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.489012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.490333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.490614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.490881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.507866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e259146-c5d8-4471-9538-98c40f3825eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.514971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:24.516294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:24.521493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.522457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.522971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.523521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.525161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.526762 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1131/2245] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:24.528026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.528639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.541633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e23bb-dbbd-477b-bb3b-a53f60add61e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.545342 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1115/2246] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:24.546304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.557822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756c90-7850-4492-b0ef-097ebbbb635f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.559136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.559846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.560116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.560384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.561136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.563006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.563392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.563595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.564007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.564290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.565064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.566700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.579102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1116/2247] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:24.580063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.594277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c2b40-b513-4b7e-b90b-1b3ad781414d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.600413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.601308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.601573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.601845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.602875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:24.603187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.604856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.611631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1132/2248] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.611631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.619619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1117/2249] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:24.620849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.644636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e4da-7789-4421-9236-99606bbb89d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.714141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22df6-7e1a-4acf-8f0b-38c6dfbd31d0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.719648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.720630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.721052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.721329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] PATH_INFO: `/v3/projects/966abd61b81742a89913fbedee198fda/users/8ab8dd8d908f491489c71a616ed41178/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.738615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.738946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966abd61b81742a89913fbedee198fda, user_id=8ab8dd8d908f491489c71a616ed41178, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.739472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.739818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.740272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.741121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.741652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.743741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.766566 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1118/2250] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:24.767476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.772415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1133/2251] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:24 2021] PUT /identity/v3/projects/966abd61b81742a89913fbedee198fda/users/8ab8dd8d908f491489c71a616ed41178/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:24.773479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.779234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae9230-f17a-49d3-a933-6bbb6c485612 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.852655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.853458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.853799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.854143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.854902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.857162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.862844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467cc8-43ca-4e70-bfca-8e7f96012265 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.873315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.874064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.874271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.874533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.876278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.878040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.882455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1119/2252] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.883646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.895321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404766-5c4a-49ac-a412-b22f2d3d70c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:24.906650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:24.908043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:24.908768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:24.910816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] PATH_INFO: `/v3/projects/713c83429d0a4a8ea5f27d8bdb3d6fb3/users/6ed119fb33ae428d93ae9a26f324a2e9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:24.919817 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1134/2253] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:24 2021] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:24.920926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:24.936251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] RBAC: Authorizing `identity:create_grant(project_id=713c83429d0a4a8ea5f27d8bdb3d6fb3, user_id=6ed119fb33ae428d93ae9a26f324a2e9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:24.939739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:24.958241 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1120/2254] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:24 2021] PUT /identity/v3/projects/713c83429d0a4a8ea5f27d8bdb3d6fb3/users/6ed119fb33ae428d93ae9a26f324a2e9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:24.959100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.019124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ba51b-bd4d-422d-8daf-d5ddf61b7168 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.075696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ba28-0c30-448c-8d21-3cd354dd022a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.084286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.085400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.086201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.086483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.087369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.090750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.108769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.109198 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1121/2255] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:25.109451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.109736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.110014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.110767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.110957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.112361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4304d3-bcf2-454c-a309-ef121404bba3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.137864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef86aba-c836-4099-afa6-5d50708cc3db admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.157511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1135/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:25.160502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.165708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.166440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.166766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.167439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.168767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.170678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.173852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.174667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.205335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1122/2257] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:25 2021] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:25.206737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.217964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbfac6-7471-4305-98b2-0a14eb04f53b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.230950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.231636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.231915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.232190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.232972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.234963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.236345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] MFA Rules not processed for user `6ed119fb33ae428d93ae9a26f324a2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:25.237605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:25.247092 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1123/2258] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:25.247894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.267667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314485-6800-4916-ba37-3ada07219330 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.273765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.274703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.274980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.275255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] PATH_INFO: `/v3/projects/966abd61b81742a89913fbedee198fda/users/8ab8dd8d908f491489c71a616ed41178/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.277610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=966abd61b81742a89913fbedee198fda, user_id=8ab8dd8d908f491489c71a616ed41178, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.283097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.306285 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1124/2259] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:25 2021] PUT /identity/v3/projects/966abd61b81742a89913fbedee198fda/users/8ab8dd8d908f491489c71a616ed41178/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:25.307660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.362023 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1136/2260] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:25.363011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.378318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526e8c4-a8a2-4479-a201-1f9f188cc3e9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.417312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e418c8-66da-4b93-b2c1-263364bb6d7d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.423694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.424712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.425189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.425652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.426638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.428769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdd199-da43-483c-9fe8-183555f5f6da admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.448735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1125/2261] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:25.448735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.448735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.448735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.490632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.491513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.491788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.492064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] PATH_INFO: `/v3/projects/ac80ffcbb1704a21843e48a3b0261997/users/46d894b0981a43508b322143717175e4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.493563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] MFA Rules not processed for user `8ab8dd8d908f491489c71a616ed41178`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:25.495270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:25.527758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac80ffcbb1704a21843e48a3b0261997, user_id=46d894b0981a43508b322143717175e4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.536309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.588701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1137/2262] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:25 2021] PUT /identity/v3/projects/ac80ffcbb1704a21843e48a3b0261997/users/46d894b0981a43508b322143717175e4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:25.590003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.660730 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1126/2263] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:25 2021] POST /identity/v3/auth/tokens => generated 3345 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:25.665130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.727561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab882b8-c173-4c3a-83f3-eb46f6d5427d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.763845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.765639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.772411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ea1e0-468c-4bf2-a5e7-1f04b76ce775 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:25.776120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.776287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.784453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:25.785857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.790511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f71cd-2a0b-4f5b-87cb-56b1b74811c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.796460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.797279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.799414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.801005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:25.806682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:25.826899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1127/2264] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:25.831550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:25.832059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:25.832694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:25.915435 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1138/2265] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:25 2021] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:25.915435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:25.918909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:25.926847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] MFA Rules not processed for user `46d894b0981a43508b322143717175e4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:25.928965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:26.071602 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1128/2266] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:25 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:26.073458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.136248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623e5b-d5ae-44f2-be41-586e1c072c0f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.151296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.153616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.154151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.154440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.249353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73bbf1-9eea-4bbf-918e-5191d258a907 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.272703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.273681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.274175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.276097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] PATH_INFO: `/v3/projects/ea64fdb2282844728c33886df39a303b/users/2e9fa45517c0412c82e0f85634858963/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.298089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.301418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.310197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64fdb2282844728c33886df39a303b, user_id=2e9fa45517c0412c82e0f85634858963, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.318987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.322876 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1139/2267] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:25 2021] GET /identity/v3/auth/tokens => generated 3345 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:26.324765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.344791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd57c1-5174-4c68-83a5-1ebafbfe618f service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.345152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1129/2268] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:26 2021] PUT /identity/v3/projects/ea64fdb2282844728c33886df39a303b/users/2e9fa45517c0412c82e0f85634858963/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:26.347007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.350944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:26.447748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.449660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.449952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.450220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.450918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.453973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0152-516e-4d53-a261-394252eed272 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.501533 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1140/2269] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:26 2021] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:26.504442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.504752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.505019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.515749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7bea5-5950-4e63-8fd3-5ea7bab67122 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.528990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.529571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.529830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.530189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.550741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:26.550741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:26.582780 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1141/2270] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:26.590474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.609560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e37520-f604-47d3-92b2-c9282b8e485e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.615563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.616242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.616519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.616847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.617856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.619670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.637358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1142/2271] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:26.637800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.638282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.639646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.640411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:26.661899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1130/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:26 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:26.664016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.680042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb39d2-4571-4354-a5c7-053267605c84 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.692779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.693446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.693978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.694257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.698216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:26.724974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a442b-4564-4d7d-9d34-629bdbb0f9aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.729956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.731992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.732726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.733348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.747193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.749476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.775132 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1143/2273] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:26.779134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.805453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13737-7e40-44cb-a83f-663067d03548 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.816380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:26.818134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:26.820084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:26.821135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] PATH_INFO: `/v3/projects/5ed607955bec42f883bc2303b95e714a/users/0e9b12bcc02846da9b60e7837c64240d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:26.853843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.859770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.865119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed607955bec42f883bc2303b95e714a, user_id=0e9b12bcc02846da9b60e7837c64240d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:26.874676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:26.903989 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1131/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:26 2021] GET /identity/v3/auth/tokens => generated 3278 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:26.915675 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1144/2275] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:26 2021] PUT /identity/v3/projects/5ed607955bec42f883bc2303b95e714a/users/0e9b12bcc02846da9b60e7837c64240d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:26.917411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:26.936924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744da8f0-f89c-49d6-ab84-b5457ba8b689 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:26.976180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:27.057486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:27.062582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.062936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.063364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.064078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:27.067657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:27.097242 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1132/2276] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:27.112816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:27.151159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f3b9d-01bc-4003-8faf-0af95952f7b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:27.152789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee5ae-5a5d-4b41-ad82-90adba118720 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:27.156303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:27.157231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.158832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.159112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] PATH_INFO: `/v3/users/366eaed3c5b94e518097270ef20f962f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.161021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] RBAC: Authorizing `identity:delete_user(user_id=366eaed3c5b94e518097270ef20f962f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:27.163454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:27.170835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:27.171984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.172416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.172875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] PATH_INFO: `/v3/projects/5ed607955bec42f883bc2303b95e714a/users/0e9b12bcc02846da9b60e7837c64240d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.181681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed607955bec42f883bc2303b95e714a, user_id=0e9b12bcc02846da9b60e7837c64240d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:27.189425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc1e84-83d1-4a04-9926-b77410257302 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:27.216696 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1133/2277] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:27 2021] PUT /identity/v3/projects/5ed607955bec42f883bc2303b95e714a/users/0e9b12bcc02846da9b60e7837c64240d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:27.228728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.230238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.230238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.249221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366eaed3c5b94e518097270ef20f962f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:27.268832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366eaed3c5b94e518097270ef20f962f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:27.272093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366eaed3c5b94e518097270ef20f962f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:27.273654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366eaed3c5b94e518097270ef20f962f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:27.290709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57ba779c-c978-4914-8227-972368fc563a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366eaed3c5b94e518097270ef20f962f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:27.309195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] MFA Rules not processed for user `0e9b12bcc02846da9b60e7837c64240d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:27.313072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:27.332172 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1145/2278] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:26 2021] DELETE /identity/v3/users/366eaed3c5b94e518097270ef20f962f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:27.337573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.339019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.340009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.374590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:27.376488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:27.484139 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1134/2279] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:27 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:27.495525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1146/2280] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:27.499761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:27.501810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:27.555854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:27.557483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:27.670510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510da120-67de-4124-8daa-0246e6f9f0fb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:27.742813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23d7db-57ba-4c0b-b2f8-4659b5cc4118 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:27.753401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:27.755094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.755094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.755094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.772439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:27.774069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:27.818822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1147/2281] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:27.859188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:27.860910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:27.872061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:27.872061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:27.994946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:27.997689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839c29-329e-4e33-a57c-f188d5a1fb0a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:28.023892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1135/2282] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:27 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:28.072545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:28.094598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06bf6e-8eb3-4c1f-b6eb-9f2c6107522f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:28.110500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:28.112427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.113400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.115155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:28.121870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:28.188023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.188560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.189180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:28.262880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] MFA Rules not processed for user `2e9fa45517c0412c82e0f85634858963`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:28.264478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:28.313780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:28.317272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:28.335226 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1148/2283] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:28 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:28.410879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1136/2284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:28 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:28.412932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:28.414815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:28.442534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74d5f-712c-45d0-b9c9-eb140ef35c7b service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:28.458112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:28.458907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.459290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.459668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:28.461162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:28.466359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:28.563424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1149/2285] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:28 2021] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:28.568011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:28.601225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc05599-ac8b-47b3-9545-c6c915903488 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:28.739873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:28.741457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.742113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.743490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:28.745761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:28.752168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:28.793187 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1137/2286] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:28 2021] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:28.797017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:28.829306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc88b-814b-44bf-ba56-682904a41e33 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:28.848443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:28.851548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.851830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.855509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:28.857474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:28.859695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:28.907608 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1150/2287] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:28.909572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:28.941287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66874-b8b7-4568-be54-9d8c44af0724 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:28.957774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:28.959319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:28.961055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:28.962076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] PATH_INFO: `/v3/projects/f69075c08b63492db02e7433b0ba0ad0/users/a0fdcec722be4e3ea8206973268525e5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.005944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69075c08b63492db02e7433b0ba0ad0, user_id=a0fdcec722be4e3ea8206973268525e5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:29.010632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:29.047009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1138/2288] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:28 2021] PUT /identity/v3/projects/f69075c08b63492db02e7433b0ba0ad0/users/a0fdcec722be4e3ea8206973268525e5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:29.048399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:29.062911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0db8a-33d4-4429-a535-e2a4f3c9492c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:29.247651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:29.251601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:29.252066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:29.254134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.255051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:29.266922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:29.303367 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1151/2289] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:29.307708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:29.323279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03ec2-af1e-4f2c-8e93-419db75bdb67 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:29.341450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:29.346488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:29.347274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:29.350350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] PATH_INFO: `/v3/projects/f69075c08b63492db02e7433b0ba0ad0/users/a0fdcec722be4e3ea8206973268525e5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.355922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69075c08b63492db02e7433b0ba0ad0, user_id=a0fdcec722be4e3ea8206973268525e5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:29.367998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:29.396326 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1139/2290] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:29 2021] PUT /identity/v3/projects/f69075c08b63492db02e7433b0ba0ad0/users/a0fdcec722be4e3ea8206973268525e5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:29.471626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:29.473566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:29.504000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755ade-0f16-407f-a9c9-aab5c6c0ce1e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:29.666943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:29.667488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:29.667488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:29.667646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] PATH_INFO: `/v3/projects/dde769db6fd2473cb5bb1cf38ac03d27` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.672773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde769db6fd2473cb5bb1cf38ac03d27)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:29.674664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:29.690905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:29.692823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:29.710480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149d56-8984-4a9b-a099-673ddc452b94 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:29.721109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:29.724253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:29.725002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:29.725557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] PATH_INFO: `/v3/users/6ed119fb33ae428d93ae9a26f324a2e9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.728640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed119fb33ae428d93ae9a26f324a2e9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:29.734560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:29.811896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde769db6fd2473cb5bb1cf38ac03d27', 'request_id': 'req-176d2efc-9e3e-49c0-8848-53053c688ed3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.854268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde769db6fd2473cb5bb1cf38ac03d27', 'request_id': 'req-176d2efc-9e3e-49c0-8848-53053c688ed3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.856773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed119fb33ae428d93ae9a26f324a2e9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.873187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde769db6fd2473cb5bb1cf38ac03d27', 'request_id': 'req-176d2efc-9e3e-49c0-8848-53053c688ed3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.877196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed119fb33ae428d93ae9a26f324a2e9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.878064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed119fb33ae428d93ae9a26f324a2e9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.909595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] The token cache is being invalidate because project dde769db6fd2473cb5bb1cf38ac03d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:29.910188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.910978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.917060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed119fb33ae428d93ae9a26f324a2e9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.917767 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1152/2291] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:29 2021] DELETE /identity/v3/projects/dde769db6fd2473cb5bb1cf38ac03d27 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:29.919730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:29.923478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:29.930003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22aa863e-915c-4d2c-8e72-74c0e05af635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed119fb33ae428d93ae9a26f324a2e9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:29.946316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1140/2292] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:29 2021] DELETE /identity/v3/users/6ed119fb33ae428d93ae9a26f324a2e9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:29.951786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:29.952161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:29.952697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:29.981185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:29.983389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:30.102947 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1141/2293] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:30.171907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:30.173407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:30.197803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d2efc-9e3e-49c0-8848-53053c688ed3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:30.214447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:30.214836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:30.215100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:30.215380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] PATH_INFO: `/v3/users/8ab8dd8d908f491489c71a616ed41178` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:30.219306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab8dd8d908f491489c71a616ed41178)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:30.223665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:30.321512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fea14-a88a-414f-b1af-bb48efda4d11 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:30.330113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:30.330701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:30.330983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:30.331258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:30.349486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab8dd8d908f491489c71a616ed41178'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:30.360467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:30.363118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:30.369437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab8dd8d908f491489c71a616ed41178'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:30.371929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab8dd8d908f491489c71a616ed41178'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:30.372741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab8dd8d908f491489c71a616ed41178'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:30.385110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d868495-4b5f-4978-bfe9-3b6e770a0980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab8dd8d908f491489c71a616ed41178'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:30.386642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1142/2294] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:30.412040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1153/2295] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:29 2021] DELETE /identity/v3/users/8ab8dd8d908f491489c71a616ed41178 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:30.959951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:30.963781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:30.984907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615c1a-1aa8-41dc-88cf-993a6e898e10 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:30.987204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:30.987669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:30.987761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.046347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] MFA Rules not processed for user `a0fdcec722be4e3ea8206973268525e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:31.047602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.122913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.124376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.125530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.126043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] PATH_INFO: `/v3/users/46d894b0981a43508b322143717175e4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.128204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d894b0981a43508b322143717175e4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:31.149447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:31.231632 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1154/2296] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:30 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:31.232704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:31.236315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.266735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ec8b3-9a63-4a62-8de2-6988b270ecf2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:31.276906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.278035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.278321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.278594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] PATH_INFO: `/v3/projects/966abd61b81742a89913fbedee198fda` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.281101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966abd61b81742a89913fbedee198fda)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:31.284404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:31.288450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d894b0981a43508b322143717175e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.297932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d894b0981a43508b322143717175e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.298806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d894b0981a43508b322143717175e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.322134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d894b0981a43508b322143717175e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.337575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d894b0981a43508b322143717175e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.344277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1143/2297] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:30 2021] DELETE /identity/v3/users/46d894b0981a43508b322143717175e4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:31.345414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:31.347992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.355992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966abd61b81742a89913fbedee198fda', 'request_id': 'req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.361723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966abd61b81742a89913fbedee198fda', 'request_id': 'req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.369412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966abd61b81742a89913fbedee198fda', 'request_id': 'req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.388838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] The token cache is being invalidate because project 966abd61b81742a89913fbedee198fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:31.389175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.390584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7fada8fa-c2c1-463b-8ecc-f6e246010cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.392161 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1155/2298] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:31 2021] DELETE /identity/v3/projects/966abd61b81742a89913fbedee198fda => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:31.397763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd4a6-c688-48d5-b887-33c623482815 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.398039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd4a6-c688-48d5-b887-33c623482815 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.399133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd4a6-c688-48d5-b887-33c623482815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.415968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-491cd4a6-c688-48d5-b887-33c623482815 None None] MFA Rules not processed for user `25402f2151994aaa812407c629812b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:31.417123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-491cd4a6-c688-48d5-b887-33c623482815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.433914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d61f-cd4b-41a6-9eb2-ce714d538c99 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:31.439286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.440440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.440861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.441238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] PATH_INFO: `/v3/projects/713c83429d0a4a8ea5f27d8bdb3d6fb3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.442547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713c83429d0a4a8ea5f27d8bdb3d6fb3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:31.444510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:31.499216 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1156/2299] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:31.503326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4137da-ab35-416f-8cdc-d4971e0c8ec8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.503691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4137da-ab35-416f-8cdc-d4971e0c8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.504041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4137da-ab35-416f-8cdc-d4971e0c8ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.521331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713c83429d0a4a8ea5f27d8bdb3d6fb3', 'request_id': 'req-9dfbaff5-a543-463e-91d8-06bf7e55f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.525000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7f4137da-ab35-416f-8cdc-d4971e0c8ec8 None None] MFA Rules not processed for user `2e9fa45517c0412c82e0f85634858963`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:31.526527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f4137da-ab35-416f-8cdc-d4971e0c8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.533785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713c83429d0a4a8ea5f27d8bdb3d6fb3', 'request_id': 'req-9dfbaff5-a543-463e-91d8-06bf7e55f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.550592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713c83429d0a4a8ea5f27d8bdb3d6fb3', 'request_id': 'req-9dfbaff5-a543-463e-91d8-06bf7e55f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.582038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] The token cache is being invalidate because project 713c83429d0a4a8ea5f27d8bdb3d6fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:31.582355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.583151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dfbaff5-a543-463e-91d8-06bf7e55f067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.587943 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1144/2300] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:31 2021] DELETE /identity/v3/projects/713c83429d0a4a8ea5f27d8bdb3d6fb3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:31.589389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.589714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.589987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.603224 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1157/2301] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:31.604886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.605952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.606441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.614406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:31.615595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.629975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:31.633336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.693058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1145/2302] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:31.693850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:31.695278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.708293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b886-ac2b-40a1-91bd-908f136a43e6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:31.713965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.714874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.715145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.715412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] PATH_INFO: `/v3/users/0e9b12bcc02846da9b60e7837c64240d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.716653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9b12bcc02846da9b60e7837c64240d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:31.718632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:31.732993 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1158/2303] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:31.732993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:31.732993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.796049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9b12bcc02846da9b60e7837c64240d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.816532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9b12bcc02846da9b60e7837c64240d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.817587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9b12bcc02846da9b60e7837c64240d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.831461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9b12bcc02846da9b60e7837c64240d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.841518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9b12bcc02846da9b60e7837c64240d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:31.851591 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1146/2304] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:31 2021] DELETE /identity/v3/users/0e9b12bcc02846da9b60e7837c64240d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:31.852355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:31.854016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.856287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa22b-4174-4284-bfd5-c4867e1d29e3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:31.927872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e99b-f296-4216-8afc-ce946b36b637 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:31.932769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.934052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.934334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.934701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.937105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:31.943908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:31.945139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:31.946350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:31.946633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:31.949703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:32.025304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.026779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b352ee1-9cb2-41f6-8250-6ea00f669ac5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.039885 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1147/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:32.041850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.041850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.042063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.042247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.044791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.055489 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1159/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:32.062457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:32.063661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:32.076025 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1148/2307] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:32.080586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.093756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc36f-5652-420a-9dae-ac73b387cb66 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.098657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.099429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.099776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.100055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.101014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:32.101321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.102912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.150128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.162458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1160/2308] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:32.164040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f2ebd-99ee-4a74-80e8-28e8fb481e6d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.170369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.171088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.171372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.171812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.172509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.175039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.216871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.224258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1149/2309] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:32 2021] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:32.229038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d15e9-12f0-4ba7-b94b-2828e10b0c60 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.360112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.360997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.361379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.361661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.362533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.364443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.418223 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1161/2310] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:32 2021] POST /identity/v3/users => generated 305 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:32.419809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.462822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a1540-fb12-476a-8c1d-873edd6e123b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.498424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.499128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.499414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.499687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.504750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.513431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.543330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1150/2311] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:32.544563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.562808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab73b3-94ed-4672-a19b-d46366619979 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.578300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.579065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.579416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.579761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.580669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.583726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff314c9-f89b-4f5c-b568-b23ea22406d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.618448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.625818 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1162/2312] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:32.643479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9fbaa-bd03-4b07-9515-aa59b8cf030f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:32.650061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:32.651028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.651307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.651584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] PATH_INFO: `/v3/projects/253cf0bf6d054346a021a110a64528ac/users/012bfe35c03d4079988a00de4c563cc1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.671974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=253cf0bf6d054346a021a110a64528ac, user_id=012bfe35c03d4079988a00de4c563cc1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:32.675657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:32.705003 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1151/2313] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:32 2021] PUT /identity/v3/projects/253cf0bf6d054346a021a110a64528ac/users/012bfe35c03d4079988a00de4c563cc1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:32.718411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:32.718877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:32.719349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:32.760376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] MFA Rules not processed for user `012bfe35c03d4079988a00de4c563cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:32.761980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:32.861245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:32.863209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:32.952351 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1163/2314] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:32 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:32.953349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.036384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e91d20-9e5e-43bf-80fd-2145bad6dc8f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.041513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122d0a-5aa1-4fb7-80d3-aacb91a70a37 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.051577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.052810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.053268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.053811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] PATH_INFO: `/v3/projects/5ed607955bec42f883bc2303b95e714a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.054502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.055249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.055757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.056136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.056418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed607955bec42f883bc2303b95e714a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.057550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.060167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.061873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.117546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1164/2315] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:32 2021] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:33.118711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.154625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed607955bec42f883bc2303b95e714a', 'request_id': 'req-07365634-9aae-4292-a9fb-6907fdfe4408'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.167464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed607955bec42f883bc2303b95e714a', 'request_id': 'req-07365634-9aae-4292-a9fb-6907fdfe4408'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.175752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed607955bec42f883bc2303b95e714a', 'request_id': 'req-07365634-9aae-4292-a9fb-6907fdfe4408'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.198521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] The token cache is being invalidate because project 5ed607955bec42f883bc2303b95e714a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:33.199752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.200582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.206955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1152/2316] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:32 2021] DELETE /identity/v3/projects/5ed607955bec42f883bc2303b95e714a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:33.208435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.210089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.224307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd24d8-885e-431f-9061-24f5d8c008c9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.371908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365634-9aae-4292-a9fb-6907fdfe4408 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.377517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.378664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.379110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.379227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.379660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] PATH_INFO: `/v3/projects/ac80ffcbb1704a21843e48a3b0261997` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.381125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac80ffcbb1704a21843e48a3b0261997)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.381861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.382965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.383315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.384258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.385171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.390800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591fb1-1346-42d1-a3d5-b04f618f3e19 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.464261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1165/2317] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:33 2021] POST /identity/v3/users => generated 310 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:33.464261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00766-a4a2-4e6e-8020-fd479125f4cb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.464261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00766-a4a2-4e6e-8020-fd479125f4cb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.464261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00766-a4a2-4e6e-8020-fd479125f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.488265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-32b00766-a4a2-4e6e-8020-fd479125f4cb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:33.489656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-32b00766-a4a2-4e6e-8020-fd479125f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.495355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac80ffcbb1704a21843e48a3b0261997', 'request_id': 'req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.508096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac80ffcbb1704a21843e48a3b0261997', 'request_id': 'req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.523660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac80ffcbb1704a21843e48a3b0261997', 'request_id': 'req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.555870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] The token cache is being invalidate because project ac80ffcbb1704a21843e48a3b0261997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:33.556208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.557256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:33.561232 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1153/2318] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:33 2021] DELETE /identity/v3/projects/ac80ffcbb1704a21843e48a3b0261997 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:33.562198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.564567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.625047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1166/2319] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:33.626847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.627209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.627554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.656019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aefdb1-c30a-47e5-9daa-79db33ece5d2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.660941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.661758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.662035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.662304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.673041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.673041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d0100-48f7-4264-9c11-8b1d426d9e65 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.676664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:33.676664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.694910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1154/2320] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:33 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:33.696065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1167/2321] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:33.697826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519626-773c-4294-97b2-5e7d8bc468b9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.698122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519626-773c-4294-97b2-5e7d8bc468b9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.698382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519626-773c-4294-97b2-5e7d8bc468b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.704929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.725275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c89d-d75e-43fc-861f-2856fdcad894 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.732101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:33.734146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.734633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.735106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] PATH_INFO: `/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6/users/51876b8c857f47ffa2e9ace9e9526382/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.736423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f519626-773c-4294-97b2-5e7d8bc468b9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:33.740021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f519626-773c-4294-97b2-5e7d8bc468b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.753455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1155/2322] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:33.756942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:33.756942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:33.756942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:33.783982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279d43b760e4c66aed95bd0b0aff9f6, user_id=51876b8c857f47ffa2e9ace9e9526382, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:33.786934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:33.789310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:33.793258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:33.809401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1156/2323] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:33.810952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.818689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1168/2324] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:33 2021] PUT /identity/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6/users/51876b8c857f47ffa2e9ace9e9526382/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:33.821949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:33.831333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90238922-089d-43e7-bcfa-e2226d4eed95 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:33.985017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2832-4d7d-4238-a188-00f104dda07b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.013458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.014450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.014930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.015159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.016063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:34.016526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.030591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.039004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.039839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.040220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.040590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.052935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:34.053459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.056412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.084585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1169/2325] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:34.086117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.090786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1157/2326] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:34.091805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.122389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd218f-7fab-4cdd-93bc-9c87c5711913 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.126699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7de9-4a68-4160-8766-86130423c977 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.130998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.131927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.132304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.134175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.138963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.156776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.157537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.157823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.158099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.158865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.161169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.173526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.191123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1170/2327] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:34.192196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.233736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedb82-4e3d-4de4-ae10-bc911c1c1549 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.264514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.265277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.266468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.266816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.267666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.271510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.290190 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1158/2328] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:34 2021] POST /identity/v3/projects => generated 395 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:34.291081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.345457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1171/2329] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:34 2021] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:34.346397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.447635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c709ea-bbb9-4286-b0be-f8f6575b9b92 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.521598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7589f-5ab7-42bb-9373-512c3b16e648 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.540509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.541373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.541905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.542185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.544325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.553431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.642922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1172/2330] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:34 2021] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:34.646754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.647580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.648504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.648836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.649123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] PATH_INFO: `/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6/users/51876b8c857f47ffa2e9ace9e9526382/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.653322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279d43b760e4c66aed95bd0b0aff9f6, user_id=51876b8c857f47ffa2e9ace9e9526382, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.656433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.688214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5c8d-2f23-429a-9215-d3f1735c5212 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.711814 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1159/2331] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:34 2021] PUT /identity/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6/users/51876b8c857f47ffa2e9ace9e9526382/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:34.713857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.854415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.855685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.856150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.856431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.857172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.862250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9ff86-594d-4d52-93a7-69f0cb147045 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.874038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f518d-3d69-408f-9d9f-c86ec5dacb7e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.885005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.885817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.886127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.886614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.887844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.891587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.900430 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1173/2332] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:34 2021] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:34.904802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.905087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.905357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.921584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1160/2333] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:34.925059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:34.949687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd6f3-945f-425b-be23-e34c63a0f72f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:34.957409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] MFA Rules not processed for user `51876b8c857f47ffa2e9ace9e9526382`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:34.959074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:34.962002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:34.962883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:34.963245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:34.963621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:34.964975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:34.966672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:34.989781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1161/2334] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:34.990728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.002589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace769-f0e4-4bb0-81be-270236d807c8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.008262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.009515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.009809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.010085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.010826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.013807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.038835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1162/2335] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:35.039915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.045833 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1174/2336] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:34 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:35.046733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.068835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c268ef-b3e8-4714-87c4-a2640bf600e8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.069097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64685375-60e4-4e2f-9dca-56fe057e9f3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.079482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.082862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.083938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.084319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] PATH_INFO: `/v3/projects/9c66781dda204d2180daaa0328cb5060/users/09504ad938ba47d8a9efa7216a409237/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.084448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.085034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.085310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.085583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.086467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.088047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.117383 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1163/2337] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:35 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:35.118657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.128846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed1f6-21ab-468b-86d6-04443e5aa11d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.131969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c66781dda204d2180daaa0328cb5060, user_id=09504ad938ba47d8a9efa7216a409237, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.134764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.135620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.136062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.136740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.137199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] PATH_INFO: `/v3/users/012bfe35c03d4079988a00de4c563cc1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.138701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012bfe35c03d4079988a00de4c563cc1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.140838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.174739 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1175/2338] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:35 2021] PUT /identity/v3/projects/9c66781dda204d2180daaa0328cb5060/users/09504ad938ba47d8a9efa7216a409237/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:35.175921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.213105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012bfe35c03d4079988a00de4c563cc1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:35.222267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012bfe35c03d4079988a00de4c563cc1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:35.223062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012bfe35c03d4079988a00de4c563cc1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:35.237663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012bfe35c03d4079988a00de4c563cc1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:35.248438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab2571c7-7bcb-493a-b852-3454de9ba899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012bfe35c03d4079988a00de4c563cc1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:35.259542 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1164/2339] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:35 2021] DELETE /identity/v3/users/012bfe35c03d4079988a00de4c563cc1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:35.259542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8902-b427-4188-8a7e-6f300c687ff0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.259542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8902-b427-4188-8a7e-6f300c687ff0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.259973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8902-b427-4188-8a7e-6f300c687ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.302862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04e17-064e-4f27-a7e8-c3a8eaff20cb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.309827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-94fe8902-b427-4188-8a7e-6f300c687ff0 None None] MFA Rules not processed for user `09504ad938ba47d8a9efa7216a409237`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:35.311523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94fe8902-b427-4188-8a7e-6f300c687ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.393198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.394206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.394932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.395416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] PATH_INFO: `/v3/projects/3eda26faa4ce4ae097d97eefd09cc4bb/users/dea4ca5955a04ce1944183f0b219b492/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.420863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eda26faa4ce4ae097d97eefd09cc4bb, user_id=dea4ca5955a04ce1944183f0b219b492, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.425071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563c7cb-5367-4af1-9184-7784c86292fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.444966 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1176/2340] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:35 2021] PUT /identity/v3/projects/3eda26faa4ce4ae097d97eefd09cc4bb/users/dea4ca5955a04ce1944183f0b219b492/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:35.447480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.447759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.448027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.472033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:35.472225 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1165/2341] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:35 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:35.473173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.473458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.475515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.479693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.549443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] MFA Rules not processed for user `dea4ca5955a04ce1944183f0b219b492`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:35.550792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.613826 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1177/2342] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:35.617517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.617517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.734125 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1166/2343] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:35.735622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.741043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.743744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88cf8d-06d0-4657-abe1-3882a82989fc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.750620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.751282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.752216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.752504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.875598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.877350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.891653 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1178/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:35 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:35.895281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828fb9-a24b-44c6-9505-a1bff677d04d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.907315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.909944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.910900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:35.911741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.912214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.915261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:35.940938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.944645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca53c-9cd7-4bdf-94ae-b2bbce956cd5 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:35.945279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.953758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:35.954642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:35.955072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:35.955493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:35.956355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:35.960100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d433f-3c73-44a0-9bfe-6f7eb4389fd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:35.977940 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1167/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:36.002577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1179/2346] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:35 2021] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:36.021829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.026349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.026633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.026951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.038317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49fe6-64e2-42f0-9752-e0efee1617c3 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.079411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] MFA Rules not processed for user `09504ad938ba47d8a9efa7216a409237`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:36.082092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:36.116160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.117051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.117426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.117908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.118728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.121740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.166353 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1168/2347] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:36 2021] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:36.171887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.195422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294ed8c-6fa2-4726-98dc-276ea0ff64d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.209955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.211978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.212463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.214063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.215432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.218622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.246891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1169/2348] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:36 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:36.246891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.268755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f5eb3-bf46-49e1-a769-d20078371270 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.276689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1180/2349] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:36 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:36.285062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.286308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.286832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.287246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] PATH_INFO: `/v3/projects/148f63b74f254c6a8b11028237839188/users/e8a18471cc0142f2b3e50b5080d3da79/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.333824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148f63b74f254c6a8b11028237839188, user_id=e8a18471cc0142f2b3e50b5080d3da79, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.337833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.367250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1170/2350] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:36 2021] PUT /identity/v3/projects/148f63b74f254c6a8b11028237839188/users/e8a18471cc0142f2b3e50b5080d3da79/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:36.372961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.389686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e433-ad47-4d93-84d9-8a59c577dbfc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.476865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.477803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.478180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.478586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.479513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.481996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f892bff-8e62-4af7-a0ac-2753b3f8da10 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.511063 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1181/2351] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:36 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:36.515334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.546536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81076-42f0-4e74-a210-cff8b3564939 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.565637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.566865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.567298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.567731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] PATH_INFO: `/v3/projects/148f63b74f254c6a8b11028237839188/users/e8a18471cc0142f2b3e50b5080d3da79/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.571446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148f63b74f254c6a8b11028237839188, user_id=e8a18471cc0142f2b3e50b5080d3da79, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.575275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.597578 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1171/2352] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:36 2021] PUT /identity/v3/projects/148f63b74f254c6a8b11028237839188/users/e8a18471cc0142f2b3e50b5080d3da79/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:36.608735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.609093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.609440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.618973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.625919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:36.681639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] MFA Rules not processed for user `e8a18471cc0142f2b3e50b5080d3da79`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:36.682884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:36.747638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d545d-b3d7-4fcf-b06f-b9ec12786313 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:36.757795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:36.759368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:36.759755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:36.760139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] PATH_INFO: `/v3/projects/253cf0bf6d054346a021a110a64528ac` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:36.761555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=253cf0bf6d054346a021a110a64528ac)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:36.764044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:36.800784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1182/2353] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:36 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:36.848391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253cf0bf6d054346a021a110a64528ac', 'request_id': 'req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:36.859289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253cf0bf6d054346a021a110a64528ac', 'request_id': 'req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:36.870295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253cf0bf6d054346a021a110a64528ac', 'request_id': 'req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:36.904545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] The token cache is being invalidate because project 253cf0bf6d054346a021a110a64528ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:36.905217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:36.906582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:36.926599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1172/2354] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:36 2021] DELETE /identity/v3/projects/253cf0bf6d054346a021a110a64528ac => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:36.930887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:36.942392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0776163-1c0c-4971-b97c-5bc15e667719 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.067571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.068449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.068772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.069050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] PATH_INFO: `/v3/users/51876b8c857f47ffa2e9ace9e9526382` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.076478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51876b8c857f47ffa2e9ace9e9526382)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.078608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:37.151627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:37.153891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:37.161643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51876b8c857f47ffa2e9ace9e9526382'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.172259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51876b8c857f47ffa2e9ace9e9526382'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.172392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51876b8c857f47ffa2e9ace9e9526382'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.173106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51876b8c857f47ffa2e9ace9e9526382'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.173809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc204a-2f0b-48ab-86bc-b0506356bf0f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.182623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.184024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51876b8c857f47ffa2e9ace9e9526382'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.184335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.184756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.184967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] PATH_INFO: `/v3/users/09504ad938ba47d8a9efa7216a409237` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.186836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09504ad938ba47d8a9efa7216a409237)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.188492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:37.221582 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1183/2355] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:36 2021] DELETE /identity/v3/users/51876b8c857f47ffa2e9ace9e9526382 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:37.221582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:37.223941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:37.300940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09504ad938ba47d8a9efa7216a409237'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.316933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09504ad938ba47d8a9efa7216a409237'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.317811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09504ad938ba47d8a9efa7216a409237'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.393355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011d288-bbfb-4698-abee-3ffcc2142ac5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.405303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09504ad938ba47d8a9efa7216a409237'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.418374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.419352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.422309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.424013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.427228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:37.427855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.437034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:37.437632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fa6c01f5-cb3a-4da1-bbd0-4782b3580623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09504ad938ba47d8a9efa7216a409237'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:37.456055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1173/2356] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:37 2021] DELETE /identity/v3/users/09504ad938ba47d8a9efa7216a409237 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:37.457711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.458039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.458259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.479428 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1184/2357] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:37.481157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:37.486242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:37.505095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:37.506366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:37.514080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49d3a-5f96-4b4f-9f22-d26439eb6c39 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.608525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.609684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.610116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.611172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.612067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.614687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:37.628674 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1174/2358] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:37.653767 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1185/2359] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:37 2021] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:37.657808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:37.662731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:37.665019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:37.686039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578cfc5-59e8-4b9c-9c69-50ac62061330 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.840726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f7e2-8aa0-483b-8d33-7e6e83efaf72 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:37.852588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.853452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.854355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.854730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.865378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:37.872759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:37.872759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:37.872759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:37.872759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:37.872759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.903976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:37.922431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1175/2360] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:37.997005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:37.998526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.013237 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1186/2361] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:38.060873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.063775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.090995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb2c6-6a51-4cac-8ba0-59bb4629ca7e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.097212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.098595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.099025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.099753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] PATH_INFO: `/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.105201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f279d43b760e4c66aed95bd0b0aff9f6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.110240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.212890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f279d43b760e4c66aed95bd0b0aff9f6', 'request_id': 'req-baf4813c-7c69-4ae0-8b4f-298225deb9e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:38.230222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f279d43b760e4c66aed95bd0b0aff9f6', 'request_id': 'req-baf4813c-7c69-4ae0-8b4f-298225deb9e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:38.230430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.232684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.267560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f279d43b760e4c66aed95bd0b0aff9f6', 'request_id': 'req-baf4813c-7c69-4ae0-8b4f-298225deb9e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:38.305045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] The token cache is being invalidate because project f279d43b760e4c66aed95bd0b0aff9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:38.305466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:38.306355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-baf4813c-7c69-4ae0-8b4f-298225deb9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:38.309102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1176/2362] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:38 2021] DELETE /identity/v3/projects/f279d43b760e4c66aed95bd0b0aff9f6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:38.316709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c339-911a-4752-87d9-16fbcc078c25 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.316709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c339-911a-4752-87d9-16fbcc078c25 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.317088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c339-911a-4752-87d9-16fbcc078c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.351617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-88d7c339-911a-4752-87d9-16fbcc078c25 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:38.353346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88d7c339-911a-4752-87d9-16fbcc078c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.455556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eef6a-16f5-4681-88e7-73f8d90538bd service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.485718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1177/2363] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:38.494327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.494670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.495092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.514205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:38.515415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.527431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1178/2364] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:38.528526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.544408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d2cd-2353-44cc-9990-c4b8e99b3a89 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.552818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.553875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.554416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.555440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.556503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:38.556991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.560130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.582404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1179/2365] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:38.583984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.595003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.596155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.596650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.597262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.597395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527bf7-40a1-4afc-9c79-e07d76019127 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.600652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.603049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.603847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.604128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.604400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.606044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.608095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.661892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1180/2366] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:38 2021] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:38.662826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.746722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.751893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eec9e-93e0-4813-bc89-f5611a38133d service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.775611 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1187/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:38 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:38.806706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.807325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.808461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.812111 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1188/2368] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:38 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:38.819513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:38.823193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:38.854629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cf58e-eefb-406b-ac36-0418f1efa2f9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.869457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.872449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.873078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.874145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.875083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.879525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:38.949664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1181/2369] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:38 2021] POST /identity/v3/users => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:38.955646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:38.972950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee30924-442d-4f78-97a9-d93ebd6d0917 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:38.987025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:38.988219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:38.989248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:38.989682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:38.990887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:38.994080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.009811 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1182/2370] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:39.013995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.029081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.053539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd54fa-e30c-4304-aec2-3998821e481b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.072366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.073373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.074673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.075142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.076541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.078376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.097767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1183/2371] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:39 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:39.106557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.116947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:39.144744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b35c0a-a2a4-4985-9a41-f0bb11bbc0a3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.161459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.162756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.163276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.163276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] PATH_INFO: `/v3/projects/9c66781dda204d2180daaa0328cb5060` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.164542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c66781dda204d2180daaa0328cb5060)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.167694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.208498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb5d1-b9ac-4f92-8242-8e68c2138a94 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.218366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.220552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.220855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.221131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects/7058689efd004aa8a094786acc8a4936` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.223326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:get_project(project_id=7058689efd004aa8a094786acc8a4936)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.225775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.227542 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1189/2372] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:38 2021] GET /identity/v3/projects/7058689efd004aa8a094786acc8a4936 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:39.232648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.241284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c66781dda204d2180daaa0328cb5060', 'request_id': 'req-4165bb18-8296-4a37-b048-a882e131e760'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:39.253313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c66781dda204d2180daaa0328cb5060', 'request_id': 'req-4165bb18-8296-4a37-b048-a882e131e760'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:39.255124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995dd3d-b4a8-4fb9-8ca7-c68baf5e2f87 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.265357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c66781dda204d2180daaa0328cb5060', 'request_id': 'req-4165bb18-8296-4a37-b048-a882e131e760'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:39.286613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] The token cache is being invalidate because project 9c66781dda204d2180daaa0328cb5060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:39.286911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:39.287552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4165bb18-8296-4a37-b048-a882e131e760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:39.290898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1184/2373] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:39 2021] DELETE /identity/v3/projects/9c66781dda204d2180daaa0328cb5060 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:39.317274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e18e5-3f48-4736-b543-b3b68ed67cbe None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.317531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e18e5-3f48-4736-b543-b3b68ed67cbe None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.317797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e18e5-3f48-4736-b543-b3b68ed67cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.353413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-555e18e5-3f48-4736-b543-b3b68ed67cbe None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:39.355109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-555e18e5-3f48-4736-b543-b3b68ed67cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:39.359926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.360961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.361239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.361514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] PATH_INFO: `/v3/projects/c235c2cfeaae45769f16d2431477c864/users/19fb7c1115b448d29b4e1c51ba6a4dd0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.375766 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1185/2374] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:39.384526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c235c2cfeaae45769f16d2431477c864, user_id=19fb7c1115b448d29b4e1c51ba6a4dd0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.388061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.388456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.388571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee697e-1e56-4911-bae7-bd3a2a550171 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.389070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.421317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1190/2375] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:39 2021] PUT /identity/v3/projects/c235c2cfeaae45769f16d2431477c864/users/19fb7c1115b448d29b4e1c51ba6a4dd0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:39.425668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.425959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.426211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.429799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:39.438156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:39.481869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] MFA Rules not processed for user `19fb7c1115b448d29b4e1c51ba6a4dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:39.483039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:39.598151 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1186/2376] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:39.604114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.619732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9b6db-a19c-42a5-96c5-3b35c24f4de1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.627827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.629097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.629652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.630141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.631128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:39.631680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.635230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.640894 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1191/2377] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:39.647124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.649756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:39.660985 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1187/2378] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:39.669209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.673578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197193f-af0c-4f1b-8e40-e922698c3cff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.699253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389028-a013-4db5-b60b-041222594652 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.704085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.705724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.705724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.705724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.706574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.706687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.707451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.707919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.709000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.709962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:39.711796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.712127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:39.772999 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1188/2379] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:39.777574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.781188 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1192/2380] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:39.784904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:39.918521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511e1f8-743b-4640-850e-f24846570a3e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.972041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0737c-5152-4899-a3f4-3bdcd80b9aa8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:39.989718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:39.989718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:39.990160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:39.991890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:39.996565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.002196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf70a94-1d46-4d99-96b1-dba25fb274f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.033599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.034489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.034861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.035048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.035756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.039254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.056191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1193/2381] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/users => generated 308 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:40.060420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573983-7eb9-476d-a128-cdc77c66b195 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.062478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573983-7eb9-476d-a128-cdc77c66b195 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.063655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573983-7eb9-476d-a128-cdc77c66b195 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.068371 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1194/2382] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:40 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:40.070296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1189/2383] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:39 2021] POST /identity/v3/users => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:40.071121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573983-7eb9-476d-a128-cdc77c66b195 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.075406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.097214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64df82-df9c-4107-8dd6-a3aea63aae82 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.098760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573983-7eb9-476d-a128-cdc77c66b195 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.104290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.105696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.106816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.107216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.107637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.108364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.108720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.109247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.109675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.110643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.110942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.113368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.127317 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1190/2384] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:40.128558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:40.131321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:40.146291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1195/2385] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:40.146291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.176279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9274-6611-4c93-9cba-48710d49fd29 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.190095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.190818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.191160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.191598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.192482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.204144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.217411 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1196/2386] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:40.218553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.232889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01720c39-a193-4572-bda5-5b52e23f6aec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.238695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.240496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.240496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.246452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] PATH_INFO: `/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db/users/4b5d2c3b7281407daa56d661e51beebe/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.248710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.251252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:40.274652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f20cbc2b414df3ac49a2a1d53d38db, user_id=4b5d2c3b7281407daa56d661e51beebe, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.286030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.326283 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1197/2387] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:40 2021] PUT /identity/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db/users/4b5d2c3b7281407daa56d661e51beebe/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:40.327303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.405491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf16-56ea-4e67-852d-c5d71ee3707e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.502171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122553-86e8-4d9d-801f-f5cf6422e539 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.510820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.518076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.518639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.519115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] PATH_INFO: `/v3/projects/878ba8a2ed374290a11f6f5f3a99d4b7/users/1e6f093983554648aaec9386d7b41f32/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.543055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878ba8a2ed374290a11f6f5f3a99d4b7, user_id=1e6f093983554648aaec9386d7b41f32, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.546614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809ff00-5073-4d45-afd0-dc4bfa853653 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.548318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.549515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.550011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.551063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects/7058689efd004aa8a094786acc8a4936` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.555371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:get_project(project_id=7058689efd004aa8a094786acc8a4936)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.556408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.559276 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1191/2388] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/projects/7058689efd004aa8a094786acc8a4936 => generated 371 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:40.560080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.581943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a47e-794f-468c-8b8b-5cef48fffd33 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.597899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1198/2389] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:40 2021] PUT /identity/v3/projects/878ba8a2ed374290a11f6f5f3a99d4b7/users/1e6f093983554648aaec9386d7b41f32/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:40.611772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.611772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.612031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.657493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] MFA Rules not processed for user `1e6f093983554648aaec9386d7b41f32`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:40.659150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:40.755439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.756203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.756963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.757708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.759756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.760989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.789252 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1192/2390] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:40.795426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.864218 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1199/2391] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:40 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:40.865927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:40.903621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b0fc0-22f1-408e-80ab-3917c9d9a5f8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.922700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:40.924528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:40.932123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:40.932123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] PATH_INFO: `/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db/users/4b5d2c3b7281407daa56d661e51beebe/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:40.934380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f20cbc2b414df3ac49a2a1d53d38db, user_id=4b5d2c3b7281407daa56d661e51beebe, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:40.947222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:40.967317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02e7-9730-4054-a83a-7d301656618a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:40.989068 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1200/2392] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:40 2021] PUT /identity/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db/users/4b5d2c3b7281407daa56d661e51beebe/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:40.989068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:41.157007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:41.158789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.159079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.159389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.162320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:41.163096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:41.170370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d7c0-b819-45b1-9e90-42ac124d814f tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:41.182014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adff081-bec2-4736-a954-6089b2afb9d6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:41.205956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1193/2393] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:41.207770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.208302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.208897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.211410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:41.217857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.218200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.218614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] PATH_INFO: `/v3/users/1e6f093983554648aaec9386d7b41f32` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.222093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6f093983554648aaec9386d7b41f32)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:41.228810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:41.243249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] MFA Rules not processed for user `4b5d2c3b7281407daa56d661e51beebe`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:41.252828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:41.374435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1194/2394] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:41 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:41.377524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:41.403673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6f093983554648aaec9386d7b41f32'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:41.418007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a03f-cba0-4054-8e83-049fe87b1d6b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:41.421445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6f093983554648aaec9386d7b41f32'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:41.422872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6f093983554648aaec9386d7b41f32'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:41.427905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6f093983554648aaec9386d7b41f32'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:41.434114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:41.435958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.436406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.436853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.437741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:41.438604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6f093983554648aaec9386d7b41f32'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:41.440205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:41.471683 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1195/2395] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:41 2021] POST /identity/v3/users => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:41.472746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:41.474968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:41.492602 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1201/2396] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:40 2021] DELETE /identity/v3/users/1e6f093983554648aaec9386d7b41f32 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:41.494988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:41.497483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:41.658170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619fc27-9752-4f55-a096-b50317b37417 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:41.680478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:41.681630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.684869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.685266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.686182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:41.686571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:41.688437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e617e-3951-460a-8c38-ccd25a445738 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:41.732750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b083-7274-4c02-84d9-ac3816c9c151 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:41.743404 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1202/2397] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:41.746328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.748162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.750957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.787456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:41.789538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:41.884954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:41.885763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:41.886108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:41.887149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:41.889751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:41.908040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1203/2398] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:41.921369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:41.923782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.003772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.005476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9e1e-3fcc-4fa5-a177-03f561dfe26d service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.022280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1196/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:41 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:42.033905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505d577-0132-4050-8eaf-aad54baea705 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.042304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.044023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.044598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.045115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.064425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.064425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.080898 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1204/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:42.081503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970db23-c6c3-4e3c-b941-49a7a2fa8c62 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.081891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970db23-c6c3-4e3c-b941-49a7a2fa8c62 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.082172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970db23-c6c3-4e3c-b941-49a7a2fa8c62 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.084085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1197/2401] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:58:42.096938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:42.112378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.125505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3e5c0-bd2e-4a52-8e79-55434fd26f8a service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.131094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.132334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.132720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.133057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects/7058689efd004aa8a094786acc8a4936` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.134462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:get_project(project_id=7058689efd004aa8a094786acc8a4936)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.137739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.148653 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1205/2402] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:42 2021] GET /identity/v3/projects/7058689efd004aa8a094786acc8a4936 => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:42.399573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485778-5ff0-41a6-8133-cf3eb586c613 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.400726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485778-5ff0-41a6-8133-cf3eb586c613 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.401237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485778-5ff0-41a6-8133-cf3eb586c613 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.403327 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1198/2403] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:42.409806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:42.411949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.429716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.440175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c378-a608-48a4-9154-6204ffdf5010 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.445209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.449388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.450141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.450141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects/7058689efd004aa8a094786acc8a4936` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.451428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:get_project(project_id=7058689efd004aa8a094786acc8a4936)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.454742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.457317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1206/2404] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:42 2021] GET /identity/v3/projects/7058689efd004aa8a094786acc8a4936 => generated 371 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:42.498361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52485778-5ff0-41a6-8133-cf3eb586c613 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.518564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52485778-5ff0-41a6-8133-cf3eb586c613 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.529781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.531786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.540868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.541797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.542082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.542922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/users/631faf391ccb4aa38d2e1f5076e3a31b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.566977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0e2e-f4f0-447d-9b23-d75b28660cbf tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.577022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.577869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.578136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.578407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] PATH_INFO: `/v3/projects/878ba8a2ed374290a11f6f5f3a99d4b7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.579637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878ba8a2ed374290a11f6f5f3a99d4b7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.581565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.583275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:delete_user(user_id=631faf391ccb4aa38d2e1f5076e3a31b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.585230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.645155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878ba8a2ed374290a11f6f5f3a99d4b7', 'request_id': 'req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.657941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878ba8a2ed374290a11f6f5f3a99d4b7', 'request_id': 'req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.668694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631faf391ccb4aa38d2e1f5076e3a31b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.668827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878ba8a2ed374290a11f6f5f3a99d4b7', 'request_id': 'req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.677575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631faf391ccb4aa38d2e1f5076e3a31b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.678798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631faf391ccb4aa38d2e1f5076e3a31b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.689800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] The token cache is being invalidate because project 878ba8a2ed374290a11f6f5f3a99d4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:42.690088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.690860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e05e42ae-c9d6-4b93-bf7e-746d80f27e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.692747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1207/2405] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:42 2021] DELETE /identity/v3/projects/878ba8a2ed374290a11f6f5f3a99d4b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:42.715275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631faf391ccb4aa38d2e1f5076e3a31b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.716305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c4b3-e677-43df-896d-a9831d5913cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.716596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c4b3-e677-43df-896d-a9831d5913cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.716944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c4b3-e677-43df-896d-a9831d5913cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.725551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631faf391ccb4aa38d2e1f5076e3a31b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.737700 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1199/2406] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:42 2021] DELETE /identity/v3/users/631faf391ccb4aa38d2e1f5076e3a31b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:42.739076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.741790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.743032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-87f2c4b3-e677-43df-896d-a9831d5913cc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:42.744206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87f2c4b3-e677-43df-896d-a9831d5913cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.838877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567e0ba-efbf-4bfc-aaa1-29ea75f51555 tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:42.846176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a18471cc0142f2b3e50b5080d3da79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '148f63b74f254c6a8b11028237839188', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:42.847968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.848526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.848951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] PATH_INFO: `/v3/projects/7058689efd004aa8a094786acc8a4936` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.851152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7058689efd004aa8a094786acc8a4936)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:42.853312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:42.877583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1208/2407] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:42.884977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:42.885155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:42.885433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:42.912366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:42.913837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:42.933531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7058689efd004aa8a094786acc8a4936', 'request_id': 'req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.951311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7058689efd004aa8a094786acc8a4936', 'request_id': 'req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.961446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7058689efd004aa8a094786acc8a4936', 'request_id': 'req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.980527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] The token cache is being invalidate because project 7058689efd004aa8a094786acc8a4936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:42.981005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.982825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:42.985201 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1200/2408] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:42 2021] DELETE /identity/v3/projects/7058689efd004aa8a094786acc8a4936 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:42.994991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:42.996624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.003340 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1209/2409] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:43.004784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.006486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.013230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fa4e-0d50-4298-9e7e-cb520df5dc0e tempest-QuotasAdminTestV236-1862657754 tempest-QuotasAdminTestV236-1862657754-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.024878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.026433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.026433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.027429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] PATH_INFO: `/v3/users/dea4ca5955a04ce1944183f0b219b492` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.029286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea4ca5955a04ce1944183f0b219b492)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.031247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.092714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea4ca5955a04ce1944183f0b219b492'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.100300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea4ca5955a04ce1944183f0b219b492'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.101091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea4ca5955a04ce1944183f0b219b492'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.102557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e097-e125-4d42-9257-2064e00cad5d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.111468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.112226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.112570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.113011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.114914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.118026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea4ca5955a04ce1944183f0b219b492'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.129572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea4ca5955a04ce1944183f0b219b492'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.140484 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1201/2410] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:42 2021] DELETE /identity/v3/users/dea4ca5955a04ce1944183f0b219b492 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:43.141340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.143685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.206614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.209927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac46d1-9103-4242-ae01-588c88c29918 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.220649 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1210/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:43.222152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.222603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.222995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.246230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e60e-3d32-44fd-a199-aa99a6b57c8b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.248386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:43.249626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.252267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.253054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.253502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.253913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.254719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:43.255088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.256777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.258316 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1211/2412] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:43.259231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.260561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.274236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d461f4-8691-4cea-a755-517f28707c00 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.275032 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1202/2413] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:43.280452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.281736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.282602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.283134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] PATH_INFO: `/v3/users/19fb7c1115b448d29b4e1c51ba6a4dd0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.285353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fb7c1115b448d29b4e1c51ba6a4dd0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.286182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.288074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.291572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.362497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983105b-8b7d-4a63-a299-7a908c08d0ba admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.368067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.368928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.369207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.370125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.383646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fb7c1115b448d29b4e1c51ba6a4dd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.384226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.386632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.404755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fb7c1115b448d29b4e1c51ba6a4dd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.406551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fb7c1115b448d29b4e1c51ba6a4dd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.407702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fb7c1115b448d29b4e1c51ba6a4dd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.415334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1203/2414] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:43.417780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.435793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9ddc220d-5e47-4f82-90a3-8106c8f61e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fb7c1115b448d29b4e1c51ba6a4dd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:43.441281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4b4e7-e93a-4999-97c5-1c9a06430f51 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.450546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.451716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.451939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.452214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.452955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.455780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.463455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1212/2415] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:43 2021] DELETE /identity/v3/users/19fb7c1115b448d29b4e1c51ba6a4dd0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:43.468537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.468908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.469255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.490191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:43.492014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.509118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1204/2416] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:43 2021] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:43.514297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.521335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.581537 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1213/2417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:43.594723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.598281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.619197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0da7d-3478-45bd-8335-816ea0483f2c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.627882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.628912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.629486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.629860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.630977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.633566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.673419 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1205/2418] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:43 2021] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:43.677542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.679124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586045f5-f5a6-4fbc-8e77-1c91e9d965f8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.690647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a799f-a79b-4598-9730-7bc76c279df4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.697032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.697703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.697982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.698255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.699057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.700669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.713509 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1206/2419] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:43.717164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.729513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c0600-e626-4b62-b825-621c976df360 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.742292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.742987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.743268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.743539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.744284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.746620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.767090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1207/2420] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:43.770857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.775232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.776821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.777066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.777338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.783101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbaf6f-4f13-47b5-8aef-5ce5a0133deb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:43.788984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:43.790444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.790728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.791007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] PATH_INFO: `/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a/users/19de94ce79634797998eede0497a07b2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.793840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.794887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a798-c302-486f-9a13-f1fd95cf31c0 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.809590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1214/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:43.817105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e89c79f8f437b8675c1e2dae4b17a, user_id=19de94ce79634797998eede0497a07b2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:43.820034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:43.842384 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1208/2422] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:43 2021] PUT /identity/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a/users/19de94ce79634797998eede0497a07b2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:43.854353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d304b-bde7-402c-add7-929b862cb525 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:43.854634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d304b-bde7-402c-add7-929b862cb525 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:43.855404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d304b-bde7-402c-add7-929b862cb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:43.896408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-209d304b-bde7-402c-add7-929b862cb525 None None] MFA Rules not processed for user `19de94ce79634797998eede0497a07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:43.898076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-209d304b-bde7-402c-add7-929b862cb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.908054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:43.910188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:43.996577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6db43-d9cf-4c41-b181-1aeab0069d34 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.014021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.014957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.017110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.017395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] PATH_INFO: `/v3/projects/3eda26faa4ce4ae097d97eefd09cc4bb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.020063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eda26faa4ce4ae097d97eefd09cc4bb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.025500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.025679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1215/2423] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:43 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:44.028430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d304b-bde7-402c-add7-929b862cb525 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.060820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d304b-bde7-402c-add7-929b862cb525 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.069189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.070457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.070917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.071681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.072896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.076756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.099739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eda26faa4ce4ae097d97eefd09cc4bb', 'request_id': 'req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.107211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eda26faa4ce4ae097d97eefd09cc4bb', 'request_id': 'req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.116320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eda26faa4ce4ae097d97eefd09cc4bb', 'request_id': 'req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.130089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1216/2424] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:44 2021] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:44.134916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] The token cache is being invalidate because project 3eda26faa4ce4ae097d97eefd09cc4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:44.135214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.135969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.138436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1209/2425] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:43 2021] DELETE /identity/v3/projects/3eda26faa4ce4ae097d97eefd09cc4bb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.140009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.142426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.142712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.144309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.233573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0b1e-17d5-4a54-88b9-5554a1dad0e6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.243190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b693c5-ea6c-4588-ba31-56306eec15d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.247052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.250156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.250855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.251145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.251556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.252279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.254061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.255664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.255807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.256121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] PATH_INFO: `/v3/users/e8a18471cc0142f2b3e50b5080d3da79` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.258003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a18471cc0142f2b3e50b5080d3da79)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.260025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.284647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1217/2426] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:44 2021] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:44.285680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.287437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.300701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faae6-d706-4174-8a6c-ce8cab8f563d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.306313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.307553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.308396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.308731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] PATH_INFO: `/v3/projects/c235c2cfeaae45769f16d2431477c864` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.310648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c235c2cfeaae45769f16d2431477c864)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.313857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.347076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a18471cc0142f2b3e50b5080d3da79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.359739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a18471cc0142f2b3e50b5080d3da79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.360520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a18471cc0142f2b3e50b5080d3da79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.389080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c235c2cfeaae45769f16d2431477c864', 'request_id': 'req-ba9ac966-bba4-45c2-aa94-5441866604ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.389260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a18471cc0142f2b3e50b5080d3da79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.397701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c235c2cfeaae45769f16d2431477c864', 'request_id': 'req-ba9ac966-bba4-45c2-aa94-5441866604ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.399279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a18471cc0142f2b3e50b5080d3da79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.410564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c235c2cfeaae45769f16d2431477c864', 'request_id': 'req-ba9ac966-bba4-45c2-aa94-5441866604ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.412910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1210/2427] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:44 2021] DELETE /identity/v3/users/e8a18471cc0142f2b3e50b5080d3da79 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.416853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.418533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.444173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] The token cache is being invalidate because project c235c2cfeaae45769f16d2431477c864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:44.445187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.446275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.467478 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1218/2428] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:44 2021] DELETE /identity/v3/projects/c235c2cfeaae45769f16d2431477c864 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.469178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.473415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.515593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b8a1-638d-4496-873d-aa7c968d0a57 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.523314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.524006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.524298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.524567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.525513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.527371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.546294 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1211/2429] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:44 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:44.547403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.549605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:44.580325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570121f-9541-4d11-b25a-8e0b4b96c954 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.587151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.588211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.588502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.588811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] PATH_INFO: `/v3/projects/7cd2b60e714243a2b5bfd71f16b19037/users/dddda01524d84107b2234cbb612c77c2/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.608856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd2b60e714243a2b5bfd71f16b19037, user_id=dddda01524d84107b2234cbb612c77c2, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.611867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.630624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac966-bba4-45c2-aa94-5441866604ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.635944 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1212/2430] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:44 2021] PUT /identity/v3/projects/7cd2b60e714243a2b5bfd71f16b19037/users/dddda01524d84107b2234cbb612c77c2/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.640664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.757747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.758649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.758933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.759211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] PATH_INFO: `/v3/users/4b5d2c3b7281407daa56d661e51beebe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.762666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5d2c3b7281407daa56d661e51beebe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.764927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557cc93-bb63-4cba-b637-d19e5902eed8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.770061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.771557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.772647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.773033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.773410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.774874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.779073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.791817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1213/2431] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:44 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:44.818174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:44.849294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c664bf-3f99-426b-aafc-2eab8898f4a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:44.857801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:44.858697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5d2c3b7281407daa56d661e51beebe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.859122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.859570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.860156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] PATH_INFO: `/v3/projects/7cd2b60e714243a2b5bfd71f16b19037/users/dddda01524d84107b2234cbb612c77c2/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.866432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5d2c3b7281407daa56d661e51beebe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.867206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5d2c3b7281407daa56d661e51beebe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.868438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5d2c3b7281407daa56d661e51beebe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.869078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd2b60e714243a2b5bfd71f16b19037, user_id=dddda01524d84107b2234cbb612c77c2, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:44.873396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4499-827d-4fe7-9e9a-137cfdfb7b0d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:44.878648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5d2c3b7281407daa56d661e51beebe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:44.891261 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1214/2432] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:44 2021] PUT /identity/v3/projects/7cd2b60e714243a2b5bfd71f16b19037/users/dddda01524d84107b2234cbb612c77c2/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.902796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:44.903165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:44.903680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:44.908647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1219/2433] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:44 2021] DELETE /identity/v3/users/4b5d2c3b7281407daa56d661e51beebe => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:44.937169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] MFA Rules not processed for user `dddda01524d84107b2234cbb612c77c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:44.938813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.050012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1215/2434] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:44 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:45.054547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:45.060821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:45.065520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.073889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308534ac-acc3-4037-ad5a-93dc1bdc8ad4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:45.102051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddda01524d84107b2234cbb612c77c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2b60e714243a2b5bfd71f16b19037', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:45.102870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.103720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.103945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.104977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:45.106452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:45.143057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1220/2435] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/roles => generated 240 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:45.144215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:45.161447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386982-6893-4c1a-8550-7486328d9bd1 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:45.171124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddda01524d84107b2234cbb612c77c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2b60e714243a2b5bfd71f16b19037', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:45.172896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.173592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.173775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] PATH_INFO: `/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a/users/19de94ce79634797998eede0497a07b2/roles/60ec5f3079754b40b3b2d426a17dc1a5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.176723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d29e89c79f8f437b8675c1e2dae4b17a, user_id=19de94ce79634797998eede0497a07b2, role_id=60ec5f3079754b40b3b2d426a17dc1a5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:45.180972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:45.199375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705895-d113-4296-bacc-6e5fe336c98c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:45.212419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1221/2436] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:45 2021] PUT /identity/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a/users/19de94ce79634797998eede0497a07b2/roles/60ec5f3079754b40b3b2d426a17dc1a5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:45.214775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:45.218571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.281461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:45.282723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.283102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.283268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] PATH_INFO: `/v3/projects/148f63b74f254c6a8b11028237839188` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.286736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148f63b74f254c6a8b11028237839188)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:45.289005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:45.363550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143187f9-4f58-43de-b1f2-78ef47b5c352 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:45.396167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148f63b74f254c6a8b11028237839188', 'request_id': 'req-46da5227-5485-4130-b7be-e5a67325f764'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.405895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148f63b74f254c6a8b11028237839188', 'request_id': 'req-46da5227-5485-4130-b7be-e5a67325f764'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.416523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148f63b74f254c6a8b11028237839188', 'request_id': 'req-46da5227-5485-4130-b7be-e5a67325f764'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.445167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] The token cache is being invalidate because project 148f63b74f254c6a8b11028237839188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:45.454979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.457228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.475334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1216/2437] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:45 2021] DELETE /identity/v3/projects/148f63b74f254c6a8b11028237839188 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:45.476478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:45.482774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.483688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19de94ce79634797998eede0497a07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd29e89c79f8f437b8675c1e2dae4b17a', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1983914154', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:45.484796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.485189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.485626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] PATH_INFO: `/v3/users/19de94ce79634797998eede0497a07b2/application_credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.486566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: Authorizing `identity:create_application_credential(user_id=19de94ce79634797998eede0497a07b2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:45.488183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa702bc-6771-474c-a38c-5dec029ceed7 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:45.637071 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1222/2438] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/users/19de94ce79634797998eede0497a07b2/application_credentials => generated 660 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:45.639758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949e87-6f18-49a4-bb5e-d06018e95169 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.639758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949e87-6f18-49a4-bb5e-d06018e95169 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.639758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949e87-6f18-49a4-bb5e-d06018e95169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.666347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da5227-5485-4130-b7be-e5a67325f764 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:45.679152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:45.680034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.681639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.681931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] PATH_INFO: `/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.684330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ea949e87-6f18-49a4-bb5e-d06018e95169 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:45.685526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f20cbc2b414df3ac49a2a1d53d38db)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:45.688311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ea949e87-6f18-49a4-bb5e-d06018e95169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.688483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:45.721016 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1223/2439] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:45.721016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676e98-4ca6-438d-a621-9d5daebf85a4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.721016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676e98-4ca6-438d-a621-9d5daebf85a4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.721016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676e98-4ca6-438d-a621-9d5daebf85a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.777488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-96676e98-4ca6-438d-a621-9d5daebf85a4 None None] MFA Rules not processed for user `19de94ce79634797998eede0497a07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:45.781995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96676e98-4ca6-438d-a621-9d5daebf85a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.790621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f20cbc2b414df3ac49a2a1d53d38db', 'request_id': 'req-12a66897-f58e-47d6-a482-cfa69507b88c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.815062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f20cbc2b414df3ac49a2a1d53d38db', 'request_id': 'req-12a66897-f58e-47d6-a482-cfa69507b88c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.833831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f20cbc2b414df3ac49a2a1d53d38db', 'request_id': 'req-12a66897-f58e-47d6-a482-cfa69507b88c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.873872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] The token cache is being invalidate because project 86f20cbc2b414df3ac49a2a1d53d38db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:45.874406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.875547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-12a66897-f58e-47d6-a482-cfa69507b88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:45.879262 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1217/2440] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:45 2021] DELETE /identity/v3/projects/86f20cbc2b414df3ac49a2a1d53d38db => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:45.881603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.881941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:45.882225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:45.910691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:45.911922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:45.996640 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1224/2441] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 10 03:58:45.998056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:45.998342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.000698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.022778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:46.024074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.030334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1218/2442] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:46.031468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.033636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.055839 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1225/2443] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:46.065421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.086144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e4672-c79b-4fef-ac42-953c21d03c8d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.093031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.094219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.094509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.095286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.097918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:46.097918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.100796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9596-9048-4652-bc39-3e493d6c3ddd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.122216 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1226/2444] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:46.124105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.124559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.125052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.150074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:46.151507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.159827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11114510-2a8e-427f-8458-4e0dadbf6a41 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.162091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1227/2445] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:46.162969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.170791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19de94ce79634797998eede0497a07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd29e89c79f8f437b8675c1e2dae4b17a', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1983914154', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.171939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.172227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.172508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] PATH_INFO: `/v3/users/19de94ce79634797998eede0497a07b2/application_credentials/3b60236141874ab6914c07ccb6531b8c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.174806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=19de94ce79634797998eede0497a07b2, application_credential_id=3b60236141874ab6914c07ccb6531b8c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.176805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.178337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385eb42-02db-4f7d-b639-566cdb3c4bee None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.185729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.186802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.187705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.188174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.189231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.192232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.217004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1219/2446] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 03:58:46 2021] DELETE /identity/v3/users/19de94ce79634797998eede0497a07b2/application_credentials/3b60236141874ab6914c07ccb6531b8c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:46.218133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.235338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670ca8-fc9f-4a3d-be35-34ea6e7839d0 tempest-ApplicationCredentialsV3AdminTest-60923673 tempest-ApplicationCredentialsV3AdminTest-60923673-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.240280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.241125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.241404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.241680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.245126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:46.245908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.248710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.251253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1228/2447] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:46.252822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.260061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.264234 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1220/2448] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:46.265316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.278324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81567e41-49d0-4e60-b5aa-015b9cb6d777 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.340999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576caf1a-a651-4419-ad4e-be8702fcffc7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.347850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddda01524d84107b2234cbb612c77c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2b60e714243a2b5bfd71f16b19037', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.350630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.350975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.351966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] PATH_INFO: `/v3/roles/60ec5f3079754b40b3b2d426a17dc1a5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.353821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60ec5f3079754b40b3b2d426a17dc1a5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.355551 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:46.355551 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:58:46.355551 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:58:46.356724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.367346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.368339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.368553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.368893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.369644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.372686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.398205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1221/2449] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:46.399145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.413029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4db0f-59b2-4f5c-b168-7b74af4adf2b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.416602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Invalidating the token cache because role 60ec5f3079754b40b3b2d426a17dc1a5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:46.417140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.418494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.419300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.419962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.420319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.420592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.421323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.421845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1229/2450] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:46 2021] DELETE /identity/v3/roles/60ec5f3079754b40b3b2d426a17dc1a5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:46.423579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.426695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.428203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.455736 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1222/2451] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:46.456651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.460131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.495424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f87-4752-4166-8cf9-36438df28218 tempest-ApplicationCredentialsV3AdminTest-990073519 tempest-ApplicationCredentialsV3AdminTest-990073519-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.525126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515632ce-e5e5-491c-b62d-aa3ed9c57bd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.530483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.531350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.531629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.531910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] PATH_INFO: `/v3/users/19de94ce79634797998eede0497a07b2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.533167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19de94ce79634797998eede0497a07b2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.535054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.550227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.550905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.551201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.551497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.552292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.553936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.563981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1230/2452] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:46.564917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.566705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.579536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74eee1-8639-4442-a2a6-0f5c5447c221 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.582111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19de94ce79634797998eede0497a07b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.584741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.585405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.585977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.585977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.586647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.588533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.594154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19de94ce79634797998eede0497a07b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.594871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19de94ce79634797998eede0497a07b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.607302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19de94ce79634797998eede0497a07b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.612733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1231/2453] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:46.612733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.614996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19de94ce79634797998eede0497a07b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:46.624068 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1223/2454] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:46 2021] DELETE /identity/v3/users/19de94ce79634797998eede0497a07b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:46.624068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.624068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.624427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925bc6-4c65-4f1b-bed5-958dc32e5ed6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.689237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb285-2a31-4f64-a129-fcc957624855 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.690936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.691602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.691878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.692149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.692922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.694378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.694639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150787-bd30-4c8c-afc8-4596d3afd183 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.695028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.695303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.695570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.696304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.698191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.710302 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1232/2455] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:46.710302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.710302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.710302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.712340 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1224/2456] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:46.713249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.715466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.728350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6850c0-4cba-4193-9aa8-a921698b2e0d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.729662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:46.730856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.733269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.734163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.734434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.734699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605/users/474556e313c74ae98e8ce7c628d64ede/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.741758 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1233/2457] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:46.741758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.750521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bb31c360eb4aff8b7e2f35c24e0605, user_id=474556e313c74ae98e8ce7c628d64ede, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.753955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.757145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb0d14-c2bf-421a-a773-712d7590ae86 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.764334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.765069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.765329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.765603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.766517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.768160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.771843 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1225/2458] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:46 2021] PUT /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605/users/474556e313c74ae98e8ce7c628d64ede/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:46.783231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.783632 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1234/2459] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:46.784059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:46.784696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:46.794393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0338221-03d9-4d98-a7bd-80fb180631fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.863714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee476-874b-4bb3-852f-8b4cfa6f1822 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:46.868247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.869101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.871299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.871299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.872254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:46.873874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.873874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.873874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] PATH_INFO: `/v3/projects/0391c5d9da1e437496283aac6a524a63/users/2e442545daa647909d6310ff78d49055/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.880093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.882900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a309a4-ebc6-48a4-98fa-34d8d7f145e2 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.894833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0391c5d9da1e437496283aac6a524a63, user_id=2e442545daa647909d6310ff78d49055, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:46.897054 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1226/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:46.898508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98f72-2e90-4766-ab2c-264d909fe81c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:46.898927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.899562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.900220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.920548 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1235/2461] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:46 2021] PUT /identity/v3/projects/0391c5d9da1e437496283aac6a524a63/users/2e442545daa647909d6310ff78d49055/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:46.931930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:46.932390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:46.932538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:46.960378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] MFA Rules not processed for user `474556e313c74ae98e8ce7c628d64ede`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:46.961654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.008959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] MFA Rules not processed for user `2e442545daa647909d6310ff78d49055`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:47.012075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.148857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1227/2462] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:47.150001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.172248 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1236/2463] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:47.180803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.182410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.269149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae461d-a84d-4b7b-94b5-ce175cdc3f2e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.280302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.281523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.282643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.283205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.286609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.288824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.343373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84c525-87da-46b0-9874-49db12edaf82 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.344341 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1228/2464] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:47 2021] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:47.351528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.447807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09faf3-ddb0-44fe-b45c-93b685f92cc4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.453705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.455196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.455656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.456075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.457579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.461403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.468701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.469322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.469624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.469876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.494405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1229/2465] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:47 2021] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:47.495988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.498221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.531242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1f2c-61bf-4edf-9e6e-9fc4b8010740 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.538224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.539102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.539374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.539643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] PATH_INFO: `/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.541516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29e89c79f8f437b8675c1e2dae4b17a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.544210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.545960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.547546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.560589 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1237/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:47 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:47.562043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.581774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6726b-cb28-4f92-821a-ff6d789dba4f service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.592673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.593392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.593669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.593939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.600772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.602384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.609768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29e89c79f8f437b8675c1e2dae4b17a', 'request_id': 'req-7053dbdf-0415-4f2a-8981-5bb7496a5697'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.619316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29e89c79f8f437b8675c1e2dae4b17a', 'request_id': 'req-7053dbdf-0415-4f2a-8981-5bb7496a5697'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.623793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1238/2467] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:47 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:47.627827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.638230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29e89c79f8f437b8675c1e2dae4b17a', 'request_id': 'req-7053dbdf-0415-4f2a-8981-5bb7496a5697'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.646025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c759-0dd7-4de7-b800-3c6bd678cf35 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.659824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] The token cache is being invalidate because project d29e89c79f8f437b8675c1e2dae4b17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:47.660139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.661919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.667823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1230/2468] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:47 2021] DELETE /identity/v3/projects/d29e89c79f8f437b8675c1e2dae4b17a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:47.668877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.671216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.752239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.754415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.754415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.754415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] PATH_INFO: `/v3/projects/51d48b2efac84d1583fb6de9915522a5/users/95860871e61144e38e812de03ccf2589/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.770512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053dbdf-0415-4f2a-8981-5bb7496a5697 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.777632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.779031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.779031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.779031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] PATH_INFO: `/v3/users/dddda01524d84107b2234cbb612c77c2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.780318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddda01524d84107b2234cbb612c77c2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.782440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.785293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d48b2efac84d1583fb6de9915522a5, user_id=95860871e61144e38e812de03ccf2589, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.789154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13353-7c2c-463f-bd8b-75537d74e701 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.813669 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1239/2469] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:47 2021] PUT /identity/v3/projects/51d48b2efac84d1583fb6de9915522a5/users/95860871e61144e38e812de03ccf2589/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:47.815218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.815575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.816036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.832225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddda01524d84107b2234cbb612c77c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.838839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddda01524d84107b2234cbb612c77c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.840034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddda01524d84107b2234cbb612c77c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.851789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddda01524d84107b2234cbb612c77c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.862613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddda01524d84107b2234cbb612c77c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:47.869346 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1231/2470] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:47 2021] DELETE /identity/v3/users/dddda01524d84107b2234cbb612c77c2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:47.872844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:47.875425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.877946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:47.879123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:47.952585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1240/2471] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:58:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:47.963388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8360-3962-492c-bfae-3bc69ad45601 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:47.968942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:47.969502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:47.969896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:47.970185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:47.971089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:47.973037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:47.988672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1232/2472] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:47 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:47.990461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.000534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.002786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.002965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a1d4-401d-41bf-9a71-db31cba7d55c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.008337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.009028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.009028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.009389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] PATH_INFO: `/v3/projects/51d48b2efac84d1583fb6de9915522a5/users/95860871e61144e38e812de03ccf2589/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.011643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d48b2efac84d1583fb6de9915522a5, user_id=95860871e61144e38e812de03ccf2589, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.014446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea0b3-3256-47fa-a961-bbb847b776c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.028676 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1241/2473] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:47 2021] PUT /identity/v3/projects/51d48b2efac84d1583fb6de9915522a5/users/95860871e61144e38e812de03ccf2589/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:48.045552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.045905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.046287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.074745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] MFA Rules not processed for user `95860871e61144e38e812de03ccf2589`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:48.076049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.108859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa3e5-dc9c-483d-b2bd-5dee4a401319 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.163888 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1242/2474] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:48.171155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.171812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.172091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.172360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.176868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.178249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.274118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.275825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.281119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21d57-232d-4b9f-a665-891d74729a0f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.287575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1233/2475] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:58:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:58:48.289046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.290798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.291127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.291909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.292225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.292653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.310732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.313729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88c3d-420e-41df-b10a-8aa19fd6ec63 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.325831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1243/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:48 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:48.350440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.350729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.351086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.352864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1244/2477] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:48.359002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:48.375899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.392356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819264-a055-49d8-a8be-9343d9d7e7f2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.399866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.400794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.402043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.402337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.404005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.406914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9799d-e3cf-4cee-919a-b1037912f230 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.410141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1245/2478] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:48 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:48.434665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6ec9-45f2-44f5-9521-7b9e7ca3156c service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.441462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.443184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.443537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.443958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] PATH_INFO: `/v3/projects/7cd2b60e714243a2b5bfd71f16b19037` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.445569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd2b60e714243a2b5bfd71f16b19037)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.454748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.473267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.473548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.473823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.477252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1246/2479] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:58:48.489898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:48.517156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.519012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd2b60e714243a2b5bfd71f16b19037', 'request_id': 'req-f7216b98-66ef-4110-abd6-6d68ca3ae80d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:48.526543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd2b60e714243a2b5bfd71f16b19037', 'request_id': 'req-f7216b98-66ef-4110-abd6-6d68ca3ae80d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:48.534479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd2b60e714243a2b5bfd71f16b19037', 'request_id': 'req-f7216b98-66ef-4110-abd6-6d68ca3ae80d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:48.536246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3001-b2e4-472e-be8b-70b6aede71a8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.550895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] The token cache is being invalidate because project 7cd2b60e714243a2b5bfd71f16b19037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:48.551419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:48.552415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f7216b98-66ef-4110-abd6-6d68ca3ae80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:48.554519 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1234/2480] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:48 2021] DELETE /identity/v3/projects/7cd2b60e714243a2b5bfd71f16b19037 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:48.561365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0187b-1019-4142-9865-d33da090b097 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.562160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0187b-1019-4142-9865-d33da090b097 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.562974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0187b-1019-4142-9865-d33da090b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.591282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f3d0187b-1019-4142-9865-d33da090b097 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:48.592685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3d0187b-1019-4142-9865-d33da090b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.659018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.660312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.661062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.661566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.663618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.667124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd59a-88b0-4f3d-98ad-aa704f1a5489 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.683752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1247/2481] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:48 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:48.684283 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1235/2482] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:48.686294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.686586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.686846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.692503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.693117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.693727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.732519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] MFA Rules not processed for user `2e442545daa647909d6310ff78d49055`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:48.733822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.743290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:48.746687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.769224 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1236/2483] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:48.773945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.788504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc0d1-8e60-4230-be3a-b81b38b9cdf2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.799431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.800420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.802226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.803069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.803422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:48.803712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.808908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90133b67-11f1-4f75-8b93-f793b85f0fd6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.848859 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1237/2484] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:58:48.850263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.850554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.850829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.880050 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1248/2485] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:48.885516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] MFA Rules not processed for user `474556e313c74ae98e8ce7c628d64ede`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:48.887359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:48.887881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.904546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfb454-ea8c-4a37-bb2b-b3218b2d71b9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:48.912597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:48.914008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.914795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.915331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.916511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:48.920059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739a8b-17f9-46d0-a45c-4e904aa65488 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:48.964942 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1249/2486] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:48.966108 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1238/2487] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:48.967340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46c64-9170-4aba-86c0-820cee8a46d8 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.967629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46c64-9170-4aba-86c0-820cee8a46d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.968061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46c64-9170-4aba-86c0-820cee8a46d8 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.969277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:48.970065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1250/2488] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:58:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:48.977236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:48.977236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:48.977236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:48.984046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48166-f249-4107-b7ad-7ece7343083f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.004443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:49.006709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.081175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.081842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.082121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.082400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.083093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.084072 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1251/2489] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:49.086587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.094174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.095753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.109308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229dff7-1cf0-41ab-aed2-bce5800097f6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.115627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.116539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.116745 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1239/2490] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:48 2021] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:49.117037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.117351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.121084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.125801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.127194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.135297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27612-8df4-4cb6-8653-13475fafdee4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.140515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.141682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.141682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.142685 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1252/2491] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:49.154561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.154561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.159679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.180750 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1240/2492] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:49.181902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.195656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66729-c9ff-46dc-b0cd-362ea48bbe1c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.200982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.201444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.201722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.201993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.203324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.205178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676675ac-eeee-4053-bc47-0bf9bc510dec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.219836 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1253/2493] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:49.228997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.261109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547e44-ea1c-488f-89f2-99bc97e0bda3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.266598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.268983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.269296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.269741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] PATH_INFO: `/v3/projects/d0229e420606423d8ece152b1f103974/users/69ee674a5d764279adb33f278ac331af/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.311461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0229e420606423d8ece152b1f103974, user_id=69ee674a5d764279adb33f278ac331af, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.318963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e937bc-3059-4115-b6ce-c1087c76766f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.359821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1241/2494] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:49 2021] PUT /identity/v3/projects/d0229e420606423d8ece152b1f103974/users/69ee674a5d764279adb33f278ac331af/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:49.365951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.366413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.366825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.382646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911123b-199b-494e-9ba5-3bd75c8b08ef None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.383207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911123b-199b-494e-9ba5-3bd75c8b08ef None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.383478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911123b-199b-494e-9ba5-3bd75c8b08ef None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.385764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1242/2495] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:58:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:58:49.391666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.391951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.392232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.433720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] MFA Rules not processed for user `69ee674a5d764279adb33f278ac331af`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:49.435599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.512702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:49.514147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.516468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1254/2496] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:49.517634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.519034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.606184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489368f-2c14-4890-961d-98c8ae8b2eed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.613132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.613815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.614189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.614698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.616932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.628628 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1243/2497] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:49.630722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.684110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.686273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.720231 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1255/2498] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:49 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:49.721323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.724550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.745728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d94e1-f1c4-4409-bd29-be25034b33cd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.751453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee4ff-819d-4880-9c04-f6f00f56eadb service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.755914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.759719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.760631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.761721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.762099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.765957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.766265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.766557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.767298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.774569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.775148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85fc4e-6ea9-4bda-8803-589cfcbd540c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.776442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:49.813147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1256/2499] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:49.827416 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1244/2500] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:49 2021] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:49.833294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:49.873203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816be77-a857-422f-9629-7f2146a3811e service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:49.911156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.911439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.911712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.938855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:49.940080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:49.966036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:49.967616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:49.968352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:49.970122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:49.972309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:49.976176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.011354 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1245/2501] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:50.016276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1257/2502] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:49 2021] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:50.021059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.038458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.043188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:50.059038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bcdcb-a2b5-4057-8803-302cbdd1119a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.078702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.079940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.080182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.082670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.083737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.086067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.103272 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1246/2503] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:50.107278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.127948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a83ab-ed48-45eb-860f-ea0dfac7e813 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.134567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.135786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.141784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.142645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] PATH_INFO: `/v3/projects/bf5f48eebb8f47bdbe999891951de990/users/595cc753e8ca4e5da75827502f5de525/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.143285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915afa-cbe1-4d4f-ba2a-6d0d083a648c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.164565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.165620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.166083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.166691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.179513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.181889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.183187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f48eebb8f47bdbe999891951de990, user_id=595cc753e8ca4e5da75827502f5de525, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.189520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.221420 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1258/2504] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:58:50.229158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1247/2505] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:50 2021] PUT /identity/v3/projects/bf5f48eebb8f47bdbe999891951de990/users/595cc753e8ca4e5da75827502f5de525/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:50.233007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.260022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b24-ecf6-40e9-a7fe-3a90fe5bc623 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.421425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.421905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.422352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.423034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.424452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.426282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.429323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.431308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:50.456806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ce74-a79b-462b-87a1-e8f0f2ee64f4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.461402 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1259/2506] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:50.467507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.470148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.474734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.476642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.477182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] PATH_INFO: `/v3/users/2e442545daa647909d6310ff78d49055` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.479231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e442545daa647909d6310ff78d49055)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.483319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.491925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a6f3-5d91-438b-a032-2f5fe5ec6703 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.512368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.513586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.513871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.514151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] PATH_INFO: `/v3/projects/bf5f48eebb8f47bdbe999891951de990/users/595cc753e8ca4e5da75827502f5de525/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.518761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f48eebb8f47bdbe999891951de990, user_id=595cc753e8ca4e5da75827502f5de525, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.523974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521657-71c6-4ceb-bf13-9a00a8f9f1c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.545874 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1260/2507] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:50 2021] PUT /identity/v3/projects/bf5f48eebb8f47bdbe999891951de990/users/595cc753e8ca4e5da75827502f5de525/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:50.554651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.556713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.558582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.585446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e442545daa647909d6310ff78d49055'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:50.605439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e442545daa647909d6310ff78d49055'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:50.607802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e442545daa647909d6310ff78d49055'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:50.629788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] MFA Rules not processed for user `595cc753e8ca4e5da75827502f5de525`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:50.631269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:50.645285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e442545daa647909d6310ff78d49055'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:50.680461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4023d18-c747-4680-8136-80cadc98ca70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e442545daa647909d6310ff78d49055'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:50.692949 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1248/2508] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:50 2021] DELETE /identity/v3/users/2e442545daa647909d6310ff78d49055 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:50.694786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.694991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.695339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.742615 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1261/2509] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:50 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:50.743694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:50.748492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.749238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:50.763838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682d3c-bea5-4b57-b2f4-a5531e702aa4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.853286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.854288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.855333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.855713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects/d0229e420606423d8ece152b1f103974` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.857166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:get_project(project_id=d0229e420606423d8ece152b1f103974)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.859299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.865481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1262/2510] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/projects/d0229e420606423d8ece152b1f103974 => generated 389 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:50.866461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.879425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efa42-86a4-4d92-ac06-34d7a7c4e767 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:50.886460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:50.887238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:50.888030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:50.888180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:50.889245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:50.891322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:50.934686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1263/2511] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:58:50 2021] POST /identity/v3/projects => generated 339 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:50.936640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.942250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1249/2512] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:50.980078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:50.982643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.125591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df0ba0-d356-414d-9360-d221934ae8ae tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.132773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.133889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.134396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.134773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.135634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.139462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.144534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1b7d-70a8-4c83-b248-8650c3eab7a9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.172787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1264/2513] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/projects => generated 8086 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:51.176946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.183567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.241888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.244506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.245083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.246081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.344085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6491-5a3f-4c2a-b5e4-e2e414e6edce tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.350663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.352256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.352699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f0bb6-0d20-43ff-9038-b1faf0f8c20d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.353219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.353608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.353993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.356191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.376487 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1250/2514] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:51.378397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9de-914e-48b8-b046-5749f79ba895 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.378851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9de-914e-48b8-b046-5749f79ba895 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.379270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9de-914e-48b8-b046-5749f79ba895 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.387875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1251/2515] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:51 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:51.389062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311d9de-914e-48b8-b046-5749f79ba895 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.420999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311d9de-914e-48b8-b046-5749f79ba895 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.434048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.436339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.438300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.438880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects/d0229e420606423d8ece152b1f103974` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.443697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:get_project(project_id=d0229e420606423d8ece152b1f103974)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.449353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.457412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1252/2516] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects/d0229e420606423d8ece152b1f103974 => generated 389 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:51.461444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:51.464349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.498017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.501018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.504382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.506115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.528062 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1265/2517] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:51.530368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.574650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca0a-e714-4ced-bcaf-b478ab176cde service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.597661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.603140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.603429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.603709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects/eb88486ddbb64f78ae964b0eafb9eba4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.611833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:get_project(project_id=eb88486ddbb64f78ae964b0eafb9eba4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.613955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.627410 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1266/2518] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects/eb88486ddbb64f78ae964b0eafb9eba4 => generated 339 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:51.637156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.693752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f57d-d069-4900-8669-ea45799e3996 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.710689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.713460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.714293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.714572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.715342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.719271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.736846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849977e-3a58-4716-9cf7-41a388e2c975 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.752072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.753265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.753689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.754146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.759099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.759986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1267/2519] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects => generated 8086 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:51.761406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.762770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.766754 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1253/2520] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:51.797314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5f50-ba5d-49c8-8e5e-22848210a188 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.830489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.832777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.836884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.837179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.841431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:51.841763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.846231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:51.939298 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1268/2521] 10.222.0.13 () {58 vars in 1165 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects?domain_id=default => generated 7755 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:51.939888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.941760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:51.943241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:51.968709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845ffc-8dd8-45c9-a507-9b22ca2ea712 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.973189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e0d9-f21a-47d8-b211-13855de23476 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:51.979491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.980305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.980740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.981139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.981865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:51.982097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.982754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:51.983055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:51.983700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] PATH_INFO: `/v3/users/9c69cc6d1fa34f34a67a711ceac91423` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:51.988498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c69cc6d1fa34f34a67a711ceac91423)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:51.999034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.001866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecb6b7-3e99-4649-a906-714daeadf055 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.076068 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1269/2522] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:58:51 2021] GET /identity/v3/projects => generated 8086 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:52.077047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802a4e-5a71-4a1c-91d4-d6938f52f5e2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.078051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802a4e-5a71-4a1c-91d4-d6938f52f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.078594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802a4e-5a71-4a1c-91d4-d6938f52f5e2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.084394 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1270/2523] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:52 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:52.087431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42802a4e-5a71-4a1c-91d4-d6938f52f5e2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.098229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c69cc6d1fa34f34a67a711ceac91423'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.128006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c69cc6d1fa34f34a67a711ceac91423'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.131703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c69cc6d1fa34f34a67a711ceac91423'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.138638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42802a4e-5a71-4a1c-91d4-d6938f52f5e2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.157211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.157951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.158415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.158764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.159809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:52.160186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.165738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.191062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c69cc6d1fa34f34a67a711ceac91423'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.211241 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1271/2524] 10.222.0.13 () {58 vars in 1165 bytes} [Wed Nov 10 03:58:52 2021] GET /identity/v3/projects?domain_id=default => generated 7755 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:52.216786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:52.218204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c69cc6d1fa34f34a67a711ceac91423'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.239970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1254/2525] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:51 2021] DELETE /identity/v3/users/9c69cc6d1fa34f34a67a711ceac91423 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:52.241174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.243794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.247098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.265613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3b2f-7ca1-49f5-9dd1-b7c2bcd0a67b tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.376933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.379801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.379801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.379801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.380174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.382303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d4b0-fff0-434e-b5a7-0f7eb70cc8d2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.383894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539578-b011-4c9e-a01b-76e9d367cec1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.384692 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1272/2526] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:52 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:52.387004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.387386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.387756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.400557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.401756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.402040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.402332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.403864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.411947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:52.414286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.416711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.487093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1255/2527] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:58:52 2021] GET /identity/v3/projects => generated 8086 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:52.489266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.493719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.585809 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1273/2528] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:52.586435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.617442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5971-dc95-4abc-a0b3-7ff83110d02f tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.618950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864473dd-c4d3-469f-b671-ef96d41855c7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.632425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.633322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.633603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.633876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] PATH_INFO: `/v3/projects/0391c5d9da1e437496283aac6a524a63` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.638051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0391c5d9da1e437496283aac6a524a63)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.640121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.640290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.642991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.643294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.647696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.648597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1166679060) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:52.648945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.660679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:52.689558 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1274/2529] 10.222.0.13 () {58 vars in 1231 bytes} [Wed Nov 10 03:58:52 2021] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1166679060 => generated 537 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:52.689558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.691732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.747710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0391c5d9da1e437496283aac6a524a63', 'request_id': 'req-1085c6e6-62a2-4c1c-a702-ec71517ba190'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.758575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0391c5d9da1e437496283aac6a524a63', 'request_id': 'req-1085c6e6-62a2-4c1c-a702-ec71517ba190'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.771314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0391c5d9da1e437496283aac6a524a63', 'request_id': 'req-1085c6e6-62a2-4c1c-a702-ec71517ba190'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.795745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] The token cache is being invalidate because project 0391c5d9da1e437496283aac6a524a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:52.796089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.796735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:52.798305 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1256/2530] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:52 2021] DELETE /identity/v3/projects/0391c5d9da1e437496283aac6a524a63 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:52.799074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:52.806698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.846486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9f36-e7e3-4e85-a73f-543fdb8ab8b0 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.937593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.938324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.938618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.938959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.941064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:52.956956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c6e6-62a2-4c1c-a702-ec71517ba190 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:52.974114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '595cc753e8ca4e5da75827502f5de525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf5f48eebb8f47bdbe999891951de990', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:52.974999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:52.975280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:52.975555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] PATH_INFO: `/v3/projects/eb88486ddbb64f78ae964b0eafb9eba4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:52.985922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb88486ddbb64f78ae964b0eafb9eba4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:52.995644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.061420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:53.064000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02def33-f13b-423a-a9a8-b1b9307793ac service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.082958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1275/2531] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:53.087023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0037-febe-4ba8-8367-82e081824e29 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.089784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0037-febe-4ba8-8367-82e081824e29 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.090084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0037-febe-4ba8-8367-82e081824e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.094599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb88486ddbb64f78ae964b0eafb9eba4', 'request_id': 'req-1d1db636-616e-4c42-a758-ba79cccbaa43'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.111077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb88486ddbb64f78ae964b0eafb9eba4', 'request_id': 'req-1d1db636-616e-4c42-a758-ba79cccbaa43'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.125682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb88486ddbb64f78ae964b0eafb9eba4', 'request_id': 'req-1d1db636-616e-4c42-a758-ba79cccbaa43'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.148379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d46f0037-febe-4ba8-8367-82e081824e29 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:53.153423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] The token cache is being invalidate because project eb88486ddbb64f78ae964b0eafb9eba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:53.155889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.155996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d46f0037-febe-4ba8-8367-82e081824e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.159575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.174915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1257/2532] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:52 2021] DELETE /identity/v3/projects/eb88486ddbb64f78ae964b0eafb9eba4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:53.180682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.183392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.339814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1276/2533] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:53.342053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1a83-649d-409e-b3e9-9c2e1f5b6dfc None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.342435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1a83-649d-409e-b3e9-9c2e1f5b6dfc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.342718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1a83-649d-409e-b3e9-9c2e1f5b6dfc None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.344669 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1277/2534] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:53.350790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.351309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.354878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.372083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db636-616e-4c42-a758-ba79cccbaa43 tempest-ListProjectsStaticTestJSON-2056668121 tempest-ListProjectsStaticTestJSON-2056668121-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:53.383108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:53.383108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.383108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.383108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] PATH_INFO: `/v3/users/69ee674a5d764279adb33f278ac331af` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.383570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ee674a5d764279adb33f278ac331af)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:53.383570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.413239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:53.414622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.427622 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1278/2535] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:53.428952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:53.430670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.488517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ee674a5d764279adb33f278ac331af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.506919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ee674a5d764279adb33f278ac331af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.509616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ee674a5d764279adb33f278ac331af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.527125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ee674a5d764279adb33f278ac331af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.539684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ee674a5d764279adb33f278ac331af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:53.556759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1258/2536] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:53 2021] DELETE /identity/v3/users/69ee674a5d764279adb33f278ac331af => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:53.556759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.559714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.559920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.574706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.675255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458cff-2869-43e2-a9e2-3ec109aee7c1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:53.692453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:53.693716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.694238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.695020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.696298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:53.697107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:53.701396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f3b7-e630-4e5c-b8e7-1b78dff5218c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.721470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1259/2537] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:53.724280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.724889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.725541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.732899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc273a6-b2c8-4641-995d-dcdc1529c7a9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:53.747723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:53.751310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:53.769948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1260/2538] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:53.771144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.786525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66cc4-c21f-4e40-bad0-743d949ee755 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:53.805147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:53.806130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.806631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.807063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.808653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:53.811849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.872386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:53.873821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:53.874222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:53.874609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:53.876062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:53.878976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:53.891333 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1279/2539] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:53 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:53.891333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.891955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1261/2540] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:53 2021] POST /identity/v3/projects => generated 395 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:53.895078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:53.899973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.138141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294662a-3186-486d-a8ae-35b8139e2cf2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.146821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.147551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.147904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.148180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.149136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.154632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47996-259c-42df-bf5a-529318832b94 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.178366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8de3c-0b4e-4172-bf7c-62ca029a54b8 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.218718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1262/2541] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:53 2021] POST /identity/v3/users => generated 298 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:54.229113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cd7f-dd0e-432e-b3ca-6614bf1ebd99 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.235550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cd7f-dd0e-432e-b3ca-6614bf1ebd99 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.237700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cd7f-dd0e-432e-b3ca-6614bf1ebd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.274315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9607cd7f-dd0e-432e-b3ca-6614bf1ebd99 None None] MFA Rules not processed for user `474556e313c74ae98e8ce7c628d64ede`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:54.275820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9607cd7f-dd0e-432e-b3ca-6614bf1ebd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.301178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.301833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.302113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.302457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.318211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.319150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.336202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1280/2542] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:54.337479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.339917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.358460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d2b-a1ab-42c0-aee2-e87d2480b62c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.369546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.371983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.372246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.372882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] PATH_INFO: `/v3/projects/24ad1ba6fa5d4499b822779bd61d165e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.375313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ad1ba6fa5d4499b822779bd61d165e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.376902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.382477 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1263/2543] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:54.389483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748bdc-7aec-4226-a5a3-025a21776055 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.389483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748bdc-7aec-4226-a5a3-025a21776055 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.389837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748bdc-7aec-4226-a5a3-025a21776055 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.397974 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1264/2544] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:58:54 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:54.398914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748bdc-7aec-4226-a5a3-025a21776055 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.432159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748bdc-7aec-4226-a5a3-025a21776055 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.472295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ad1ba6fa5d4499b822779bd61d165e', 'request_id': 'req-f3c8970e-a0c3-45ab-99f8-153132610c74'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.488055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ad1ba6fa5d4499b822779bd61d165e', 'request_id': 'req-f3c8970e-a0c3-45ab-99f8-153132610c74'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.501746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ad1ba6fa5d4499b822779bd61d165e', 'request_id': 'req-f3c8970e-a0c3-45ab-99f8-153132610c74'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.531722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] The token cache is being invalidate because project 24ad1ba6fa5d4499b822779bd61d165e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:54.532029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.536168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f3c8970e-a0c3-45ab-99f8-153132610c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.540681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1281/2545] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:54 2021] DELETE /identity/v3/projects/24ad1ba6fa5d4499b822779bd61d165e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:54.540681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.540681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.540681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.587278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:54.589310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.608494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.609210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.609498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.609882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.611012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.613015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.647427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1265/2546] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:54.650350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.656116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.694685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704533-de05-4d13-9fd9-f4ff67780b44 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.712807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.715630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.715906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.717033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] PATH_INFO: `/v3/users/57c9afaa7f7743129107c58c52e67a7b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.719839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c9afaa7f7743129107c58c52e67a7b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.722286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.743232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1282/2547] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:58:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:54.746021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.750530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.784184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf823d-48c8-4eba-8012-08bf0070c217 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.795452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.796509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.796705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.797012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.797779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.799511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.846694 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1283/2548] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:54.846994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c9afaa7f7743129107c58c52e67a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.847768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.850706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:54.870633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c9afaa7f7743129107c58c52e67a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.871693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c9afaa7f7743129107c58c52e67a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.873792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d9ab-8c2e-49a0-b285-054e8e661f55 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.882526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.883912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.884196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.884467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.895755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c9afaa7f7743129107c58c52e67a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.897391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:54.900876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:54.922583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1284/2549] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:54.923424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:54.938882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bed6eda-0fe9-454b-84a7-83919301fea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c9afaa7f7743129107c58c52e67a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:54.941934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562cbba-0565-46b5-bcd8-1c03fd7cef2a service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:54.954582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:54.957320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:54.959800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:54.960928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] PATH_INFO: `/v3/projects/9292c0220abe4d6f9cda1353a3310caa/users/5d35eeeaaf7941fd856b675d50a33265/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:54.967663 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1266/2550] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:54 2021] DELETE /identity/v3/users/57c9afaa7f7743129107c58c52e67a7b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:55.017550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9292c0220abe4d6f9cda1353a3310caa, user_id=5d35eeeaaf7941fd856b675d50a33265, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:55.020887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:55.061034 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1285/2551] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:54 2021] PUT /identity/v3/projects/9292c0220abe4d6f9cda1353a3310caa/users/5d35eeeaaf7941fd856b675d50a33265/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:55.072774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:55.073587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:55.073935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:55.118351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] MFA Rules not processed for user `5d35eeeaaf7941fd856b675d50a33265`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:55.120241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.223436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1267/2552] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:55 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:55.256445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:55.258794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.283991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:55.285442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.443087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f410-897f-4038-b955-dbb97b5d6612 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:55.452845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:55.453992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:55.454931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e78c-492c-4839-998f-628a75d94861 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:55.455742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:55.455934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:55.458620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.470592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:55.471621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:55.471908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:55.472187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] PATH_INFO: `/v3/projects/d0229e420606423d8ece152b1f103974` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:55.474144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0229e420606423d8ece152b1f103974)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:55.480185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:55.493506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:55.500635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:55.516916 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1268/2553] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:55.599991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0229e420606423d8ece152b1f103974', 'request_id': 'req-af74a0c5-c3c8-444f-bf74-76274d1781fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.608792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0229e420606423d8ece152b1f103974', 'request_id': 'req-af74a0c5-c3c8-444f-bf74-76274d1781fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.631236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0229e420606423d8ece152b1f103974', 'request_id': 'req-af74a0c5-c3c8-444f-bf74-76274d1781fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.669877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] The token cache is being invalidate because project d0229e420606423d8ece152b1f103974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:55.670167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.676490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.678746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1286/2554] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:55 2021] DELETE /identity/v3/projects/d0229e420606423d8ece152b1f103974 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:55.683845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:55.703966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d443-b121-4894-a031-abb9cdc52334 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:55.739044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:55.740536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.844834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:55.846350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:55.846350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:55.846803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] PATH_INFO: `/v3/users/595cc753e8ca4e5da75827502f5de525` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:55.851893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595cc753e8ca4e5da75827502f5de525)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:55.862602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:55.934860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595cc753e8ca4e5da75827502f5de525'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.949175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595cc753e8ca4e5da75827502f5de525'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.950286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595cc753e8ca4e5da75827502f5de525'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:55.970013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74a0c5-c3c8-444f-bf74-76274d1781fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:55.976422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:55.977310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:55.977747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:55.978205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:55.984358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:55.985890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595cc753e8ca4e5da75827502f5de525'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.003161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595cc753e8ca4e5da75827502f5de525'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.016972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1269/2555] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:55 2021] DELETE /identity/v3/users/595cc753e8ca4e5da75827502f5de525 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:56.016972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:56.029230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.101947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.103627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb39c-3f5a-4ed7-9e57-31f659d10e97 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.123573 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1287/2556] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:55 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:58:56.193817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3191e-8d2b-4aa2-874a-e2ccddde3032 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.194135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3191e-8d2b-4aa2-874a-e2ccddde3032 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.194375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3191e-8d2b-4aa2-874a-e2ccddde3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.255258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a26ea-6c9a-4657-bde5-ce3370513f89 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:56.271971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:56.276626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.277302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.278121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] PATH_INFO: `/v3/projects/f101603cd1a34ab788746ffd77bbd39c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.278454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dec3191e-8d2b-4aa2-874a-e2ccddde3032 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:56.279678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dec3191e-8d2b-4aa2-874a-e2ccddde3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.282073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f101603cd1a34ab788746ffd77bbd39c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.286370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.439580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f101603cd1a34ab788746ffd77bbd39c', 'request_id': 'req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.461803 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1288/2557] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:58:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:56.463574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.463574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.463574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.466858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f101603cd1a34ab788746ffd77bbd39c', 'request_id': 'req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.476678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1289/2558] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:56 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:56.477551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:56.481397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.489694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f101603cd1a34ab788746ffd77bbd39c', 'request_id': 'req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.513484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] The token cache is being invalidate because project f101603cd1a34ab788746ffd77bbd39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:56.514405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.515080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:56.523199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1270/2559] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:56 2021] DELETE /identity/v3/projects/f101603cd1a34ab788746ffd77bbd39c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:56.523199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:56.523199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.615743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:56.617565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.624943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6e23-cf23-46a6-b167-1bbe1f0477b2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:56.647089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:56.649797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.650078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.650352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.663179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.701304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218e7d-4d7b-40a2-ae15-a017d3f4ff02 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:56.706454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:56.707609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.707897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.708170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.709616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.710425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.711657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bbc59-8cca-4941-ba49-d211600c27bf tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.713701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1290/2560] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:56 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:56.715149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4047c-93a7-418b-9a94-62a5c0af7ad3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.715432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4047c-93a7-418b-9a94-62a5c0af7ad3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.715709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4047c-93a7-418b-9a94-62a5c0af7ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.723201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.744127 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1271/2561] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:56.751979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-46d4047c-93a7-418b-9a94-62a5c0af7ad3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:56.753532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-46d4047c-93a7-418b-9a94-62a5c0af7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.774987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:56.778588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.881087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1291/2562] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:56.896696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.896985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.897261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.914965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bca0b-25fb-431c-a5cd-42eb5d4393d5 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:56.921644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:56.921857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:56.922967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.923230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:56.923506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.924378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] PATH_INFO: `/v3/projects/bf5f48eebb8f47bdbe999891951de990` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.926114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5f48eebb8f47bdbe999891951de990)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.930205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.939619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1292/2563] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:56.940902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:56.953625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1178ee-c0c4-45db-a552-f1ded0f30d39 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:56.959762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:56.960602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:56.961021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:56.961397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:56.962907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:56.963551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:56.965788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:56.981138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1293/2564] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:56.989000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.001184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5f48eebb8f47bdbe999891951de990', 'request_id': 'req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:57.007068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95dcad-d4e2-48c2-8c95-b0203152f282 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.008885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5f48eebb8f47bdbe999891951de990', 'request_id': 'req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:57.024364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5f48eebb8f47bdbe999891951de990', 'request_id': 'req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:57.052542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] The token cache is being invalidate because project bf5f48eebb8f47bdbe999891951de990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:58:57.053008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:57.053846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd8e8216-eb7a-439b-ac69-cd7d6e2070fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:57.061163 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1272/2565] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:56 2021] DELETE /identity/v3/projects/bf5f48eebb8f47bdbe999891951de990 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:57.062743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0bf02-831f-466c-8bb0-63bcb18660db None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.063135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0bf02-831f-466c-8bb0-63bcb18660db None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.063512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0bf02-831f-466c-8bb0-63bcb18660db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.096918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b7c0bf02-831f-466c-8bb0-63bcb18660db None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:57.098389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b7c0bf02-831f-466c-8bb0-63bcb18660db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.157094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.158176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.159220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.160053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.161466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.166148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.227882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1294/2566] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:56 2021] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:57.229911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.232714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.238106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1273/2567] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:57.246734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.247152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.247533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.268582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:57.269989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.317552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493ab7-a674-4ab0-8436-9e4f83b86689 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.343503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.343670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.343915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.344137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.345147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.347980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.372844 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1274/2568] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:58:57.377744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.387336 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1295/2569] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:57.391752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.402058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41254f1d-2255-4a35-b14e-e91055838fe5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.409566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369148-28a0-457a-b65d-7f3e1e2a648f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.412917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.413030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.413202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.413463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.414678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:58:57.414983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.416575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.423592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.424234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.424574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.424872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.425854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.429795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.442622 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1275/2570] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:57.446669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.450998 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1296/2571] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:58:57.457620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.473677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9965c-4cc4-4042-9c82-1cd5dd63de6a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.475075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597d409-efdb-43e0-9726-74071e994527 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.482119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.483118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.484036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.484459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.485576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.487600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596413-fa7c-45ef-90ac-2296acffc1be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.493715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.494497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.494776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.495127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.496001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.498556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.501889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1297/2572] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:57.503640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a80b-32ca-4aaf-beb0-705cedbad062 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.505000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a80b-32ca-4aaf-beb0-705cedbad062 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.505464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a80b-32ca-4aaf-beb0-705cedbad062 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.507711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1298/2573] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:57.508557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a80b-32ca-4aaf-beb0-705cedbad062 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.524230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a80b-32ca-4aaf-beb0-705cedbad062 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.530824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.532168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.532683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.533376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] PATH_INFO: `/v3/projects/a5ed7dce06584ab79a7dcbe1e5b27dc3/users/0620c1e55c3e4dadaa37890c7951e274/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.555710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ed7dce06584ab79a7dcbe1e5b27dc3, user_id=0620c1e55c3e4dadaa37890c7951e274, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.559898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.560346 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1276/2574] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:57.561338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:57.564955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.581873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1299/2575] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:57 2021] PUT /identity/v3/projects/a5ed7dce06584ab79a7dcbe1e5b27dc3/users/0620c1e55c3e4dadaa37890c7951e274/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:57.582946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.685756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeba09a-280c-4846-9820-ae6502b8ef0c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.690831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.691857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.691857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.692088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.693116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.695059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4fef-8b68-459c-b2d9-fc217497e2da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.697365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.698761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.721734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1300/2576] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:57.723632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.724023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.724502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.760960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:57.762498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:57.783173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166b4e1-89e8-4138-bb98-9428d8f3a294 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.877612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.878857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1301/2577] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:57.879740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.879966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.884978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.886968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.889096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.891194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067d99-6a32-4290-a13f-6c71f6a67b3b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.891811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.897098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.897770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.898049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.898316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.899245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.900778 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1277/2578] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:57.900889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.902662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.922075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b563-9a2b-40df-ab27-99dd4989fc23 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.925299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1302/2579] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:57.928476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:57.931763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.932723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.933165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.933501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.934384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.936702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.950295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee087-37dc-4ba9-a279-76bec8f49b51 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:57.956185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:57.957262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:57.957651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:57.958021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:57.958862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:57.962381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:57.986895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1278/2580] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:57.988061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.001195 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1303/2581] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:58.005085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.019455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649feeca-ee04-4c11-b99b-91b4f615f49f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.076512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f472b-ebfe-45f9-a77a-2bdb3484000f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.082618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.083533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.083930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.084223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.085099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.085231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.086074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.086360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.087355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] PATH_INFO: `/v3/projects/d5c4a3d627b64a60b0e21c94c8b62be1/users/059cf2766b4e4dd9bd35a8b79cb5920a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.087828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b9768-1d09-44e2-adf8-0bc097c40ba2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.107500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c4a3d627b64a60b0e21c94c8b62be1, user_id=059cf2766b4e4dd9bd35a8b79cb5920a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.111890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.115967 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1279/2582] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:57 2021] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:58.118326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639017bd-05ec-49a3-b12f-b2b7328a6553 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.119045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639017bd-05ec-49a3-b12f-b2b7328a6553 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.120746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639017bd-05ec-49a3-b12f-b2b7328a6553 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.125515 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1280/2583] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:58 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:58.126326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639017bd-05ec-49a3-b12f-b2b7328a6553 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.141311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1304/2584] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:58 2021] PUT /identity/v3/projects/d5c4a3d627b64a60b0e21c94c8b62be1/users/059cf2766b4e4dd9bd35a8b79cb5920a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:58.142392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:58.158837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639017bd-05ec-49a3-b12f-b2b7328a6553 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.242038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.259543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.261598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.262270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.262557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.264864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.266808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99069f7-787d-4e98-aaae-d070a2335462 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.287174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1281/2585] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:58.288705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.288996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.289272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.322376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] MFA Rules not processed for user `059cf2766b4e4dd9bd35a8b79cb5920a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:58.333411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.387106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434c39-a9a9-438a-84d6-6c28d598b473 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.394050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.395328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.395949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.396526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.401000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.403757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.406167 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1305/2586] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:58 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:58.407692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.419161 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1282/2587] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:58.422504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d661-826d-4c58-a1ed-0e223768f0e2 tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.423624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.428020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.429235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.429588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.430671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] PATH_INFO: `/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e/users/72da726789b54cddba470e3050054d43/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.435559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8c2db-9931-4f57-92fe-56e60396b823 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.440510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.441286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.441639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.442023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.442798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.445321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.451682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71435cce1a1f43cfb13115ccdb6f8f1e, user_id=72da726789b54cddba470e3050054d43, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.454753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.482353 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1283/2588] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:58.486177 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1306/2589] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:58 2021] PUT /identity/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e/users/72da726789b54cddba470e3050054d43/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:58.497140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.500158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.580685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d8a1-7ddd-46fd-9280-25cdc0c0b239 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.607194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137858-363a-4388-a586-e67bcd6821d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.626065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.626748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.627028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.627297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.628022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.629993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39407-87af-4ad7-b1c2-94f29207279d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.654902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.657324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.657324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.657324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.657701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.659358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.669898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1284/2590] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:58.671468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.671823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.672165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.677155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1307/2591] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:58.677155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.678898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.692248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c811b-8ce4-4ed3-9cb3-172c64d82ddf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.695687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] MFA Rules not processed for user `474556e313c74ae98e8ce7c628d64ede`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:58.697295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.697489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.698465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.698814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.699157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] PATH_INFO: `/v3/users/5d35eeeaaf7941fd856b675d50a33265` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.700452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d35eeeaaf7941fd856b675d50a33265)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.702467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.756157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d35eeeaaf7941fd856b675d50a33265'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:58.757307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1285/2592] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:58.758600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.769414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be1e8c-53f6-47ff-a3af-15b2a95808ac None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.772281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d35eeeaaf7941fd856b675d50a33265'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:58.773032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d35eeeaaf7941fd856b675d50a33265'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:58.776569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.777273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.777552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.777733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d35eeeaaf7941fd856b675d50a33265'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:58.777838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.778571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.780221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.788642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d35eeeaaf7941fd856b675d50a33265'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:58:58.794120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1286/2593] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:58.795457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.798287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.816539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45e4d-d7f9-4e9f-946d-925b3fe5251e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.819286 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1308/2594] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:58:58 2021] DELETE /identity/v3/users/5d35eeeaaf7941fd856b675d50a33265 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:58.820197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:58.822010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.826659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.830785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.830785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.830785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] PATH_INFO: `/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e/users/72da726789b54cddba470e3050054d43/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.830785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71435cce1a1f43cfb13115ccdb6f8f1e, user_id=72da726789b54cddba470e3050054d43, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:58.834325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6cd2-8e20-44fb-b94e-35faf307f5a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:58.866097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1287/2595] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:58 2021] PUT /identity/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e/users/72da726789b54cddba470e3050054d43/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:58.867478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a654-ba24-4887-91d5-0d4d9df33150 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.867771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a654-ba24-4887-91d5-0d4d9df33150 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.868041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a654-ba24-4887-91d5-0d4d9df33150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.890482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9515a654-ba24-4887-91d5-0d4d9df33150 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:58.893174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9515a654-ba24-4887-91d5-0d4d9df33150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:58.925984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3ee5-2556-44f4-ba87-1511b3533afa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:58.983828 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1288/2596] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:58.986274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.986561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:58.986840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:58.997960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:58.998923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:58.999538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.000155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] PATH_INFO: `/v3/projects/fe46870dfeb341289bae1956363c0f74/users/aeaa1440ac79454c9e4462376bfb003e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.017522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe46870dfeb341289bae1956363c0f74, user_id=aeaa1440ac79454c9e4462376bfb003e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.020648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.024483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] MFA Rules not processed for user `72da726789b54cddba470e3050054d43`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:59.026600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.060331 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1309/2597] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:58 2021] PUT /identity/v3/projects/fe46870dfeb341289bae1956363c0f74/users/aeaa1440ac79454c9e4462376bfb003e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:59.061700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.063899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.131252 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1289/2598] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:58 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:59.132138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.146330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393e30f-4035-4ce0-af6e-108b88a0ee5d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.149443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f690-a026-4e4c-9f74-a1bc1500e420 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.155213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.155905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.156322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.156595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.236063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.237693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9401-4511-4faf-a188-525dbc67bd73 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.238652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.239326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.239603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.239879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.240636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.242239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.251228 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1310/2599] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:59.252796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66451-5343-4bfa-8a58-8b3640936f5c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.253148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66451-5343-4bfa-8a58-8b3640936f5c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.253854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66451-5343-4bfa-8a58-8b3640936f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.256598 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1290/2600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:58:59 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:58:59.261176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.282784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c6f66451-5343-4bfa-8a58-8b3640936f5c None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:59.284036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c6f66451-5343-4bfa-8a58-8b3640936f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.300623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ae02-d106-460f-a3ad-455510b16f7b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.314744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.318455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.320141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.320583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] PATH_INFO: `/v3/projects/fe46870dfeb341289bae1956363c0f74/users/aeaa1440ac79454c9e4462376bfb003e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.327857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe46870dfeb341289bae1956363c0f74, user_id=aeaa1440ac79454c9e4462376bfb003e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.331302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2941b7-d576-43da-866a-8bf705864979 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.348363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1291/2601] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:58:59 2021] PUT /identity/v3/projects/fe46870dfeb341289bae1956363c0f74/users/aeaa1440ac79454c9e4462376bfb003e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:58:59.358935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.359228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.359503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.390233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1311/2602] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:59.392560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.392966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.393359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.396093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1312/2603] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 03:58:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 03:58:59.398170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] MFA Rules not processed for user `aeaa1440ac79454c9e4462376bfb003e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:58:59.399848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.401020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 03:58:59.403419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.509507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.510981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.519478 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1292/2604] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:58:59.524296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.537339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f748d-f09f-4bf9-aa21-f63b7fa17582 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.544557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.545114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.545399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.545674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.547349 ncdv-817176-1 devstack@keystone.service[96285]: WARNING oslo_log.versionutils [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:58:59.548710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.550293 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:59.550293 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:58:59.550293 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:58:59.551774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.600107 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1293/2605] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/policies => generated 229 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:58:59.600107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.603149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.625882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dbc98-f1bb-4176-a2fa-2687c257592a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.627474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0d7-be15-4c41-b662-8a110523c7f6 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.631713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95860871e61144e38e812de03ccf2589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51d48b2efac84d1583fb6de9915522a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.632993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.633600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.634804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.636348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.637033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorizing `identity:get_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.637593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.637924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.638206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.639966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.640745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:58:59.643310 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1313/2606] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 03:58:59 2021] GET /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 381 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:59.644707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.667363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73a84a-8a2a-459c-b47c-6f257206f62e tempest-QuotasAdminNegativeTest-1604054535 tempest-QuotasAdminNegativeTest-1604054535-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.681560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.684007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.684699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.686553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/fd94acb652484db89a68c1401b41daf2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.689468 ncdv-817176-1 devstack@keystone.service[96284]: WARNING oslo_log.versionutils [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:58:59.698713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=fd94acb652484db89a68c1401b41daf2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.701984 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:59.701984 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:58:59.701984 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:58:59.706669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.747043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1314/2607] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 03:58:59 2021] PATCH /identity/v3/policies/fd94acb652484db89a68c1401b41daf2 => generated 236 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:59.755374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.768151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575560e8-5f9b-480f-9ce9-6d7f08d882de tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.775292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.776946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.777501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.777925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/fd94acb652484db89a68c1401b41daf2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.779072 ncdv-817176-1 devstack@keystone.service[96284]: WARNING oslo_log.versionutils [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:58:59.780210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=fd94acb652484db89a68c1401b41daf2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.781693 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:59.781693 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:58:59.781693 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:58:59.782966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.785207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.787649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.796746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1315/2608] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:58:59 2021] GET /identity/v3/policies/fd94acb652484db89a68c1401b41daf2 => generated 236 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:58:59.797816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.812111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa97f-fa03-40ed-8835-a0a09f5c7830 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.813803 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1294/2609] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:58:59 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:58:59.817120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.817977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.818258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.818535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/fd94acb652484db89a68c1401b41daf2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.820223 ncdv-817176-1 devstack@keystone.service[96284]: WARNING oslo_log.versionutils [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:58:59.820901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=fd94acb652484db89a68c1401b41daf2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.822568 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:59.822568 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:58:59.822568 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:58:59.823905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.848543 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1316/2610] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:58:59 2021] DELETE /identity/v3/policies/fd94acb652484db89a68c1401b41daf2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:58:59.855573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.874357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c118-c8d4-4485-8a6b-2f6c1482a670 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.888991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.889476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.889852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.890243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.891579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.896825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.920874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1295/2611] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/policies => generated 229 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:59.925376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.936862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569171e0-083d-41d1-9323-ad03b61584fb tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.943634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.944541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.945031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.945288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.946268 ncdv-817176-1 devstack@keystone.service[96284]: WARNING oslo_log.versionutils [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:58:59.947125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:58:59.948435 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:58:59.948435 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:58:59.948435 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:58:59.949337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:58:59.972646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1317/2612] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/policies => generated 230 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:58:59.978631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:58:59.991116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336665-837c-497b-93aa-63bc2dae6c21 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:58:59.995836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:58:59.996501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:58:59.996937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:58:59.997226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:58:59.998554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.000345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.017640 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1296/2613] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:58:59 2021] POST /identity/v3/policies => generated 230 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:00.021751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.033913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103618-4f67-448d-97c4-d282ea8c3fd7 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.041691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.044144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.044467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.046722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.048944 ncdv-817176-1 devstack@keystone.service[96284]: WARNING oslo_log.versionutils [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:59:00.051164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.055808 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_policies failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:00.055808 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:00.055808 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:00.057006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.068031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.070825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.077001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1318/2614] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:59:00 2021] GET /identity/v3/policies => generated 765 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:00.081560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.118723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb1482-822d-4847-ac8e-0a1279b7fd17 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.136476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.137602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.137952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.138341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/ef10ad3584e44d17b1d983be8e6322b9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.140446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ef10ad3584e44d17b1d983be8e6322b9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.144251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.179558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01c4c6-1454-4065-a1e4-c44529602044 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.181291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1319/2615] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/policies/ef10ad3584e44d17b1d983be8e6322b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.183223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.186174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.201373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.202253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.202525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.202798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] PATH_INFO: `/v3/projects/9292c0220abe4d6f9cda1353a3310caa` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.205733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9292c0220abe4d6f9cda1353a3310caa)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.206489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c3ed-f599-4098-b91c-1315323bc85b tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.208824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.214005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.215012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.215409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.215784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] PATH_INFO: `/v3/users/474556e313c74ae98e8ce7c628d64ede` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.217166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474556e313c74ae98e8ce7c628d64ede)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.220445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.280305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9292c0220abe4d6f9cda1353a3310caa', 'request_id': 'req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.285509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474556e313c74ae98e8ce7c628d64ede'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.289241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9292c0220abe4d6f9cda1353a3310caa', 'request_id': 'req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.294700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474556e313c74ae98e8ce7c628d64ede'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.295606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474556e313c74ae98e8ce7c628d64ede'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.296311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474556e313c74ae98e8ce7c628d64ede'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.298551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9292c0220abe4d6f9cda1353a3310caa', 'request_id': 'req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.308470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbb2ffeb-052f-4f2b-86b3-f56362c442e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474556e313c74ae98e8ce7c628d64ede'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.318885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] The token cache is being invalidate because project 9292c0220abe4d6f9cda1353a3310caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:00.319203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.319963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.323242 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1297/2616] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/projects/9292c0220abe4d6f9cda1353a3310caa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.324428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.325841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.338143 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1320/2617] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/users/474556e313c74ae98e8ce7c628d64ede => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.341193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46edbf-0c3a-40a5-8233-f0635151290c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.341193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46edbf-0c3a-40a5-8233-f0635151290c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.341193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46edbf-0c3a-40a5-8233-f0635151290c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.371790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6a46edbf-0c3a-40a5-8233-f0635151290c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:00.373693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a46edbf-0c3a-40a5-8233-f0635151290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.416143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c6ac-061c-4eaa-b4fe-f6007f895f77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.435552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1321/2618] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:00.437541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f352-a5be-46f7-97ca-970c33a899ea None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.437822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f352-a5be-46f7-97ca-970c33a899ea None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.438093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f352-a5be-46f7-97ca-970c33a899ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.458778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff37f352-a5be-46f7-97ca-970c33a899ea None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:00.459979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff37f352-a5be-46f7-97ca-970c33a899ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.468488 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1322/2619] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:00.473047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.473167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.473370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.482447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.483316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.483597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.483867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/e25ee51ebd824d17aeb4cfd12f4f9755` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.484716 ncdv-817176-1 devstack@keystone.service[96285]: WARNING oslo_log.versionutils [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 10 03:59:00.485348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e25ee51ebd824d17aeb4cfd12f4f9755)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.486625 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:00.486625 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:00.486625 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:00.487491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.492654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:00.493869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.512135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1323/2620] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:00.512135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.512135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.512454 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1298/2621] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/policies/e25ee51ebd824d17aeb4cfd12f4f9755 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.512454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.524898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b26e-4a02-45a6-8470-8cc87206b70d tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.530511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.531537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.531537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.531777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.532851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:00.533023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.534961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.553527 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1299/2622] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:00.554908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.568176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02be53-140f-4c46-9892-9a8f1ed161e9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.575474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeaa1440ac79454c9e4462376bfb003e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe46870dfeb341289bae1956363c0f74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.578024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.578024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.578024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] PATH_INFO: `/v3/policies/06ade64920ee4e03aceeae65ac3f020c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.579223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=06ade64920ee4e03aceeae65ac3f020c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.581560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.595141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac8cc-26e1-4988-b395-382b65092edb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.601064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.602001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.602128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.602450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.611761 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1300/2623] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/policies/06ade64920ee4e03aceeae65ac3f020c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.616301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.622431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.624203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.636988 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1324/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:00.637864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.653188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9513a3-502d-4aeb-91d3-37f0bd4f04b9 tempest-PoliciesTestJSON-1368888836 tempest-PoliciesTestJSON-1368888836-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.653567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.661370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.662341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.662722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.663113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.664010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.666017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9a38-0c1a-4487-8e26-c3d8a338b07b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.690911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940c0c-46fe-499a-a103-43ab0dc7d5c4 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:00.702088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:00.703793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.704177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.704526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] PATH_INFO: `/v3/users/059cf2766b4e4dd9bd35a8b79cb5920a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.706070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059cf2766b4e4dd9bd35a8b79cb5920a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:00.710457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:00.734085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1301/2625] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:00.735862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.736348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.736953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.775763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] MFA Rules not processed for user `18d81f586d0a4e8ea083ba207b9f905e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:00.777936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.815767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059cf2766b4e4dd9bd35a8b79cb5920a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.826920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059cf2766b4e4dd9bd35a8b79cb5920a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.827774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059cf2766b4e4dd9bd35a8b79cb5920a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.828491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059cf2766b4e4dd9bd35a8b79cb5920a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.841554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5eb6c056-508d-49e8-93df-1349137033a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059cf2766b4e4dd9bd35a8b79cb5920a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:00.876523 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1302/2626] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:00.877334 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1325/2627] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:00 2021] DELETE /identity/v3/users/059cf2766b4e4dd9bd35a8b79cb5920a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:00.881707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:00.881852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a84ea-125c-4925-b05e-7e33a65764d5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:00.881996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a84ea-125c-4925-b05e-7e33a65764d5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:00.882275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a84ea-125c-4925-b05e-7e33a65764d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:00.887054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.908495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c93a84ea-125c-4925-b05e-7e33a65764d5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:00.910254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c93a84ea-125c-4925-b05e-7e33a65764d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:00.987333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c67a2-cb89-4c52-9810-76a6a97c935a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.008084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1326/2628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:01.011164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.011801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.012144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.034982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] MFA Rules not processed for user `18d81f586d0a4e8ea083ba207b9f905e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:01.036302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.056410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.057490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.057835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.058231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.059780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.061083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.091575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1303/2629] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:00 2021] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:01.091575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.093254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.113005 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1327/2630] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:01.114157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.128351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd926a8-437d-446d-841e-f4df6b4edbe6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.134085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.134829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.135214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.136203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.137047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.138741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.161028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1328/2631] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:01.162031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.164781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.189931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152497a2-9f18-460f-9910-64a8e980ce3a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.199913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.201024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.201381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.201724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] PATH_INFO: `/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.204660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bb31c360eb4aff8b7e2f35c24e0605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.207166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.242689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ff27-f100-4bb6-bf27-ab3fb539b72e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.248053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.248812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.249090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.249362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.261052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.263112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.271105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bb31c360eb4aff8b7e2f35c24e0605', 'request_id': 'req-8a2eec81-5732-466d-bd99-2f3195ed02ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.279202 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1304/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:01.279880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.283997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bb31c360eb4aff8b7e2f35c24e0605', 'request_id': 'req-8a2eec81-5732-466d-bd99-2f3195ed02ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.290611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f7de9-6177-4771-ae43-f7e107eeb938 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.292879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bb31c360eb4aff8b7e2f35c24e0605', 'request_id': 'req-8a2eec81-5732-466d-bd99-2f3195ed02ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.310111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] The token cache is being invalidate because project 57bb31c360eb4aff8b7e2f35c24e0605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:01.310516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.311176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.313594 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1329/2633] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:01 2021] DELETE /identity/v3/projects/57bb31c360eb4aff8b7e2f35c24e0605 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:01.317798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.319195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.392184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.393029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.393308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.393751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.394682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.396993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.419957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1305/2634] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:01.421720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.424818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.427525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2eec81-5732-466d-bd99-2f3195ed02ce admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.435869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.437039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.437552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.438731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] PATH_INFO: `/v3/users/95860871e61144e38e812de03ccf2589` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.439287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=95860871e61144e38e812de03ccf2589)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.442185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.442677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ff5-8d85-427e-aa60-3b5596518001 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.453078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.471780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.473187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.473524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] PATH_INFO: `/v3/projects/4f733c65bb8b451582fb9a9f98c0c5ee/users/28439236f513404989b79da765cd70d9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.519277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f733c65bb8b451582fb9a9f98c0c5ee, user_id=28439236f513404989b79da765cd70d9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.522458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95860871e61144e38e812de03ccf2589'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.523369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8b93-59e5-4efb-88e8-377c1372ba39 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.540072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95860871e61144e38e812de03ccf2589'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.546293 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1306/2635] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:01 2021] PUT /identity/v3/projects/4f733c65bb8b451582fb9a9f98c0c5ee/users/28439236f513404989b79da765cd70d9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:01.546499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95860871e61144e38e812de03ccf2589'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.548560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95860871e61144e38e812de03ccf2589'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.552547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.553012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.553301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.570602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95860871e61144e38e812de03ccf2589'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.596809 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1330/2636] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:01 2021] DELETE /identity/v3/users/95860871e61144e38e812de03ccf2589 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:01.609538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:01.610861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.678777 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1307/2637] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:01.707006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.710834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.795212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a747a4-1d5d-4bc6-ab5b-9232f102f5fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.795833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:01.797757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:01.812094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.813052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.813052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.813321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.823767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c079e4-0fee-482b-a9ae-cf40a1701d4e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:01.833846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.835465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.843970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:01.845496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:01.846174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:01.847866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] PATH_INFO: `/v3/projects/d5c4a3d627b64a60b0e21c94c8b62be1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:01.848006 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1331/2638] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:01.848747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c4a3d627b64a60b0e21c94c8b62be1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:01.850883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:01.916394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c4a3d627b64a60b0e21c94c8b62be1', 'request_id': 'req-3c7192f4-c973-4fcd-a4ea-ea9531de969c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.926392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c4a3d627b64a60b0e21c94c8b62be1', 'request_id': 'req-3c7192f4-c973-4fcd-a4ea-ea9531de969c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.943166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c4a3d627b64a60b0e21c94c8b62be1', 'request_id': 'req-3c7192f4-c973-4fcd-a4ea-ea9531de969c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.984356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] The token cache is being invalidate because project d5c4a3d627b64a60b0e21c94c8b62be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:01.984762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.985812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:01.993104 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1308/2639] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:01 2021] DELETE /identity/v3/projects/d5c4a3d627b64a60b0e21c94c8b62be1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:01.993925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:02.007108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ec0c-e1e4-47f6-b678-032a072fca29 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:02.109860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:02.111083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.111438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.111981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] PATH_INFO: `/v3/users/aeaa1440ac79454c9e4462376bfb003e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.113883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeaa1440ac79454c9e4462376bfb003e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:02.121153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:02.206389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeaa1440ac79454c9e4462376bfb003e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.215483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeaa1440ac79454c9e4462376bfb003e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.216320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeaa1440ac79454c9e4462376bfb003e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.217057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeaa1440ac79454c9e4462376bfb003e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.235715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1969ac7-67d7-4781-9c04-4251a7597436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeaa1440ac79454c9e4462376bfb003e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.269009 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1332/2640] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:01 2021] DELETE /identity/v3/users/aeaa1440ac79454c9e4462376bfb003e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:02.360998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:02.364360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:02.382478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7192f4-c973-4fcd-a4ea-ea9531de969c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:02.459011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:02.459883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.460224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.460415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] PATH_INFO: `/v3/projects/51d48b2efac84d1583fb6de9915522a5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.461824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d48b2efac84d1583fb6de9915522a5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:02.464344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:02.552234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d48b2efac84d1583fb6de9915522a5', 'request_id': 'req-a34698cb-e33c-4e05-b674-e0f6134c6457'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.560258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d48b2efac84d1583fb6de9915522a5', 'request_id': 'req-a34698cb-e33c-4e05-b674-e0f6134c6457'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.568384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d48b2efac84d1583fb6de9915522a5', 'request_id': 'req-a34698cb-e33c-4e05-b674-e0f6134c6457'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.585543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] The token cache is being invalidate because project 51d48b2efac84d1583fb6de9915522a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:02.586249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.587120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a34698cb-e33c-4e05-b674-e0f6134c6457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:02.589901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1309/2641] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:02 2021] DELETE /identity/v3/projects/51d48b2efac84d1583fb6de9915522a5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:02.600463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.601021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.601823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.622218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:02.623645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:02.716264 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1333/2642] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:02.717525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.717874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.718237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.765606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:02.769024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:02.787059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:02.787767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1310/2643] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:02.797066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f0051-11ab-42dc-935a-c047932adf12 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:02.809039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:02.809725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.810007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.810281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.811101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:02.811407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:02.813070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:02.836424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1334/2644] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:02.837217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:02.849880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7eb3f-6ba2-46bb-8531-d32179367bb1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:02.855456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:02.855875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.856162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.856427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.857169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:02.859966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:02.895818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1311/2645] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:02 2021] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:02.899772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:02.911739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2e9a-3363-4ec1-b098-0ba420c2ad01 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:02.987626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:02.989367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:02.989367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:02.989367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:02.989798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:02.992343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.027355 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1335/2646] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:02 2021] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:03.031029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.054780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21445-d82f-438e-9f20-7e5dd7e69fe5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:03.060909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:03.061584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.061872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.062146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.062912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:03.064590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.079761 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1312/2647] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:03 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:03.081047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.091968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d3ffd-e19f-466f-8686-fc913e513e13 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:03.098511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:03.099357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.099644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.099915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.100725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:03.103890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee4d3c-5c6a-4e9c-beca-1ff37828a4d6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.116712 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1336/2648] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:59:03.121816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.136632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1822b29-969a-4b95-b305-6d4466b030f6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:03.142168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:03.143023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.143835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.144241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] PATH_INFO: `/v3/projects/1c202747bc3044aebec5343fecc84bf0/users/bc84bf23e73e4a79845afd2d87e4ff8f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.169852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c202747bc3044aebec5343fecc84bf0, user_id=bc84bf23e73e4a79845afd2d87e4ff8f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:03.174208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.192526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1313/2649] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:03 2021] PUT /identity/v3/projects/1c202747bc3044aebec5343fecc84bf0/users/bc84bf23e73e4a79845afd2d87e4ff8f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:03.203542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.203828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.204116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.234740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] MFA Rules not processed for user `bc84bf23e73e4a79845afd2d87e4ff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:03.235940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.320507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1337/2650] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:03 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:03.333430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.335120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.420213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f6ca-ea36-47b9-91e3-cd97fd387f8b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:03.426367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:03.427113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.427556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.427844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.438641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:03.440271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e3bac-1170-46c4-98b6-382e6a1288f7 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.454386 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1314/2651] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:03 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:03.539564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.542107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.647364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071603b-61cf-4523-b355-034f467b0eb2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:03.653315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:03.654231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.654563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.654838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] PATH_INFO: `/v3/projects/fe46870dfeb341289bae1956363c0f74` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.656212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe46870dfeb341289bae1956363c0f74)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:03.659472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:03.713912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe46870dfeb341289bae1956363c0f74', 'request_id': 'req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:03.722514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe46870dfeb341289bae1956363c0f74', 'request_id': 'req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:03.734192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe46870dfeb341289bae1956363c0f74', 'request_id': 'req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:03.750007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] The token cache is being invalidate because project fe46870dfeb341289bae1956363c0f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:03.751181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:03.751790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c66008e0-5f18-4ef3-a4f2-6c9dfb7fd745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:03.754463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1338/2652] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:03 2021] DELETE /identity/v3/projects/fe46870dfeb341289bae1956363c0f74 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:03.762271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71199ba-59be-4424-8d58-52bef818dc07 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.762645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71199ba-59be-4424-8d58-52bef818dc07 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.762933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71199ba-59be-4424-8d58-52bef818dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.794355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.794881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.795308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.799730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f71199ba-59be-4424-8d58-52bef818dc07 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:03.808018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f71199ba-59be-4424-8d58-52bef818dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.853469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] MFA Rules not processed for user `28439236f513404989b79da765cd70d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:03.855475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.941084 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1315/2653] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:03.949209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebeb2-82af-4565-9963-5d8e418dd637 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:03.949491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebeb2-82af-4565-9963-5d8e418dd637 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:03.949769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebeb2-82af-4565-9963-5d8e418dd637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:03.983660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1339/2654] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:03 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:03.984817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:03.986769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:03.988406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-66bebeb2-82af-4565-9963-5d8e418dd637 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:03.991320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66bebeb2-82af-4565-9963-5d8e418dd637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.006999 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1316/2655] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:04.009471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.010994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.011824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.026627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5accc04-e89a-47a1-911d-1f956bcf987b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.032894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.033982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.037107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.037415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] PATH_INFO: `/v3/users/bc84bf23e73e4a79845afd2d87e4ff8f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.050659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc84bf23e73e4a79845afd2d87e4ff8f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.056384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.078038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] MFA Rules not processed for user `28439236f513404989b79da765cd70d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:04.081201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.100167 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1317/2656] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:04.101223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.113568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450982c-38a3-4691-a41c-0e4b64264c64 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.122827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.123622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.124227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.124600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.125704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:04.126086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.129623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.147315 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1318/2657] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:04.152289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.166551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523110-0197-48ea-9774-013bddb87550 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.172409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.173131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.173409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.173678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.174388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.175185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc84bf23e73e4a79845afd2d87e4ff8f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:04.176812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.184415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc84bf23e73e4a79845afd2d87e4ff8f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:04.185181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc84bf23e73e4a79845afd2d87e4ff8f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:04.185808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc84bf23e73e4a79845afd2d87e4ff8f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:04.205768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ab7e90e-9250-47ca-aa88-4b21e47970ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc84bf23e73e4a79845afd2d87e4ff8f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:04.219258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1319/2658] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:04.223879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.227469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.238056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1340/2659] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:03 2021] DELETE /identity/v3/users/bc84bf23e73e4a79845afd2d87e4ff8f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:04.239753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.240207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.241027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.265343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:04.266686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.337673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d6200-7230-435c-9c42-db3b20ef5855 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.361207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1341/2660] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:04.374071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.376128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.428921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.428921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.428921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.428921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.429731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.431518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.456066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563520-6ee6-4fa8-9594-5b1501295078 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.457052 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1320/2661] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:04.457807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.460540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.464026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.464901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.466099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.466099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.478041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.479501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.489296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1342/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:04.489921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.510882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e0e8-b905-4f25-837c-dd4ac440dacb service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.516208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.517274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.518471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.518749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.519917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.523151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.540668 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1343/2663] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:04 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:04.542784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.562194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3133544-9c08-40bc-8859-cffacf2d66cb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.567768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae525ae-51df-4c47-b784-58d0cc0aff07 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.570809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.571616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.572277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.572681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.575722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.578881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.579914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.580647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.581066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.581977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.585460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.613074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1344/2664] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:04 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:04.614114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.625830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252688e4-b1cf-47cd-a735-3f6b27b5f96e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.630898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.631836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.632115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.632383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] PATH_INFO: `/v3/projects/2dd9f3992f314dbab5e91d15af7efac7/users/4b99a26c9fbc4a72bad408d446e26c99/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.649813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd9f3992f314dbab5e91d15af7efac7, user_id=4b99a26c9fbc4a72bad408d446e26c99, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.652653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c8b4-e2e0-4b01-8188-5242f466708d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.670754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.672416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.677079 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1345/2665] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:04 2021] PUT /identity/v3/projects/2dd9f3992f314dbab5e91d15af7efac7/users/4b99a26c9fbc4a72bad408d446e26c99/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:04.685899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1321/2666] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:04 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:04.689329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.689619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.690082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.726764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] MFA Rules not processed for user `4b99a26c9fbc4a72bad408d446e26c99`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:04.728173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:04.798044 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1346/2667] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:04.805370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.819913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b3c7-51e7-4a13-a2d8-9a5460d37eec service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:04.884474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:04.885196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:04.885480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:04.885754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:04.886473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:04.888358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:04.928305 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1322/2668] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:04.932739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:04.948173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03303eb4-5bd4-4e0a-8295-c3579abbad5b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.016485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.017218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.017498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.017770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.018499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.020433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.059377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1347/2669] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:04 2021] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:05.063118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.074568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5ac8-3b5f-4854-ae5b-8dd63c62489c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.079882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.080982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.081325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.081691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.082519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.084222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.100352 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1323/2670] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:05.101925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.115902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f9b1-72e8-418e-833a-de2f325fd6a4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.132318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.133806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.133806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.133989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] PATH_INFO: `/v3/projects/e0b609fe90764329aca628682cb7f223/users/5db7795cfc794ed3a240c7aa3893ee87/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.153568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b609fe90764329aca628682cb7f223, user_id=5db7795cfc794ed3a240c7aa3893ee87, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.156449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.179635 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1348/2671] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:05 2021] PUT /identity/v3/projects/e0b609fe90764329aca628682cb7f223/users/5db7795cfc794ed3a240c7aa3893ee87/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:05.184747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.196157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3dcb-9e32-448c-a253-425c6593d041 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.271943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.272797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.273077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.273383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.274343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.276746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1cd11-716f-42ea-9268-2ed7dfbddfb0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.288447 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1324/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:05.292853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.308133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2760d-2ce4-493c-ae64-5fddb5970ac9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.314760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.317026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.317376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.318112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] PATH_INFO: `/v3/projects/e0b609fe90764329aca628682cb7f223/users/5db7795cfc794ed3a240c7aa3893ee87/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.321036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b609fe90764329aca628682cb7f223, user_id=5db7795cfc794ed3a240c7aa3893ee87, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.324975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.339189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1349/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:05 2021] PUT /identity/v3/projects/e0b609fe90764329aca628682cb7f223/users/5db7795cfc794ed3a240c7aa3893ee87/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:05.349916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.350392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.350669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.369736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.375749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:05.409087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] MFA Rules not processed for user `5db7795cfc794ed3a240c7aa3893ee87`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:05.410312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:05.510929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da872def-4d37-420f-b87f-4af01628218a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.521472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.522345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.522623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.522895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] PATH_INFO: `/v3/projects/1c202747bc3044aebec5343fecc84bf0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.527253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c202747bc3044aebec5343fecc84bf0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.529550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.557698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1325/2674] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:05 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:05.558930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.593011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988bda-5e7a-48c1-a747-a1be25adb55e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.608850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.609520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.610179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.610179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.610744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.612574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.631544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c202747bc3044aebec5343fecc84bf0', 'request_id': 'req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:05.641458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c202747bc3044aebec5343fecc84bf0', 'request_id': 'req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:05.675981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c202747bc3044aebec5343fecc84bf0', 'request_id': 'req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:05.692208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1326/2675] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:05 2021] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:05.695876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.725211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] The token cache is being invalidate because project 1c202747bc3044aebec5343fecc84bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:05.726091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:05.726933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de2a29fa-d40a-4016-8e6b-05f63c3c0a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:05.736221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1350/2676] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:05 2021] DELETE /identity/v3/projects/1c202747bc3044aebec5343fecc84bf0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:05.739077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a864-985e-420f-b085-be451974865e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.739077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a864-985e-420f-b085-be451974865e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.739077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a864-985e-420f-b085-be451974865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.767214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f7b9a864-985e-420f-b085-be451974865e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:05.769264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f7b9a864-985e-420f-b085-be451974865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:05.908054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e9e7-bbea-4849-9a25-68c402e9677e tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:05.925844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:05.925844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.925844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.926239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.926239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:05.926239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:05.927481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1351/2677] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:05.929141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:05.931533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:05.931963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:05.977001 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1327/2678] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:05 2021] POST /identity/v3/users => generated 416 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:05.978247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:05.984126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:05.997609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:06.006874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.015647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654f513-66ea-4080-abff-be31d662962a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.023059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.024140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.025156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.026177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/users/21eaa096396e437aa72d4260935405d2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.042181 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1352/2679] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:06.044045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.049239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_user(user_id=21eaa096396e437aa72d4260935405d2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.053337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.059050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1328/2680] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 03:59:05 2021] GET /identity/v3/users/21eaa096396e437aa72d4260935405d2 => generated 416 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:06.060343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.070102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199173c1-6128-4922-8b28-3633ab79b372 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.083889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.084598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.085465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.085465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.086089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:06.086757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.088643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.093420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7901bb-528f-442f-8510-bf3e614060dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.105554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.109015 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1353/2681] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:06.109118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.109118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.109118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/users/21eaa096396e437aa72d4260935405d2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.109434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_user(user_id=21eaa096396e437aa72d4260935405d2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.112132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.112420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.123939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87817f-ad07-4d57-ad35-9b837fef60b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.131898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.132816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.133169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.134117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.135785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.137804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.177882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1354/2682] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:06 2021] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:06.185881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.228146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21eaa096396e437aa72d4260935405d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.239578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21eaa096396e437aa72d4260935405d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.241624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21eaa096396e437aa72d4260935405d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.270713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21eaa096396e437aa72d4260935405d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.287015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21eaa096396e437aa72d4260935405d2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.308840 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1329/2683] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:06 2021] DELETE /identity/v3/users/21eaa096396e437aa72d4260935405d2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:06.310888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.314038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.371363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b5db-4006-4e1d-9a6b-42cbe2ae389f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.457046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a500e2-fc5b-4876-9214-79de07b48137 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.483502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.485628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.485914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.486191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/b1110a5260134885a97e6ec2f9c0285e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.487546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1110a5260134885a97e6ec2f9c0285e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.489507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.500900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.501947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.502237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.502573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.503338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.507754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.554174 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1355/2684] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:06 2021] POST /identity/v3/users => generated 300 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:06.554494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1110a5260134885a97e6ec2f9c0285e', 'request_id': 'req-95750e60-cdc8-4523-ad21-5a5ce63ac10d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.561321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.565440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1110a5260134885a97e6ec2f9c0285e', 'request_id': 'req-95750e60-cdc8-4523-ad21-5a5ce63ac10d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.572735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.574733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1110a5260134885a97e6ec2f9c0285e', 'request_id': 'req-95750e60-cdc8-4523-ad21-5a5ce63ac10d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.588982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c46ed-0f88-435f-8cd2-e3179935f0ff admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.627117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project b1110a5260134885a97e6ec2f9c0285e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:06.627480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.629178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:06.631894 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1330/2685] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:06 2021] DELETE /identity/v3/projects/b1110a5260134885a97e6ec2f9c0285e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:06.639405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.641208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.672395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.673303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.673582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.674523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.675287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.678787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.715075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1356/2686] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:06.720269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.722760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.740453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc13d81-bfd2-4114-8e44-53508ef43dad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.746128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.746801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.747084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.747360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.748108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.749735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.752234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750e60-cdc8-4523-ad21-5a5ce63ac10d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.758577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.759606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.760060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.760568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1357/2687] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:06.760898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.761705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.763541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.764695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.775507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3839-a0c6-4aee-8a14-5ee320332edb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.781227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:06.782217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.782598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.783066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] PATH_INFO: `/v3/projects/3c429da1ce66472ea906f7e8cf5e4dd8/users/babb6fa91c674360b017571d83afc6a2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.792557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1331/2688] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:06 2021] POST /identity/v3/projects => generated 347 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:06.794216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.801002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c429da1ce66472ea906f7e8cf5e4dd8, user_id=babb6fa91c674360b017571d83afc6a2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:06.803784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b941fb3-4baa-41ee-8b7e-06f9233569c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:06.827087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1358/2689] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:06 2021] PUT /identity/v3/projects/3c429da1ce66472ea906f7e8cf5e4dd8/users/babb6fa91c674360b017571d83afc6a2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:06.839335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:06.840304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:06.840796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:06.865224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:06.866535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:06.925855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781d15e-d9db-4b08-b917-a92e9321b6dc tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:06.943552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1359/2690] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:06.952991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:06.954613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:07.016593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cc7fc-42de-4863-9027-400dfc354d84 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.021209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.021986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.022655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.023112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.046579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.050476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.061147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.062147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.063902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.064932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.067627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:07.069308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.074979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.079970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1360/2691] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:59:07.103012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1332/2692] 10.222.0.13 () {58 vars in 1159 bytes} [Wed Nov 10 03:59:06 2021] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:07.104448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.116539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a6bd-45e5-4406-a621-c20461eee089 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.121967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.122937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.123318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.123752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.124567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.127074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.151925 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1361/2693] 10.222.0.13 () {58 vars in 1127 bytes} [Wed Nov 10 03:59:07 2021] GET /identity/v3/domains => generated 828 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:07.153339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.176968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1abfc-bb2a-43ac-aff9-b1b360d34395 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.190381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.191456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.191736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.192059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/4c75f1da8779490192615832fe7d5655` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.193961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_project(project_id=4c75f1da8779490192615832fe7d5655)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.198536 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:07.198536 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:07.198536 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:07.199533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.214704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.215558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.249941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.250586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.258212 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1333/2694] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 03:59:07 2021] PATCH /identity/v3/projects/4c75f1da8779490192615832fe7d5655 => generated 361 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:07.258477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.261495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:07.280323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2756c-9f83-4f17-8e70-c3821a9b21c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.391574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.392865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.393171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.393469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/4c75f1da8779490192615832fe7d5655` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.406634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c75f1da8779490192615832fe7d5655)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.408885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.464008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.501708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4c75f1da8779490192615832fe7d5655'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.583843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.594498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.603152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.622109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 4c75f1da8779490192615832fe7d5655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:07.622351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.623432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.639330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.644463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.645392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4c75f1da8779490192615832fe7d5655', 'request_id': 'req-9e2c31c1-1ec7-4e67-9164-68ee2880984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:07.652859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1362/2695] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:07 2021] DELETE /identity/v3/projects/4c75f1da8779490192615832fe7d5655 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:07.657645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.669123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aa008-efa4-4ef7-a023-6fd4366cf659 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.748275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.749290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.749476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.749899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.750684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.752810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.790555 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1334/2696] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:07 2021] POST /identity/v3/projects => generated 359 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:07.795173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.797045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:07.835644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c31c1-1ec7-4e67-9164-68ee2880984d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.919558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.920494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.920840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.923281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/36ae47be5fb44e3a9a5c95c65580dcdf` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.924591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=36ae47be5fb44e3a9a5c95c65580dcdf)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.929326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:07.933787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1363/2697] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:07 2021] GET /identity/v3/projects/36ae47be5fb44e3a9a5c95c65580dcdf => generated 359 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:07.938016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:07.955058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ec22-52b7-4795-a5dc-11a4b7e91bd0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:07.965891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:07.966765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:07.967123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:07.968102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/36ae47be5fb44e3a9a5c95c65580dcdf` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:07.970703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36ae47be5fb44e3a9a5c95c65580dcdf)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:07.974758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.043195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ae47be5fb44e3a9a5c95c65580dcdf', 'request_id': 'req-62e8394b-c309-46d2-8c96-c2a7343d8ce7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.063156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ae47be5fb44e3a9a5c95c65580dcdf', 'request_id': 'req-62e8394b-c309-46d2-8c96-c2a7343d8ce7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.073974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ae47be5fb44e3a9a5c95c65580dcdf', 'request_id': 'req-62e8394b-c309-46d2-8c96-c2a7343d8ce7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.095499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 36ae47be5fb44e3a9a5c95c65580dcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:08.096906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.097964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.100733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1335/2698] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:07 2021] DELETE /identity/v3/projects/36ae47be5fb44e3a9a5c95c65580dcdf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:08.105612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.107660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.124332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd48fe-2a95-44e3-9ce9-551de4ba7532 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.187106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.187768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.188047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.188317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.189378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:08.192083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb92a-a886-4688-ac94-45a44b7e0b9f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.226731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1364/2699] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:08 2021] POST /identity/v3/projects => generated 360 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:08.230943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.240885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8394b-c309-46d2-8c96-c2a7343d8ce7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.321274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f533-0e50-4abc-8cfb-031044c6ff05 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.322065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f533-0e50-4abc-8cfb-031044c6ff05 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.322631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f533-0e50-4abc-8cfb-031044c6ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.349601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.351688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.352038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.352328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/68b1507bfbe04b5b805b5ed7e2dfa3f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.355574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=68b1507bfbe04b5b805b5ed7e2dfa3f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:08.360978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.368024 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1336/2700] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:08 2021] GET /identity/v3/projects/68b1507bfbe04b5b805b5ed7e2dfa3f8 => generated 360 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:08.371692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.377649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b1c1f533-0e50-4abc-8cfb-031044c6ff05 None None] MFA Rules not processed for user `babb6fa91c674360b017571d83afc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:08.381059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1c1f533-0e50-4abc-8cfb-031044c6ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.390227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc549fb-f21f-44ab-a618-ec05e1638b42 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.405644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.407006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.410117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.410827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/68b1507bfbe04b5b805b5ed7e2dfa3f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.419974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68b1507bfbe04b5b805b5ed7e2dfa3f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:08.422249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.510814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1365/2701] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:08.522638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.522979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.523294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.551003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b1507bfbe04b5b805b5ed7e2dfa3f8', 'request_id': 'req-69c90028-c191-46f4-9202-5f58c6eeceee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.560240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b1507bfbe04b5b805b5ed7e2dfa3f8', 'request_id': 'req-69c90028-c191-46f4-9202-5f58c6eeceee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.565622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] MFA Rules not processed for user `babb6fa91c674360b017571d83afc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:08.570027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b1507bfbe04b5b805b5ed7e2dfa3f8', 'request_id': 'req-69c90028-c191-46f4-9202-5f58c6eeceee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.570804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.590041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 68b1507bfbe04b5b805b5ed7e2dfa3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:08.590771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.591838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:08.594282 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1337/2702] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:08 2021] DELETE /identity/v3/projects/68b1507bfbe04b5b805b5ed7e2dfa3f8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:08.604526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.606701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.693691 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1366/2703] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:08.703120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.705696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.741786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c90028-c191-46f4-9202-5f58c6eeceee tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.748990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.749656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.749955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.750264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.750907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:08.753460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.801226 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1338/2704] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:59:08 2021] POST /identity/v3/projects => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:08.805003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.818422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9720-c4d8-4a71-bdef-1f278a96dc74 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.939421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c93e-8ad2-4109-86c9-8a5d40aed822 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.942328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.943557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.944144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.944413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.946968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.949197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.949645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.950094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/6a56484c5c0b43e190cde6159f395a1b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.951466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=6a56484c5c0b43e190cde6159f395a1b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:08.953590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:08.955852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:08.961269 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1339/2705] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:08 2021] GET /identity/v3/projects/6a56484c5c0b43e190cde6159f395a1b => generated 347 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:08.962285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:08.985064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315b65a-a0b9-41b4-8498-641cfb503cdf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:08.995070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:08.996410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:08.996854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:08.997226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/6a56484c5c0b43e190cde6159f395a1b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:08.999920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a56484c5c0b43e190cde6159f395a1b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.002099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.035350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.040022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.058898 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1367/2706] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:08 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:59:09.065318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a56484c5c0b43e190cde6159f395a1b', 'request_id': 'req-237cdf20-cb9c-4635-aee8-467f492919ea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.072355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a56484c5c0b43e190cde6159f395a1b', 'request_id': 'req-237cdf20-cb9c-4635-aee8-467f492919ea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.085667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a56484c5c0b43e190cde6159f395a1b', 'request_id': 'req-237cdf20-cb9c-4635-aee8-467f492919ea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.108497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 6a56484c5c0b43e190cde6159f395a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:09.109128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.110112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.119210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:09.120636 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1340/2707] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:08 2021] DELETE /identity/v3/projects/6a56484c5c0b43e190cde6159f395a1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:09.133936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb012-6fd6-4bc4-996c-2a22c9755b53 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:09.256263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:09.257008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:09.257297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:09.258310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:09.259084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.260809 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:09.260809 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:09.260809 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:09.261771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.294133 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1368/2708] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 03:59:09 2021] POST /identity/v3/domains => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:09.300561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:09.303700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:09.322119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdf20-cb9c-4635-aee8-467f492919ea tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:09.396359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:09.396921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:09.397446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:09.397815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:09.398584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.401596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.497083 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1341/2709] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:09 2021] POST /identity/v3/projects => generated 405 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:09.499953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:09.514454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ec8-b7bd-4159-970c-567f07280cd3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:09.619642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:09.620943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:09.621503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:09.621992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/13f2ac052dcf435787bfe8369ec28bff` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:09.625035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=13f2ac052dcf435787bfe8369ec28bff)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.627349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.631280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1369/2710] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:09 2021] GET /identity/v3/projects/13f2ac052dcf435787bfe8369ec28bff => generated 405 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:09.634373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:09.651594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f5468-9291-42e2-a008-95581f0d6130 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:09.656217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:09.657232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:09.657515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:09.657787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/13f2ac052dcf435787bfe8369ec28bff` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:09.659528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13f2ac052dcf435787bfe8369ec28bff)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.661532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.741608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f2ac052dcf435787bfe8369ec28bff', 'request_id': 'req-0c307756-a099-45ec-8831-89626108ea79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.751128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f2ac052dcf435787bfe8369ec28bff', 'request_id': 'req-0c307756-a099-45ec-8831-89626108ea79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.774725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f2ac052dcf435787bfe8369ec28bff', 'request_id': 'req-0c307756-a099-45ec-8831-89626108ea79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.807613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 13f2ac052dcf435787bfe8369ec28bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:09.808242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.809165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.811455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1342/2711] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:09 2021] DELETE /identity/v3/projects/13f2ac052dcf435787bfe8369ec28bff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:09.815383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:09.817251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:09.844203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847a6b-23f6-4461-877a-9856ea834c32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:09.917753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:09.919285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:09.919573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:09.919857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/92d0f4c50b4b4556bcea0418110df717` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:09.921999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=92d0f4c50b4b4556bcea0418110df717)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:09.923973 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:09.923973 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:09.923973 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:09.925302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:09.955749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:09.956461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.020108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.020828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.033842 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1370/2712] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:09 2021] PATCH /identity/v3/domains/92d0f4c50b4b4556bcea0418110df717 => generated 276 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:10.035325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:10.055724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307756-a099-45ec-8831-89626108ea79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:10.243217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:10.245472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:10.245871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:10.246449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/92d0f4c50b4b4556bcea0418110df717` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:10.268418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=92d0f4c50b4b4556bcea0418110df717)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:10.273214 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:10.273214 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:10.273214 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:10.274376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:10.351461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.366837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '92d0f4c50b4b4556bcea0418110df717'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.557798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.571597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.589297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.611626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 92d0f4c50b4b4556bcea0418110df717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:10.611939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.612811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.642307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.657050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.658567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '92d0f4c50b4b4556bcea0418110df717', 'request_id': 'req-2471408c-c3b3-4b7d-a6b1-7316c400c42b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:10.666985 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1343/2713] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:10 2021] DELETE /identity/v3/domains/92d0f4c50b4b4556bcea0418110df717 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:10.678367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:10.679918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:10.694045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd3e2-e5cd-4383-bc16-9a9a447d33f3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:10.761959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:10.762781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:10.763072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:10.763353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:10.764263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:10.766110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:10.804321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1371/2714] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 03:59:10 2021] POST /identity/v3/domains => generated 276 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:10.806405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:10.807754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:10.826848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471408c-c3b3-4b7d-a6b1-7316c400c42b tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:10.984286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:10.984433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:10.985174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:10.985543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:10.986459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:10.988645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:11.035920 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1344/2715] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:10 2021] POST /identity/v3/projects => generated 410 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:11.040433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:11.053104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bc727-8305-4eee-ab9a-45df4da6c13a tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:11.157909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:11.158631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:11.158923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:11.159206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:11.171537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:11.173662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:11.232718 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1372/2716] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:11 2021] POST /identity/v3/projects => generated 404 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:11.234508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:11.250111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3b41-0e69-4882-98e3-34c3e6e19237 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:11.379512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:11.380695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:11.381263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:11.385747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/5c1e3520358641c2922a2041502dafd2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:11.387571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c1e3520358641c2922a2041502dafd2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:11.389850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:11.520774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1e3520358641c2922a2041502dafd2', 'request_id': 'req-5f63d479-f2da-44a2-b530-f89ec52f7c8f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.527859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1e3520358641c2922a2041502dafd2', 'request_id': 'req-5f63d479-f2da-44a2-b530-f89ec52f7c8f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.538520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1e3520358641c2922a2041502dafd2', 'request_id': 'req-5f63d479-f2da-44a2-b530-f89ec52f7c8f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.578766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 5c1e3520358641c2922a2041502dafd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:11.580043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.581337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.585387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1345/2717] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:11 2021] DELETE /identity/v3/projects/5c1e3520358641c2922a2041502dafd2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:11.590987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:11.594853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:11.635845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1656-7409-4586-bea3-6dd934865a79 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:11.811599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:11.813424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:11.813808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:11.814201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/4e7cb756fbd447b6896e3bc94bacac3a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:11.815681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e7cb756fbd447b6896e3bc94bacac3a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:11.831511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:11.960101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7cb756fbd447b6896e3bc94bacac3a', 'request_id': 'req-510a880c-ca86-4446-990d-496e804911fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:11.969130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7cb756fbd447b6896e3bc94bacac3a', 'request_id': 'req-510a880c-ca86-4446-990d-496e804911fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.017431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7cb756fbd447b6896e3bc94bacac3a', 'request_id': 'req-510a880c-ca86-4446-990d-496e804911fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.052784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 4e7cb756fbd447b6896e3bc94bacac3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:12.053438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.053949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.056784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1373/2718] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:11 2021] DELETE /identity/v3/projects/4e7cb756fbd447b6896e3bc94bacac3a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:12.060927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:12.078116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d479-f2da-44a2-b530-f89ec52f7c8f tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:12.206830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:12.207711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:12.207995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:12.208870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/65bf32abee0148de81c4db3b0c678d89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:12.214749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=65bf32abee0148de81c4db3b0c678d89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:12.215792 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:12.215792 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:12.215792 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:12.216748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:12.272107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.274017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.314019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.314719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-479743c0-a950-4dc4-a1b6-89c72c192c27 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.320424 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1346/2719] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:12 2021] PATCH /identity/v3/domains/65bf32abee0148de81c4db3b0c678d89 => generated 277 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:12.323423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:12.325351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:12.359944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a880c-ca86-4446-990d-496e804911fb tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:12.499103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:12.500434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:12.501020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:12.501635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/65bf32abee0148de81c4db3b0c678d89` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:12.512543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:12.512900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:12.513201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:12.525531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=65bf32abee0148de81c4db3b0c678d89)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:12.526581 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:12.526581 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:12.526581 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:12.527567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:12.568542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] MFA Rules not processed for user `2e9fa45517c0412c82e0f85634858963`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:12.571087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:12.575541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.597900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '65bf32abee0148de81c4db3b0c678d89'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.670846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.687266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.699568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.711116 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1347/2720] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:12 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:12.732483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 65bf32abee0148de81c4db3b0c678d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:12.734566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.736241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.768519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.775080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.776324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '65bf32abee0148de81c4db3b0c678d89', 'request_id': 'req-a22d97da-3de7-4dce-ac40-146873217ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:12.787742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1374/2721] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:12 2021] DELETE /identity/v3/domains/65bf32abee0148de81c4db3b0c678d89 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:12.792952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:12.794973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:12.814428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2e03-876d-472a-8a27-bbf1f2b436b2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:12.975590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:12.976390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:12.976752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:12.977026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:12.977795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:12.980470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.029747 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1348/2722] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:12 2021] POST /identity/v3/projects => generated 378 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:13.033444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.034964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:13.051477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d97da-3de7-4dce-ac40-146873217ae3 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.145237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.147053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.148162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.148683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/8c90f5075c7a447a9ac761893768027b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.150214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c90f5075c7a447a9ac761893768027b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.152499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.155405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1375/2723] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:13 2021] GET /identity/v3/projects/8c90f5075c7a447a9ac761893768027b => generated 378 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:13.159577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.173301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b818c1-dd17-4fb5-af75-2230a44d54ec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.179010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.179866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.180154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.180427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.181207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.197108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.234992 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1349/2724] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 03:59:13 2021] GET /identity/v3/projects => generated 7690 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:13.239109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.251183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0f96-5363-4f46-8d03-1ff286a0badf tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.256534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.257164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.257424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.257976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/8c90f5075c7a447a9ac761893768027b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.260024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c90f5075c7a447a9ac761893768027b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.261635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.342015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c90f5075c7a447a9ac761893768027b', 'request_id': 'req-282e4100-0d80-482e-878d-534a406da60d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.349367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c90f5075c7a447a9ac761893768027b', 'request_id': 'req-282e4100-0d80-482e-878d-534a406da60d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.361611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c90f5075c7a447a9ac761893768027b', 'request_id': 'req-282e4100-0d80-482e-878d-534a406da60d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.382220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 8c90f5075c7a447a9ac761893768027b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:13.382752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.383351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.386489 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1376/2725] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:13 2021] DELETE /identity/v3/projects/8c90f5075c7a447a9ac761893768027b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:13.391396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.397283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:13.413210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f04b-45f9-45fd-8ffa-7e6a4c7e70b4 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.491222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.492284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.492750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.493190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.494430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.496784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.543586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1350/2726] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 03:59:13 2021] POST /identity/v3/projects => generated 347 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:13.543923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.555819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e4100-0d80-482e-878d-534a406da60d tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.624155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.625241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.625531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.625810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/815145b5e8644719ba64d0616412d99b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.627671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_project(project_id=815145b5e8644719ba64d0616412d99b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.628885 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:13.628885 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:13.628885 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:13.630278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.675707 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1377/2727] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 03:59:13 2021] PATCH /identity/v3/projects/815145b5e8644719ba64d0616412d99b => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:13.677237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.698997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e9e3-9c0d-4833-88ae-4b777c68d850 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.705778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.707233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.707670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.708114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/815145b5e8644719ba64d0616412d99b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.729045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=815145b5e8644719ba64d0616412d99b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.731471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.737022 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1351/2728] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:13 2021] GET /identity/v3/projects/815145b5e8644719ba64d0616412d99b => generated 348 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:13.738031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.750521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8448c1-e9b8-4b33-bf0c-05adb993abfa tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.755761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.757034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.757424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.757846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/815145b5e8644719ba64d0616412d99b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.759340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=815145b5e8644719ba64d0616412d99b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.762591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:13.830662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815145b5e8644719ba64d0616412d99b', 'request_id': 'req-ce7b8608-37a3-4794-a487-a0c57958e8a7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.836294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815145b5e8644719ba64d0616412d99b', 'request_id': 'req-ce7b8608-37a3-4794-a487-a0c57958e8a7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.844773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815145b5e8644719ba64d0616412d99b', 'request_id': 'req-ce7b8608-37a3-4794-a487-a0c57958e8a7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.863198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 815145b5e8644719ba64d0616412d99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:13.863557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.865230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:13.867241 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1378/2729] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:13 2021] DELETE /identity/v3/projects/815145b5e8644719ba64d0616412d99b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:13.872280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:13.876127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:13.895513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e209-3fcf-44dc-a19d-8526863e67b5 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:13.977112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:13.977794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:13.978075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:13.978335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:13.979087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:13.981021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.024178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1352/2730] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:13 2021] POST /identity/v3/projects => generated 359 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:14.025075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.040278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8608-37a3-4794-a487-a0c57958e8a7 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.144764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.145708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.146271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.146271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/8d9a51ba158d489fa932f10ed5e9f506` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.147662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_project(project_id=8d9a51ba158d489fa932f10ed5e9f506)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.149668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.222773 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1379/2731] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 03:59:14 2021] PATCH /identity/v3/projects/8d9a51ba158d489fa932f10ed5e9f506 => generated 371 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:14.227672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.240059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be220a8-7535-4653-a7cf-8c664658a6c0 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.246734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.248227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.248513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.248830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/8d9a51ba158d489fa932f10ed5e9f506` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.265909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=8d9a51ba158d489fa932f10ed5e9f506)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.268340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.273819 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1353/2732] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:14 2021] GET /identity/v3/projects/8d9a51ba158d489fa932f10ed5e9f506 => generated 358 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:14.275370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.291543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6ecc-6225-462c-9c52-f8a426f87ff1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.297525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.298576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.298954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.299398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/8d9a51ba158d489fa932f10ed5e9f506` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.300756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8d9a51ba158d489fa932f10ed5e9f506)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.302823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.384352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9a51ba158d489fa932f10ed5e9f506', 'request_id': 'req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:14.392391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9a51ba158d489fa932f10ed5e9f506', 'request_id': 'req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:14.399668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9a51ba158d489fa932f10ed5e9f506', 'request_id': 'req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:14.420339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 8d9a51ba158d489fa932f10ed5e9f506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:14.421379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:14.425047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:14.427288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1380/2733] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:14 2021] DELETE /identity/v3/projects/8d9a51ba158d489fa932f10ed5e9f506 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:14.433436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.437628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:14.452368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491db0-5f1d-4074-b5dd-0294ca6f7ce1 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.580371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.584104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.587040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.587491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.588344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.594966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.669475 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1354/2734] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:14 2021] POST /identity/v3/projects => generated 354 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:14.675418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.694726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86633-65b7-4ad6-afb6-db1bc2fe5e92 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.804984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.809923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.809923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.810174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/70f6b563675e4536888f9e5d2c032d03` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.813104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:update_project(project_id=70f6b563675e4536888f9e5d2c032d03)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.817269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.881941 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1381/2735] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 03:59:14 2021] PATCH /identity/v3/projects/70f6b563675e4536888f9e5d2c032d03 => generated 369 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:14.886076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.903332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c82b-6528-4495-89ef-7e8338baff32 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.922293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.923842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.924160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.924973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/70f6b563675e4536888f9e5d2c032d03` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.944543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:get_project(project_id=70f6b563675e4536888f9e5d2c032d03)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.949899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:14.952649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1355/2736] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:14 2021] GET /identity/v3/projects/70f6b563675e4536888f9e5d2c032d03 => generated 356 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:14.955695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:14.970875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac861e-ef71-498b-857e-1013c0a1d2b9 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:14.980706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:14.981601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:14.981888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:14.982163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/projects/70f6b563675e4536888f9e5d2c032d03` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:14.984855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=70f6b563675e4536888f9e5d2c032d03)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:14.986783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:15.075500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f6b563675e4536888f9e5d2c032d03', 'request_id': 'req-8499f829-7956-46ae-bdc4-618da29d5924'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.086757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f6b563675e4536888f9e5d2c032d03', 'request_id': 'req-8499f829-7956-46ae-bdc4-618da29d5924'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.097439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f6b563675e4536888f9e5d2c032d03', 'request_id': 'req-8499f829-7956-46ae-bdc4-618da29d5924'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.123005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] The token cache is being invalidate because project 70f6b563675e4536888f9e5d2c032d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:15.123302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.125065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.137496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:15.139440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:15.152730 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1382/2737] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:14 2021] DELETE /identity/v3/projects/70f6b563675e4536888f9e5d2c032d03 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:15.172200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856965b-a9a5-4e76-bc80-9275172e8f07 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:15.259576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:15.261424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.261668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.262036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/65bf32abee0148de81c4db3b0c678d89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:15.269481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:59:15.281077 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Could not find domain: 65bf32abee0148de81c4db3b0c678d89.: keystone.exception.DomainNotFound: Could not find domain: 65bf32abee0148de81c4db3b0c678d89. Nov 10 03:59:15.286735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:15.299520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499f829-7956-46ae-bdc4-618da29d5924 tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:15.301063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1356/2738] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:15 2021] PATCH /identity/v3/domains/65bf32abee0148de81c4db3b0c678d89 => generated 112 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:15.307855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5db7795cfc794ed3a240c7aa3893ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0b609fe90764329aca628682cb7f223', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:15.309373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.309655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.309931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] PATH_INFO: `/v3/domains/92d0f4c50b4b4556bcea0418110df717` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:15.318650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:59:15.328944 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d136f0e8-1486-4573-96de-a652e564daab tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Could not find domain: 92d0f4c50b4b4556bcea0418110df717.: keystone.exception.DomainNotFound: Could not find domain: 92d0f4c50b4b4556bcea0418110df717. Nov 10 03:59:15.330557 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1383/2739] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:15 2021] PATCH /identity/v3/domains/92d0f4c50b4b4556bcea0418110df717 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:15.334679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:15.336978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:15.439889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd7ba-8d77-453f-a078-7cb906e28eec tempest-ProjectsTestJSON-380301007 tempest-ProjectsTestJSON-380301007-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:15.453783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:15.453783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.454053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.454147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] PATH_INFO: `/v3/users/4b99a26c9fbc4a72bad408d446e26c99` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:15.456212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b99a26c9fbc4a72bad408d446e26c99)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:15.459753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:15.552290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b99a26c9fbc4a72bad408d446e26c99'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.580289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b99a26c9fbc4a72bad408d446e26c99'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.581591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b99a26c9fbc4a72bad408d446e26c99'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.604763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b99a26c9fbc4a72bad408d446e26c99'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.616595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b99a26c9fbc4a72bad408d446e26c99'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:15.643048 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1357/2740] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:15 2021] DELETE /identity/v3/users/4b99a26c9fbc4a72bad408d446e26c99 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:15.647980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.648706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.648910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:15.668871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:15.669397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:15.796344 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1384/2741] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:15.824240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:15.826182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:15.826667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:15.827917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:15.942434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9216-999d-4465-bf88-58f7b7bf52a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:15.946571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:15.947594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.947862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.948183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:15.965899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:15.967380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:15.979698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb8d5e-1641-4eae-bf4b-c4fc1e392bcd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:15.995408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:15.995912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:15.996148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:15.996425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:16.008748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:16.011333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1358/2742] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:16.118121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:16.122363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe4b00-3768-4e23-a502-4efa62eb2bab service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:16.148727 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1385/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:15 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:17.397108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:17.399357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:17.419619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72ae6-9647-402c-b524-cbe3250d321a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:17.425917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:17.427077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:17.427568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:17.428048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] PATH_INFO: `/v3/projects/2dd9f3992f314dbab5e91d15af7efac7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:17.429661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd9f3992f314dbab5e91d15af7efac7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:17.432966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:17.504750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd9f3992f314dbab5e91d15af7efac7', 'request_id': 'req-e72efaad-fba9-4525-8ff4-3483cbaf785f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.525555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd9f3992f314dbab5e91d15af7efac7', 'request_id': 'req-e72efaad-fba9-4525-8ff4-3483cbaf785f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.544913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd9f3992f314dbab5e91d15af7efac7', 'request_id': 'req-e72efaad-fba9-4525-8ff4-3483cbaf785f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.548360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:17.549259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:17.549763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:17.567436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] The token cache is being invalidate because project 2dd9f3992f314dbab5e91d15af7efac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:17.567436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.568279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.574983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:17.575253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1359/2744] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:17 2021] DELETE /identity/v3/projects/2dd9f3992f314dbab5e91d15af7efac7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:17.576799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:17.579337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:17.583504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:17.699209 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1386/2745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:17 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:17.727902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efaad-fba9-4525-8ff4-3483cbaf785f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:17.744368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:17.745880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:17.745880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:17.746071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] PATH_INFO: `/v3/users/5db7795cfc794ed3a240c7aa3893ee87` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:17.747940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db7795cfc794ed3a240c7aa3893ee87)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:17.750215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:17.847013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db7795cfc794ed3a240c7aa3893ee87'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.856179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db7795cfc794ed3a240c7aa3893ee87'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.857093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db7795cfc794ed3a240c7aa3893ee87'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.872956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db7795cfc794ed3a240c7aa3893ee87'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.887033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-585bfe45-4bb1-41ad-96f6-1e8870ac7800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db7795cfc794ed3a240c7aa3893ee87'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:17.897610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1360/2746] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:17 2021] DELETE /identity/v3/users/5db7795cfc794ed3a240c7aa3893ee87 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:19.413439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:19.448240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480131-f7a8-491b-9004-2c2a3b99cbdd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:19.655426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:19.656574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:19.657066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:19.657524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] PATH_INFO: `/v3/projects/e0b609fe90764329aca628682cb7f223` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:19.660864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b609fe90764329aca628682cb7f223)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:19.663150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:19.748917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b609fe90764329aca628682cb7f223', 'request_id': 'req-f001f242-8289-4207-9824-d80019fb0652'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:19.756334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b609fe90764329aca628682cb7f223', 'request_id': 'req-f001f242-8289-4207-9824-d80019fb0652'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:19.765176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b609fe90764329aca628682cb7f223', 'request_id': 'req-f001f242-8289-4207-9824-d80019fb0652'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:19.791626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] The token cache is being invalidate because project e0b609fe90764329aca628682cb7f223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:19.792095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:19.793132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f001f242-8289-4207-9824-d80019fb0652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:19.795624 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1387/2747] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:19 2021] DELETE /identity/v3/projects/e0b609fe90764329aca628682cb7f223 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:19.801647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:19.802161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:19.802161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:19.838703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:19.839964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:19.961589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1361/2748] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:19.971368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:19.971667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:19.971930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.009911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:20.011174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:20.031372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1388/2749] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:20.036404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.050270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2ddf-e98f-4cdf-bddd-ccf3ffb77811 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.060382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.061757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.062287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.063595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.064801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:20.065267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.068668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.091014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.093273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1362/2750] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:20.106088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471099-4dc4-4eca-89a9-ee2bdc40a907 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.119097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.119848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.120132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.120411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.124088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.126003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.205110 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1389/2751] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:20 2021] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:20.210153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.223780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd4d6-1309-4df8-aab2-a289b287388a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.347800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.348938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.349394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.349818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.350672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.352962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.393658 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1363/2752] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:20 2021] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:20.398515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.416680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a9a3-1a8f-4f5d-b2b9-517d6107d114 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.422993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.423226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.423495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.423826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.424569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.426240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.439667 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1390/2753] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:20.443498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.455150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c699-2fcf-44a9-8e7e-b81ef07c9643 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.467678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.468962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.469252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.470116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.471031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.474343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a54a-5df0-4145-b2ea-58cdc3955d2c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.491400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1364/2754] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:20 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:20.492293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.510124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d341ca6-0bc5-4978-9054-dfb09fcaecea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:20.518109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:20.519537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.519967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.520696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] PATH_INFO: `/v3/projects/f341ffa077ed4a5bbe62a187f59f7f72/users/5b03007637044faa8579dedd9b849183/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.545548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f341ffa077ed4a5bbe62a187f59f7f72, user_id=5b03007637044faa8579dedd9b849183, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:20.551574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:20.583234 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1391/2755] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:20 2021] PUT /identity/v3/projects/f341ffa077ed4a5bbe62a187f59f7f72/users/5b03007637044faa8579dedd9b849183/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:20.657632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:20.657910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:20.658175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:20.713006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] MFA Rules not processed for user `5b03007637044faa8579dedd9b849183`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:20.714463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:20.879727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:20.883411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1365/2756] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:21.059431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a4c4-3f4f-4b82-8ecb-33ebc57971d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.065823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.066883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.067649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.068253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.069596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.075362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.116523 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1392/2757] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:20 2021] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:21.117792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:21.135728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a32f0-b972-439c-a5cd-66e2b50f84f4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.280104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.281005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.281303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.282557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.283634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.287686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.324562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1366/2758] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:21 2021] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:21.329419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:21.343963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2d17-aa2b-4d30-bbec-5715de4b682c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.360300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.361362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.361929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.362490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.363550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.367218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.395555 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1393/2759] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:21 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:21.400803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:21.416740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28665052-16e7-451a-9672-96b98ef29d41 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.426723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.429160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.430552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.432361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] PATH_INFO: `/v3/projects/cebd5ecda41c4801a54ad746fe6f129d/users/d7add50a8ad14b9585f0241ddf356a70/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.484706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebd5ecda41c4801a54ad746fe6f129d, user_id=d7add50a8ad14b9585f0241ddf356a70, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.494692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.525876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1367/2760] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:21 2021] PUT /identity/v3/projects/cebd5ecda41c4801a54ad746fe6f129d/users/d7add50a8ad14b9585f0241ddf356a70/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:21.530278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:21.545346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fcc62-ee9a-484f-884f-daa019a56ecb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.753792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.754898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.754898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.755061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.755922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.760394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4205-a09b-4e53-964e-f188671acf8d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.797555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:21.799862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1394/2761] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:21 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:21.825179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c2b9-e210-4ea8-97f3-4061977205d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:21.837025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:21.840128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.841625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.842014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] PATH_INFO: `/v3/projects/cebd5ecda41c4801a54ad746fe6f129d/users/d7add50a8ad14b9585f0241ddf356a70/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.850927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebd5ecda41c4801a54ad746fe6f129d, user_id=d7add50a8ad14b9585f0241ddf356a70, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:21.853792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:21.885211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1368/2762] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:21 2021] PUT /identity/v3/projects/cebd5ecda41c4801a54ad746fe6f129d/users/d7add50a8ad14b9585f0241ddf356a70/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:21.896091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:21.896353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:21.896653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:21.950617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] MFA Rules not processed for user `d7add50a8ad14b9585f0241ddf356a70`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:21.953230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:22.077775 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1395/2763] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:21 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:22.083256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:22.095445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705431-215f-4d27-90ea-186ad3e41320 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:22.101267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7add50a8ad14b9585f0241ddf356a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cebd5ecda41c4801a54ad746fe6f129d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:22.102303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:22.102645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:22.103091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:22.104384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:22.106293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:22.141865 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1369/2764] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:22 2021] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:22.146734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:22.220342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac30257-6b33-483a-adc3-0bbc47485d16 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:22.363473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b03007637044faa8579dedd9b849183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f341ffa077ed4a5bbe62a187f59f7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:22.369325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:22.369620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:22.369904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] PATH_INFO: `/v3/projects/852ed676ed8c45c18270c38fd9cc6c2a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:22.371905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] RBAC: Authorizing `identity:delete_project(project_id=852ed676ed8c45c18270c38fd9cc6c2a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:22.385690 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Nov 10 03:59:22.387899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1396/2765] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:22 2021] DELETE /identity/v3/projects/852ed676ed8c45c18270c38fd9cc6c2a => generated 136 bytes in 242 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:22.392938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:22.561096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757e79-7739-4c9d-afa7-8305b5e57574 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:22.575806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7add50a8ad14b9585f0241ddf356a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cebd5ecda41c4801a54ad746fe6f129d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:22.576789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:22.577078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:22.577362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] PATH_INFO: `/v3/projects/852ed676ed8c45c18270c38fd9cc6c2a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:22.584381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: Authorizing `identity:delete_project(project_id=852ed676ed8c45c18270c38fd9cc6c2a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:22.586495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:22.654431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852ed676ed8c45c18270c38fd9cc6c2a', 'request_id': 'req-f97e6cdb-c648-43ea-9323-01ca64ecce67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:22.662628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852ed676ed8c45c18270c38fd9cc6c2a', 'request_id': 'req-f97e6cdb-c648-43ea-9323-01ca64ecce67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:22.670046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852ed676ed8c45c18270c38fd9cc6c2a', 'request_id': 'req-f97e6cdb-c648-43ea-9323-01ca64ecce67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:22.687739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] The token cache is being invalidate because project 852ed676ed8c45c18270c38fd9cc6c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:22.687739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:22.688044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f97e6cdb-c648-43ea-9323-01ca64ecce67 tempest-ProjectsNegativeTestJSON-787012481 tempest-ProjectsNegativeTestJSON-787012481-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:22.693583 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1370/2766] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:22 2021] DELETE /identity/v3/projects/852ed676ed8c45c18270c38fd9cc6c2a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:22.694520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:22.699012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:22.902061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633921fb-966d-4e5e-9503-440549f227ab tempest-ProjectsNegativeTestJSON-288339596 tempest-ProjectsNegativeTestJSON-288339596-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:23.032142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:23.033066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:23.033381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:23.033885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] PATH_INFO: `/v3/users/5b03007637044faa8579dedd9b849183` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:23.035541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b03007637044faa8579dedd9b849183)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:23.037666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:23.110199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b03007637044faa8579dedd9b849183'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:23.118204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b03007637044faa8579dedd9b849183'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:23.119136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b03007637044faa8579dedd9b849183'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:23.119958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b03007637044faa8579dedd9b849183'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:23.132583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b03007637044faa8579dedd9b849183'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:23.160517 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1397/2767] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:22 2021] DELETE /identity/v3/users/5b03007637044faa8579dedd9b849183 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:23.164087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:23.164600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:23.165073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:23.193806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:23.195488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:23.360864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1371/2768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:23.420983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:23.423208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:23.498782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354eea2-0063-4c33-bcd5-e8d54ce54837 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:23.502715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:23.503301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:23.503582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:23.503858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:23.518169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:23.519749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:23.532147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1398/2769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:24.675030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:24.676642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:24.693684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158e04a-889d-44a9-937f-2b9bdf057bfa None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:24.704521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:24.706062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:24.706490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:24.707014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] PATH_INFO: `/v3/projects/f341ffa077ed4a5bbe62a187f59f7f72` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:24.708957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f341ffa077ed4a5bbe62a187f59f7f72)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:24.711291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:24.859143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f341ffa077ed4a5bbe62a187f59f7f72', 'request_id': 'req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:24.867109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f341ffa077ed4a5bbe62a187f59f7f72', 'request_id': 'req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:24.876132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f341ffa077ed4a5bbe62a187f59f7f72', 'request_id': 'req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:24.894466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] The token cache is being invalidate because project f341ffa077ed4a5bbe62a187f59f7f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:24.894997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:24.896028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:24.902333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1372/2770] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:24 2021] DELETE /identity/v3/projects/f341ffa077ed4a5bbe62a187f59f7f72 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:24.902881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:24.913801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d535-e3d3-4762-b013-dce834a48426 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:25.009833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:25.010892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:25.011173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:25.011617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] PATH_INFO: `/v3/users/d7add50a8ad14b9585f0241ddf356a70` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:25.012977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7add50a8ad14b9585f0241ddf356a70)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:25.016898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:25.128513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7add50a8ad14b9585f0241ddf356a70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:25.137583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7add50a8ad14b9585f0241ddf356a70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:25.138415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7add50a8ad14b9585f0241ddf356a70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:25.139167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7add50a8ad14b9585f0241ddf356a70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:25.148256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1308500-1236-455d-9f85-fdaca7f702a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7add50a8ad14b9585f0241ddf356a70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:25.174363 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1399/2771] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:24 2021] DELETE /identity/v3/users/d7add50a8ad14b9585f0241ddf356a70 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:27.269209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:27.270679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:27.286048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5903-98c7-4ff6-b7ea-b19f5d040312 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:27.358202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:27.360014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.361526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.361960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] PATH_INFO: `/v3/projects/cebd5ecda41c4801a54ad746fe6f129d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.363436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebd5ecda41c4801a54ad746fe6f129d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:27.365565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:27.433798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebd5ecda41c4801a54ad746fe6f129d', 'request_id': 'req-6e93b48e-52d1-49e4-800f-c23afa56f0a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:27.440948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebd5ecda41c4801a54ad746fe6f129d', 'request_id': 'req-6e93b48e-52d1-49e4-800f-c23afa56f0a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:27.452435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebd5ecda41c4801a54ad746fe6f129d', 'request_id': 'req-6e93b48e-52d1-49e4-800f-c23afa56f0a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:27.469473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] The token cache is being invalidate because project cebd5ecda41c4801a54ad746fe6f129d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:27.470012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:27.470810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e93b48e-52d1-49e4-800f-c23afa56f0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:27.472863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1373/2772] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:27 2021] DELETE /identity/v3/projects/cebd5ecda41c4801a54ad746fe6f129d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:27.479919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38065-e570-4500-bc78-539062f55edf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.480448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38065-e570-4500-bc78-539062f55edf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.480533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38065-e570-4500-bc78-539062f55edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.503514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9da38065-e570-4500-bc78-539062f55edf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:27.505149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9da38065-e570-4500-bc78-539062f55edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:27.581398 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1400/2773] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:27.590447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.591555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.592026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.625848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:27.627970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:27.641742 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1374/2774] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:27.646744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da38065-e570-4500-bc78-539062f55edf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:27.686521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da38065-e570-4500-bc78-539062f55edf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:27.692475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:27.693322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.693608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.693882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.695106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:27.696003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:27.698673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:27.716920 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1401/2775] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:27.722150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:27.733998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b67e-d3ba-47e6-b284-de8083736384 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:27.739932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:27.741793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.742259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.743103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.744385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:27.746886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:27.808147 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1375/2776] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:27 2021] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:27.812459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:27.833992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e06fd-0a6c-4cea-b958-bb36df671e17 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:27.974783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:27.975773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:27.976459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:27.976973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:27.977902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:27.980926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.014708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1402/2777] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:27 2021] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:28.019051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.036280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace6000-4feb-46b8-9296-3d49eb0efea4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.044213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.045336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.047284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.048204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.053243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.059962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.086293 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1376/2778] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:28.088362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.104951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9948-c30f-46d2-95e0-0e124b2ba532 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.116841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.117521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.117855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.118139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.119164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.120917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af7948-4211-4737-bc30-5eff2906861f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.164982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1403/2779] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:28.165249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.184820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9511-5a7c-4d87-8443-6c76a487963d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.199351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.199351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.199351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.199730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] PATH_INFO: `/v3/projects/e820974013534b01bd497f65ddf15f1e/users/54944dfb19ff4e5aaf18d101ccfa1c6c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.251084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e820974013534b01bd497f65ddf15f1e, user_id=54944dfb19ff4e5aaf18d101ccfa1c6c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.254000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.285172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1377/2780] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:28 2021] PUT /identity/v3/projects/e820974013534b01bd497f65ddf15f1e/users/54944dfb19ff4e5aaf18d101ccfa1c6c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:28.286889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.287149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.287427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.349330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] MFA Rules not processed for user `54944dfb19ff4e5aaf18d101ccfa1c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:28.350566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:28.483663 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1404/2781] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:28 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:28.488057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.598888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffac06-8b8a-4bb5-9d56-f3240d509378 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.607068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.611652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.611965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.612242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.614161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.619500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.683655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1378/2782] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:28 2021] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:28.687993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.701314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452afafa-42fb-4459-98b7-4f1a895e4a24 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.797446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.798342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.798716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.804314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.804314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.804314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.849058 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1405/2783] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:28 2021] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:28.853530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.867353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f90e3-79cd-4277-9cbb-793a6fc0e604 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.873203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.873972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.874322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.874664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.875474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.877522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.892220 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1379/2784] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:28.893580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:28.910607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba74f-1cba-4e80-885b-bd7d5a2d77cc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:28.918159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:28.919348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:28.919747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:28.920126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] PATH_INFO: `/v3/projects/46b33ab7e45f46c0857c5677bb7b7875/users/969aa36a47fa4930bbced24c2b60f685/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:28.951211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b33ab7e45f46c0857c5677bb7b7875, user_id=969aa36a47fa4930bbced24c2b60f685, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:28.957006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:28.995017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1406/2785] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:28 2021] PUT /identity/v3/projects/46b33ab7e45f46c0857c5677bb7b7875/users/969aa36a47fa4930bbced24c2b60f685/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:28.995132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.010448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1445-79b7-40ab-ad85-1151ceb9f6bc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.124196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.125026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.125377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.125739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.128206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.129997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23795e4e-8c14-48fe-b3b8-86f2e683f373 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.142081 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1380/2786] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:29.146522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.162246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9888fc-ec44-4c03-aae4-6eb7322420bf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.168292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.169227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.169505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.169777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] PATH_INFO: `/v3/projects/46b33ab7e45f46c0857c5677bb7b7875/users/969aa36a47fa4930bbced24c2b60f685/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.172261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b33ab7e45f46c0857c5677bb7b7875, user_id=969aa36a47fa4930bbced24c2b60f685, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.175480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.196046 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1407/2787] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:29 2021] PUT /identity/v3/projects/46b33ab7e45f46c0857c5677bb7b7875/users/969aa36a47fa4930bbced24c2b60f685/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:29.206203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.206492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.206766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.240591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] MFA Rules not processed for user `969aa36a47fa4930bbced24c2b60f685`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:29.243811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:29.334845 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1381/2788] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:29.339757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.350495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966e08-02cf-4474-a818-a0d05dbd4cd6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.370344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.371036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.371315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.371596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.372414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.374856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.395346 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1408/2789] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/roles => generated 235 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:29.400578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.411108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c88d2-ced3-42d2-87b0-9b2143cef490 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.418331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.419867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.420985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.421666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.422611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.424598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.448265 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1382/2790] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/roles => generated 234 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:29.452102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.464417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d37cf-2b37-4071-98c3-08139e910f01 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.469919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.472503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.473041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.473727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.475107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.476920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.503456 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1409/2791] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/roles => generated 234 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:29.509760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.526597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e73e-9388-4c55-b4af-d8b4e5e81f88 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.533674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.534712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.535158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.535696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.536793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.538852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.558059 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1383/2792] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/domains => generated 276 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:29.563347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.576888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666383-d493-4093-a28a-6e49a6960d04 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.643442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.644029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.644389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.644794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.645594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.647597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.693102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1410/2793] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:29.697100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.708581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cedd39-6d37-4a69-b297-d7879eec4812 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.805483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.807097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.807453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.807795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.812093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.813237 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:29.813237 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:29.813237 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:29.815030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.879459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1384/2794] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/groups => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:29.880898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.893570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691f2c-ce83-4e96-b115-981f71b9afcf tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.926113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.927142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.927532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.928097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.929643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.932276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:29.962845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:29.970395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1411/2795] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/roles => generated 234 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:29.974533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f043c-4da8-4406-a1d5-f218bc7d94b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:29.979816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:29.981203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:29.981556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:29.982115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:29.982944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:29.985063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.015901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1385/2796] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:29 2021] POST /identity/v3/users => generated 442 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:30.017861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.028423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2d4-b37b-4a6c-aafd-29eb7c53cdfd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.034607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.035229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.037866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.037866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.037866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.039072 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:30.039072 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:30.039072 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:30.040692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.065342 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1412/2797] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:30 2021] POST /identity/v3/roles => generated 270 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:30.068406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.087605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b7c3-7b1f-45fa-8991-44b536081437 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.112410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.114037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.114937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.115335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/02d7e1ef90bd4862aa8d44dbe169fed1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.146517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=02d7e1ef90bd4862aa8d44dbe169fed1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.150291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.191171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1386/2798] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:30 2021] PUT /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/02d7e1ef90bd4862aa8d44dbe169fed1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:30.192477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.218697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0acbd-cca9-48d0-8b03-1e681d63d755 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.342847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.343504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.343818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.344230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.345493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Adding query filter params (scope.project.id=e07b179ea18c4b83a0319ae5264c6e49, user.id=b7a613abdb314f8fb874c386ed29bddb) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:30.345811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.347672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.421812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1413/2799] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 03:59:30 2021] GET /identity/v3/role_assignments?scope.project.id=e07b179ea18c4b83a0319ae5264c6e49&user.id=b7a613abdb314f8fb874c386ed29bddb&effective => generated 228 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:30.424081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.434930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2aa1-e268-4d83-838f-76f37dcf4d86 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.441871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.443167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.443638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.444071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/02d7e1ef90bd4862aa8d44dbe169fed1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.446605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=02d7e1ef90bd4862aa8d44dbe169fed1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.448433 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:30.448433 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:30.448433 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:30.450882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.458423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 02d7e1ef90bd4862aa8d44dbe169fed1 was removed from user b7a613abdb314f8fb874c386ed29bddb on project e07b179ea18c4b83a0319ae5264c6e49. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:30.459868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:30.460580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:30.481806 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1387/2800] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 03:59:30 2021] DELETE /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/02d7e1ef90bd4862aa8d44dbe169fed1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:30.485875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.487881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:30.501721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8bc2f-24b0-4823-9ab6-a9cc2421d456 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.569172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.571105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.571105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.571105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/02d7e1ef90bd4862aa8d44dbe169fed1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.573017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=02d7e1ef90bd4862aa8d44dbe169fed1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.574141 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:30.574141 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:30.574141 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:30.575172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.614004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 02d7e1ef90bd4862aa8d44dbe169fed1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:30.614355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:30.614954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:30.618344 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1414/2801] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:30 2021] DELETE /identity/v3/roles/02d7e1ef90bd4862aa8d44dbe169fed1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:30.623194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.634682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a93d-ccf8-4578-be14-2bd5c1d5c3b9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.714685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.715596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.715879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.718739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/ee4cc5e5590c44f0a5cb142b1e4c0832` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.727553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=ee4cc5e5590c44f0a5cb142b1e4c0832)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.730821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.760205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1388/2802] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:30 2021] PUT /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/ee4cc5e5590c44f0a5cb142b1e4c0832 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:30.764396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.773704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:30.794455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf96a-83f1-4773-a86e-f5261afb592a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:30.902382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:30.903329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:30.903632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:30.903905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:30.906405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:30.907999 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:30.907999 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:30.907999 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:30.908855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:30.939477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1415/2803] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:30 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 520 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:30.943690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:30.959861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a277c7-29d5-4f6d-b952-e97ea654acab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.036076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.036886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.037370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.037743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.038679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Adding query filter params (scope.project.id=e07b179ea18c4b83a0319ae5264c6e49, user.id=b7a613abdb314f8fb874c386ed29bddb) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:31.039103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.041387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.143391 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1389/2804] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 03:59:30 2021] GET /identity/v3/role_assignments?scope.project.id=e07b179ea18c4b83a0319ae5264c6e49&user.id=b7a613abdb314f8fb874c386ed29bddb&effective => generated 1061 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:31.148585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.163821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe8a6-c329-4dd5-90e9-8cb2989bfe52 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.170319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.172425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.172735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.173012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.177473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.178502 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:31.178502 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:31.178502 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:31.179380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a653c4-261c-445f-ba59-6bf25afa27b8 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.193964 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1416/2805] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:31 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:31.200028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.218190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2ebd-b563-4a7e-822c-1355ee197cb6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.254485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.254804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.257505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.280919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:31.283400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:31.311766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.318260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.318559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.322603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.323820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Adding query filter params (scope.project.id=e07b179ea18c4b83a0319ae5264c6e49, user.id=b7a613abdb314f8fb874c386ed29bddb) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:31.324148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.326191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.365391 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1417/2806] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 03:59:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:31.381578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.382821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:31.402881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1390/2807] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 03:59:31 2021] GET /identity/v3/role_assignments?scope.project.id=e07b179ea18c4b83a0319ae5264c6e49&user.id=b7a613abdb314f8fb874c386ed29bddb&effective => generated 577 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:31.407261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.418658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244a89-edf2-41fc-b31d-4bf1691d613c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.428773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.431792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.433045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.433480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.435409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.437822 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:31.437822 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:31.437822 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:31.439373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.463796 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9.: keystone.exception.ImpliedRoleNotFound: ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9. Nov 10 03:59:31.467184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1391/2808] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:31 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 137 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 03:59:31.473508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.488483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150194b-5946-47bc-8d92-068cfdc4a8c4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.503359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.504474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.504576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.504823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/ee4cc5e5590c44f0a5cb142b1e4c0832` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.514358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=ee4cc5e5590c44f0a5cb142b1e4c0832)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.517025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.532487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role ee4cc5e5590c44f0a5cb142b1e4c0832 was removed from user b7a613abdb314f8fb874c386ed29bddb on project e07b179ea18c4b83a0319ae5264c6e49. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:31.532771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:31.533572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:31.554006 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1392/2809] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 03:59:31 2021] DELETE /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/ee4cc5e5590c44f0a5cb142b1e4c0832 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:31.561358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.563592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:31.617431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2704e-639f-4b37-baac-81c06bb26d60 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.766121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f2e0-d1b5-4a45-9619-cd44062fb96b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.772533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.774947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.776268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.777450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.778943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.780264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.780817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.781572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.782503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:31.783583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.786703 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:31.786703 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:31.786703 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:31.788597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.810218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1393/2810] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:31 2021] POST /identity/v3/roles => generated 272 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:31.815645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.842029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062298-e84b-4435-9129-556f78e348e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.858493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.859817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.860320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.861255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.863247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Adding query filter params (domain_id=e094558a3d814c3cb4b95fc05d687471) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:31.863672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.866482 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domain_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:31.866482 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:31.866482 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:31.868153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.888667 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1394/2811] 10.222.0.13 () {58 vars in 1206 bytes} [Wed Nov 10 03:59:31 2021] GET /identity/v3/roles?domain_id=e094558a3d814c3cb4b95fc05d687471 => generated 409 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:31.892656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:31.923490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814f16-5371-4dbd-bdad-8b6e44b9843c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:31.946599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:31.947774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.948075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.948353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/006ab72a482e4b1d8a928914e710ec97` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.955711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.958462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6250-890b-4d1e-abec-365d7f4791d1 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:31.969551 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1418/2812] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:59:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 03:59:31.969888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=006ab72a482e4b1d8a928914e710ec97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:31.971035 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:31.971035 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:31.971035 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:31.971289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:31.971627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:31.972009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:31.972127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.026999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] MFA Rules not processed for user `25402f2151994aaa812407c629812b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:32.029963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:32.051418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 006ab72a482e4b1d8a928914e710ec97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:32.051810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:32.052620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:32.056759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1395/2813] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:31 2021] DELETE /identity/v3/roles/006ab72a482e4b1d8a928914e710ec97 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:32.063785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.065413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:32.094596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1419/2814] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:32.256873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec9b3-25f2-4fb0-b732-15d64ab4fc1a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.263195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.264093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.264446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.264959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.266084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Adding query filter params (domain_id=e094558a3d814c3cb4b95fc05d687471) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:32.266589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.268493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.276646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1396/2815] 10.222.0.13 () {58 vars in 1206 bytes} [Wed Nov 10 03:59:32 2021] GET /identity/v3/roles?domain_id=e094558a3d814c3cb4b95fc05d687471 => generated 148 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:32.279978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.318829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6380f-5bda-4729-a8ac-cb171d1eb5e2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.338743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.342780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.346056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.346555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/006ab72a482e4b1d8a928914e710ec97` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.398412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:59:32.407487 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Could not find role: 006ab72a482e4b1d8a928914e710ec97.: keystone.exception.RoleNotFound: Could not find role: 006ab72a482e4b1d8a928914e710ec97. Nov 10 03:59:32.413325 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1420/2816] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:32 2021] DELETE /identity/v3/roles/006ab72a482e4b1d8a928914e710ec97 => generated 110 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:32.415143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.426645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3bb0d-7013-4dc6-9f6a-462669be7f4c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.432654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.433588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.433873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.434151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.454393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.459095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.484513 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1397/2817] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:32 2021] PUT /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:32.488501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.505373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd15a1-fc49-4ef3-8b3a-ab44aaa76970 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.633007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.634804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.635207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.635577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.637541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e094558a3d814c3cb4b95fc05d687471, group_id=8ef01e63757840d5bc927e4a2ece082a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.638657 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_grants failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:32.638657 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:32.638657 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:32.640891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.661100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.673958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3299-01b5-440c-94ea-a5eae63565cb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.676196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1421/2818] 10.222.0.13 () {58 vars in 1364 bytes} [Wed Nov 10 03:59:32 2021] GET /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles => generated 409 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:32.681502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.682536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.682929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.683410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.686477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.687614 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:32.687614 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:32.687614 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:32.689839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.702106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1398/2819] 10.222.0.13 () {58 vars in 1464 bytes} [Wed Nov 10 03:59:32 2021] HEAD /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:32.702676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.718549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696150f-f6f5-482f-9a3a-eed6cdb9db1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.724297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.725372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.725662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.725941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.728940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.730124 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:32.730124 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:32.730124 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:32.732719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.748112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bdd1bf022d554d21a8b99c727add16d6 was removed from group 8ef01e63757840d5bc927e4a2ece082a on domain e094558a3d814c3cb4b95fc05d687471. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:32.748376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:32.749905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:32.785230 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1422/2820] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 03:59:32 2021] DELETE /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:32.791567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:32.793712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:32.807750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2551-59b0-4269-842c-9234c4d520fb tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:32.944020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:32.945690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:32.945982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:32.946267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:32.951376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:32.955147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:32.987770 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1399/2821] 10.222.0.13 () {60 vars in 1485 bytes} [Wed Nov 10 03:59:32 2021] PUT /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:32.988868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:33.005895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817ce5-ecb6-4705-a7fa-9c011667b7e4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:33.145758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:33.146955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.147343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.147748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.149971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_grants(project_id=e07b179ea18c4b83a0319ae5264c6e49, group_id=8ef01e63757840d5bc927e4a2ece082a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:33.152885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54917cc2-c8b1-4d12-93b1-f310e7b8f5b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:33.175272 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1423/2822] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 03:59:32 2021] GET /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles => generated 410 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:33.180374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:33.203344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af48d9-2b30-4b71-896b-6ffba94331ef tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:33.213417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:33.214451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.214597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.214870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/groups/8ef01e63757840d5bc927e4a2ece082a/users/b7a613abdb314f8fb874c386ed29bddb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.221824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8ef01e63757840d5bc927e4a2ece082a, user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:33.223287 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:add_user_to_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:33.223287 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:33.223287 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:33.224541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:33.296941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1400/2823] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 03:59:33 2021] PUT /identity/v3/groups/8ef01e63757840d5bc927e4a2ece082a/users/b7a613abdb314f8fb874c386ed29bddb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:33.301585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.302013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.302387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.384154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] MFA Rules not processed for user `b7a613abdb314f8fb874c386ed29bddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:33.385639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:33.596075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1424/2824] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:33 2021] POST /identity/v3/auth/tokens => generated 3257 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:33.599616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:33.706608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53e48-6478-49f1-b840-f9d07e270799 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:33.718620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:33.719728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.720900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.721491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.726486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:33.735325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:33.751793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1401/2825] 10.222.0.13 () {58 vars in 1467 bytes} [Wed Nov 10 03:59:33 2021] HEAD /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:33.755657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:33.770417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d3ab-7a0f-4b29-85cf-f1bb8d861107 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:33.777813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:33.779161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.779745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.780174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.783586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:33.787265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:33.797665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bdd1bf022d554d21a8b99c727add16d6 was removed from group 8ef01e63757840d5bc927e4a2ece082a on project e07b179ea18c4b83a0319ae5264c6e49. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:33.798361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:33.799529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:33.817216 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1425/2826] 10.222.0.13 () {58 vars in 1469 bytes} [Wed Nov 10 03:59:33 2021] DELETE /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:33.821159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:33.823733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:33.854885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a846326-0e04-4444-9c21-e6e6a799fa24 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:33.936126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:33.937339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:33.937731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:33.938107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/groups/8ef01e63757840d5bc927e4a2ece082a/users/b7a613abdb314f8fb874c386ed29bddb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:33.940007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8ef01e63757840d5bc927e4a2ece082a, user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:33.941176 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:remove_user_from_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:33.941176 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:33.941176 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:33.942991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:33.959261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:34.012890 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1402/2827] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 03:59:33 2021] DELETE /identity/v3/groups/8ef01e63757840d5bc927e4a2ece082a/users/b7a613abdb314f8fb874c386ed29bddb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.017321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.034803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf6ad-1ce0-47d5-9d3c-014a5ae2bb15 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.161053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.161896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.162224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.162507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.165261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.166484 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.166484 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:34.166484 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:34.167367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.190020 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1426/2828] 10.222.0.13 () {60 vars in 1380 bytes} [Wed Nov 10 03:59:34 2021] PUT /identity/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.194409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.214685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7696-d97d-4202-bd1f-68161573b196 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.244312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.246476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.246768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.247104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.252726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=8ef01e63757840d5bc927e4a2ece082a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.253813 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_system_grants_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.253813 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:34.253813 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:34.254694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.282204 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1403/2829] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 03:59:34 2021] GET /identity/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles => generated 375 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:34.283498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.298849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139247-b8aa-4b92-b235-80794d42a436 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.315788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.316685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.316972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.317248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.323607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.324877 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.324877 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:34.324877 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:34.326067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.335429 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1427/2830] 10.222.0.13 () {58 vars in 1362 bytes} [Wed Nov 10 03:59:34 2021] HEAD /identity/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.339652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.357075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ddc6-d46b-4b4d-a933-891e788c2e8b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.367946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.369761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.370215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.370698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.382312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=8ef01e63757840d5bc927e4a2ece082a, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.383691 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.383691 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:34.383691 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:34.385510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.401882 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1404/2831] 10.222.0.13 () {58 vars in 1364 bytes} [Wed Nov 10 03:59:34 2021] DELETE /identity/v3/system/groups/8ef01e63757840d5bc927e4a2ece082a/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.407060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.440311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731613-0874-4687-8eb7-8a76d244ced6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.453539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.454313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.454587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.454859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.489166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.507370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.604165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1428/2832] 10.222.0.13 () {60 vars in 1479 bytes} [Wed Nov 10 03:59:34 2021] PUT /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:34.613126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.634957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f962-88d1-4366-ba0d-a122c743b8b0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.713654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.714531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.714815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.715095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.725149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e094558a3d814c3cb4b95fc05d687471, user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.726496 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_grants failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.726496 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:34.726496 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:34.731841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.772009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1405/2833] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 10 03:59:34 2021] GET /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles => generated 408 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:34.773552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.791629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5389a-6303-44cf-8fed-573e4a2938b2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.809206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.810672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.811356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.811869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.815040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.821262 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:34.821262 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:34.821262 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:34.823487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.848995 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1429/2834] 10.222.0.13 () {58 vars in 1461 bytes} [Wed Nov 10 03:59:34 2021] HEAD /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.850300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.867628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d7bc-2c58-4e9f-a96b-fc1c694c44f6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:34.876257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:34.877601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:34.878169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:34.878862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:34.897078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e094558a3d814c3cb4b95fc05d687471, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:34.900084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:34.923784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bdd1bf022d554d21a8b99c727add16d6 was removed from user b7a613abdb314f8fb874c386ed29bddb on domain e094558a3d814c3cb4b95fc05d687471. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:34.924351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:34.925339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:34.977206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1406/2835] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 03:59:34 2021] DELETE /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:34.993421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:34.995317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:35.021065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60306-5e89-4be6-badb-e933ed0817c6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.185271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.186520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.186808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.193856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.204390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.208829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.248720 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1430/2836] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:34 2021] PUT /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:35.249914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:35.264570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e797-72e7-4bfc-98a8-d8a412331305 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.444444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.445536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.445918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.446310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.457696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_grants(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.460398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.483180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1407/2837] 10.222.0.13 () {58 vars in 1364 bytes} [Wed Nov 10 03:59:35 2021] GET /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles => generated 409 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:35.487436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:35.508195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed5246-3dd5-47b6-86fc-064c352b28a6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.520015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.522738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.523091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.526137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.557334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.560186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.585005 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1431/2838] 10.222.0.13 () {58 vars in 1464 bytes} [Wed Nov 10 03:59:35 2021] HEAD /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:35.586201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:35.604005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467789-cc8f-48be-b629-71b0f84d4a55 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.617752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.619640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.623648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.624235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.629389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e07b179ea18c4b83a0319ae5264c6e49, user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.641780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.665385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bdd1bf022d554d21a8b99c727add16d6 was removed from user b7a613abdb314f8fb874c386ed29bddb on project e07b179ea18c4b83a0319ae5264c6e49. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:35.666068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:35.667048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:35.700981 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1408/2839] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 03:59:35 2021] DELETE /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:35.708877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:35.720058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:35.757255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2afa-0e7e-42b9-9c5e-0ea6a9811306 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.892127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.893055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.893339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.893615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.895582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.897223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.919110 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1432/2840] 10.222.0.13 () {60 vars in 1377 bytes} [Wed Nov 10 03:59:35 2021] PUT /identity/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:35.924648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:35.937350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c565d3-29f7-43c7-970a-d89a76c91484 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:35.956819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:35.958481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:35.959898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:35.961622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:35.964931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:35.966267 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_system_grants_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:35.966267 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:35.966267 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:35.967825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:35.985288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1409/2841] 10.222.0.13 () {58 vars in 1259 bytes} [Wed Nov 10 03:59:35 2021] GET /identity/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles => generated 374 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:35.988298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.003669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3af-0741-457d-9f4f-8b4147a3c0a9 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.015611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.016963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.017372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.017899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.021061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.021061 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:36.021061 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:36.021061 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:36.022433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.029299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1433/2842] 10.222.0.13 () {58 vars in 1359 bytes} [Wed Nov 10 03:59:35 2021] HEAD /identity/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:36.033547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.053231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450704-7018-4807-97c0-1b7b51e4932b tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.064292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.065201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.065479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.065753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.077802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=b7a613abdb314f8fb874c386ed29bddb, role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.077802 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:36.077802 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:36.077802 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:36.077802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.102284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1410/2843] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 10 03:59:36 2021] DELETE /identity/v3/system/users/b7a613abdb314f8fb874c386ed29bddb/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:36.104179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.118453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77237-0b70-4779-9063-4b74083ba637 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.132093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.132997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.133468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.133855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.134815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.137797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.165126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1434/2844] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:36 2021] POST /identity/v3/roles => generated 269 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.167287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.184255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76976-37f3-4835-86e2-ef484e2ec2b3 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.193081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.193842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.194128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.194412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.195190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.197464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.242381 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1411/2845] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:36 2021] POST /identity/v3/roles => generated 270 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.244405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.262080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8c536-38ff-4f36-886b-4a5b668c7bbc tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.278070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.278994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.279273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.279554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/57460286bb304b4d94ff3c3cf05e7b1f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.286572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=57460286bb304b4d94ff3c3cf05e7b1f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.288447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.345214 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1435/2846] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:36 2021] PUT /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/57460286bb304b4d94ff3c3cf05e7b1f => generated 530 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.349335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.371341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cee2-b7f4-4ac3-9083-cd6fccf638ce tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.466607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.470366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.470665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.471173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.472560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.474377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.510456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1412/2847] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 03:59:36 2021] POST /identity/v3/domains => generated 276 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:36.514004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.532266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77add2-4af4-46ef-bb90-d2c8acf3901c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.661284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.662783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.663429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.663898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.664977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.667613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.688322 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1436/2848] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:36 2021] POST /identity/v3/roles => generated 270 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.692050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.706122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bcf8-2303-416d-8cfa-66f43e24b9c2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.714840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.716777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.717166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.717552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/a3171c3865e14c4c8892cf799c52f874` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.722134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=a3171c3865e14c4c8892cf799c52f874)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.729239 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:36.729239 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:36.729239 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:36.730744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebe05e-71d4-4b10-a83f-c6a477742c45 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.772873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1413/2849] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:36 2021] PUT /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/a3171c3865e14c4c8892cf799c52f874 => generated 530 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.778238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:36.793703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.794449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.795042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.799615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daffeb-3ac9-462f-b9e8-d90f63ca8bdd tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:36.857408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] MFA Rules not processed for user `ebb77877fd9f4a398e15837f80b60bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:36.859329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:36.922866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:36.924353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:36.924793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:36.925180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:36.927387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:36.929141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:36.976637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1437/2850] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:36 2021] PUT /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 524 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:36.977576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:37.016576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1414/2851] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:36 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:37.067372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be5b23-81a9-43e6-9a22-041293c767e2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:37.080072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:37.080072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.080072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.080631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bdd1bf022d554d21a8b99c727add16d6/implies/bcfb341f9e1e4859b5e7d36f17e66b75` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.086516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bdd1bf022d554d21a8b99c727add16d6, implied_role_id=bcfb341f9e1e4859b5e7d36f17e66b75)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:37.089529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:37.153203 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] bcfb341f9e1e4859b5e7d36f17e66b75 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: bcfb341f9e1e4859b5e7d36f17e66b75 cannot be an implied roles. Nov 10 03:59:37.171928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1438/2852] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:36 2021] PUT /identity/v3/roles/bdd1bf022d554d21a8b99c727add16d6/implies/bcfb341f9e1e4859b5e7d36f17e66b75 => generated 116 bytes in 192 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:37.174613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:37.205857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bda0-0f95-4e1b-ad90-631581370a02 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:37.220343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:37.221254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.221621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.221832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.228933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:37.228933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:37.271914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1415/2853] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:37 2021] DELETE /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:37.275748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:37.295000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c00b-41e6-487f-8457-8fe8ac9ff266 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:37.490421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:37.491508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.494259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.494259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/a3171c3865e14c4c8892cf799c52f874` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.495733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=a3171c3865e14c4c8892cf799c52f874)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:37.497598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb79f57-0ffb-4a69-9bd0-ccfc64fba113 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:37.516957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1439/2854] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:37 2021] DELETE /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/a3171c3865e14c4c8892cf799c52f874 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:37.521171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:37.531624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e27a-d21a-4786-8b59-612b40e76c37 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:37.789440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:37.790891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.791167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.791437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/a3171c3865e14c4c8892cf799c52f874` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.802913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a3171c3865e14c4c8892cf799c52f874)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:37.812884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:37.880881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473680c-375d-4466-a391-0cf7783b8e6b None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.881166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473680c-375d-4466-a391-0cf7783b8e6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.881451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473680c-375d-4466-a391-0cf7783b8e6b None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.883320 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1440/2855] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 03:59:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 03:59:37.899051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003e2c-b412-41d6-8899-94e292023985 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:37.899462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003e2c-b412-41d6-8899-94e292023985 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:37.899634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003e2c-b412-41d6-8899-94e292023985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:37.939667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role a3171c3865e14c4c8892cf799c52f874 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:37.940016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:37.941155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:37.944052 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1416/2856] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:37 2021] DELETE /identity/v3/roles/a3171c3865e14c4c8892cf799c52f874 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:37.949534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:37.953155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:37.959461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-70003e2c-b412-41d6-8899-94e292023985 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:37.960747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70003e2c-b412-41d6-8899-94e292023985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:38.095931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1441/2857] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 03:59:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:38.112328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740fcc8-7e9b-42e3-ae9a-c656c4dd6a6f tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:38.131544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:38.132627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:38.133083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:38.134494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/113f98b498764a6cbd5e2b2eded29501` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:38.153515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003e2c-b412-41d6-8899-94e292023985 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:38.155000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70003e2c-b412-41d6-8899-94e292023985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:38.170249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=113f98b498764a6cbd5e2b2eded29501)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:38.172670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:38.184405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003e2c-b412-41d6-8899-94e292023985 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:38.201421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:38.202075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:38.202350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:38.202794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:38.224041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.226544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.227054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:38.229427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:38.255960 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1442/2858] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 03:59:38.288235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.289970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.295780 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1417/2859] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:37 2021] PATCH /identity/v3/domains/113f98b498764a6cbd5e2b2eded29501 => generated 277 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:38.299503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:38.323066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135772b5-22ff-4a28-81cd-05776b8a2933 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:38.475754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:38.478899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:38.480290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:38.480707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/113f98b498764a6cbd5e2b2eded29501` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:38.512301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=113f98b498764a6cbd5e2b2eded29501)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:38.516540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:38.568419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.600378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '113f98b498764a6cbd5e2b2eded29501'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.746863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.792051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.811729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.849329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] The token cache is being invalidate because project 113f98b498764a6cbd5e2b2eded29501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:38.850643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.851121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.881633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.891276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.896071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '113f98b498764a6cbd5e2b2eded29501', 'request_id': 'req-dce5e602-6644-42dd-8350-b313f7517186'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:38.909158 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1443/2860] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:38 2021] DELETE /identity/v3/domains/113f98b498764a6cbd5e2b2eded29501 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:38.909913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:38.911425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:38.938947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fdab-de27-4609-be98-922099c5ce1d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:39.094491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:39.097205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:39.098332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:39.098770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/57460286bb304b4d94ff3c3cf05e7b1f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:39.104308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcfb341f9e1e4859b5e7d36f17e66b75, implied_role_id=57460286bb304b4d94ff3c3cf05e7b1f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:39.109060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:39.128235 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1418/2861] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:38 2021] DELETE /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75/implies/57460286bb304b4d94ff3c3cf05e7b1f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:39.133044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:39.134724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:39.160475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e602-6644-42dd-8350-b313f7517186 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:39.383491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:39.388324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:39.389355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:39.390624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/57460286bb304b4d94ff3c3cf05e7b1f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:39.395363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=57460286bb304b4d94ff3c3cf05e7b1f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:39.407856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:39.508342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 57460286bb304b4d94ff3c3cf05e7b1f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:39.594737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:39.609651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:39.617768 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1444/2862] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:39 2021] DELETE /identity/v3/roles/57460286bb304b4d94ff3c3cf05e7b1f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:39.618283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:39.625166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:39.652249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c169-0809-4434-ad3c-5f0800e8b8a2 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:39.759227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:39.759868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:39.760204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:39.760592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:39.762062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bcfb341f9e1e4859b5e7d36f17e66b75)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:39.764257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:39.911498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bcfb341f9e1e4859b5e7d36f17e66b75 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:39.911498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:39.913209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:39.920218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1419/2863] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:39 2021] DELETE /identity/v3/roles/bcfb341f9e1e4859b5e7d36f17e66b75 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:39.921099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:39.938969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e953-8f7c-484f-a729-0ab633b770ab tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.060426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.061565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.061981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.062397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.064451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.066310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.102905 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1445/2864] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:39 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 520 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:40.105086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.107362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:40.134381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1c85-b6d4-4828-acc5-e15539e60748 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.326332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.329300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.329748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.330981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.336558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.339322 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:40.339322 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:40.339322 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:40.341146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.342778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.344776 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:40.344776 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:40.344776 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:40.346037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.357807 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1420/2865] 10.222.0.13 () {58 vars in 1344 bytes} [Wed Nov 10 03:59:40 2021] HEAD /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:40.363673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.379597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcb09-2fb1-48c6-bbb4-61105f653293 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.385865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.387124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.387610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.389038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.393415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.396213 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:40.396213 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:40.396213 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:40.397708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.412042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.413073 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1446/2866] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 03:59:40 2021] GET /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 520 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:40.435153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf150f-b7d3-4201-850e-7fda2536269c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.441672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.443849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.444369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.445499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.448594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.453826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.473729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.474176 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1421/2867] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:40 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:40.488890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1688c-735e-4165-abff-e4ded77b1b08 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.616355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.617731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.617731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.620036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.623407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.625143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.656454 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9.: keystone.exception.ImpliedRoleNotFound: ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9. Nov 10 03:59:40.662825 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1447/2868] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 03:59:40 2021] GET /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 137 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 03:59:40.665594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.681770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d399f-8677-4ca3-abb8-e1ae8eee90c5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.693928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.697398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.697966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.698443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.700816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.703102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.721471 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9.: keystone.exception.ImpliedRoleNotFound: ee4cc5e5590c44f0a5cb142b1e4c0832 does not imply 87d890d426884dbdad21dcbbf53888a9. Nov 10 03:59:40.723253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1422/2869] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:40 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 137 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:40.733339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.746906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b251-372b-4dca-a875-c8836a556004 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.753389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.754439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.754726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.755005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.756983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.760409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:40.817080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1448/2870] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:40 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 520 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:40.817327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:40.845344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aca22-911b-4d2c-9b63-d03541202e73 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:40.974822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:40.977798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:40.978043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:40.978326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:40.982551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:40.984169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.022038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1423/2871] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:40 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78 => generated 520 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:41.029196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.048744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5a46a-22c7-491e-ac82-1207fda8b765 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:41.164465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:41.165970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:41.166427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:41.167065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:41.169278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=47883565102c47dcab55cf8811240a78, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:41.172127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.207854 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1449/2872] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:41 2021] PUT /identity/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 519 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:41.209092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.226195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764d89-8178-4963-a0f8-dfdcfdbf8449 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:41.363639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:41.364758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:41.365096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:41.365546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:41.366606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:41.367785 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_inference_rules failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:41.367785 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:41.367785 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:41.369620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.408887 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1424/2873] 10.222.0.13 () {58 vars in 1151 bytes} [Wed Nov 10 03:59:41 2021] GET /identity/v3/role_inferences => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:41.413641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.433895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3eb8d-ecb5-495a-9ef2-9dfecb67b6ff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:41.446616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:41.447962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:41.451853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:41.452171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:41.456184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=47883565102c47dcab55cf8811240a78, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:41.460751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.489275 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1450/2874] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:41 2021] DELETE /identity/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:41.493924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.510667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c812cf-b8df-4b4f-b5ef-96178555aad7 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:41.668107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:41.669556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:41.670042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:41.670863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:41.674197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:41.676275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.692784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1425/2875] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:41 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:41.697321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.709122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f55f28-ff9e-4356-9b2f-1042f0b8d728 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:41.857754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:41.858693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:41.858977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:41.859260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:41.862749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:41.864399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:41.889167 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1451/2876] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:41 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:41.895951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:41.927698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae791-23cf-4eef-99df-ef99a694acb4 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.099216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.100041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.100385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.101105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.101733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.105193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.173339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.178623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1426/2877] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:41 2021] GET /identity/v3/roles => generated 2321 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:42.188390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55387d1-70dd-4469-8b19-ae86bb626868 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.219364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.220054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.220340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.220649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.225067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.226704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.256495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1452/2878] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 03:59:42 2021] POST /identity/v3/roles => generated 235 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:42.261503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.293715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34586-2b6b-4c78-b90e-2262d470e51e tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.302738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.303612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.306105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.306105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/d788b6293f4443a8ab7beddaa147cbc3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.310157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:update_role(role_id=d788b6293f4443a8ab7beddaa147cbc3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.311284 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:42.311284 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:42.311284 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:42.312159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.373300 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1427/2879] 10.222.0.13 () {60 vars in 1242 bytes} [Wed Nov 10 03:59:42 2021] PATCH /identity/v3/roles/d788b6293f4443a8ab7beddaa147cbc3 => generated 238 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:42.377857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.398961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec4bf-6f4a-4840-bf6f-3c1af6bdb139 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.413490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.427424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.428012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.428012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/d788b6293f4443a8ab7beddaa147cbc3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.449514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:get_role(role_id=d788b6293f4443a8ab7beddaa147cbc3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.453745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.456566 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1453/2880] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 03:59:42 2021] GET /identity/v3/roles/d788b6293f4443a8ab7beddaa147cbc3 => generated 238 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:42.460981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.476874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fd06d-9b02-4d19-b04e-dece84f8ddd6 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.487193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.487894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.488182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.489048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.489830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.491487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.525729 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1428/2881] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:42 2021] GET /identity/v3/roles => generated 2550 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:42.527014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.538887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230112-b84a-401b-8bca-62652628c8a5 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.553229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.553755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.554109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.554338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/d788b6293f4443a8ab7beddaa147cbc3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.557031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d788b6293f4443a8ab7beddaa147cbc3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.562470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.653699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role d788b6293f4443a8ab7beddaa147cbc3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:42.654266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:42.658374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:42.663462 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1454/2882] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:42 2021] DELETE /identity/v3/roles/d788b6293f4443a8ab7beddaa147cbc3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:42.669442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.671762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:42.694032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13215-a206-41a6-a389-ac59056ebf72 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:42.873707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:42.875275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:42.875803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:42.876243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:42.888017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:42.892365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:42.959092 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1429/2883] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:42 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 520 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:42.962337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:42.989714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d257-afb3-4775-b7b4-0d36b8349eff tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:43.127575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:43.128562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:43.128876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:43.129199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:43.136794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:43.142298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:43.206661 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1455/2884] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:42 2021] PUT /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78 => generated 520 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:43.210548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:43.234128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abf269-ebea-426d-a694-d859d2f1ea79 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:43.388389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:43.393022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:43.394538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:43.395466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:43.407304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=47883565102c47dcab55cf8811240a78, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:43.409697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:43.487922 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1430/2885] 10.222.0.13 () {60 vars in 1362 bytes} [Wed Nov 10 03:59:43 2021] PUT /identity/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 519 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:43.491895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:43.504171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2649-01d6-4833-acce-933c84146453 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:43.685143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:43.686009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:43.686290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:43.686561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78/implies` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:43.689376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:43.690400 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_implied_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:43.690400 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:43.690400 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:43.691823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:43.716904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1456/2886] 10.222.0.13 () {58 vars in 1244 bytes} [Wed Nov 10 03:59:43 2021] GET /identity/v3/roles/47883565102c47dcab55cf8811240a78/implies => generated 488 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:43.723510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:43.737497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48653-8a91-4d42-82c0-41997fcddcea tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:43.749541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:43.750428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:43.750699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:43.750974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:43.752217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:43.754577 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_implied_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:43.754577 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:43.754577 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:43.756179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:43.772523 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1431/2887] 10.222.0.13 () {58 vars in 1244 bytes} [Wed Nov 10 03:59:43 2021] GET /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies => generated 659 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:43.773595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:43.788863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5e06c-a86a-4358-8677-bda658a2edae tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:43.809313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:43.810546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:43.810975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:43.811407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:43.816249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=47883565102c47dcab55cf8811240a78, implied_role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:43.819397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:43.863972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1457/2888] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:43 2021] DELETE /identity/v3/roles/47883565102c47dcab55cf8811240a78/implies/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:43.869959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:43.919188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920817d7-8966-4cec-9005-856ef761ff8c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:44.070366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:44.072125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:44.072411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:44.072732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:44.087045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:44.093022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:44.120399 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1432/2889] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:43 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/47883565102c47dcab55cf8811240a78 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:44.122755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:44.135176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314438-4df2-4d72-8ee0-dabce731ab28 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:44.310348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:44.313530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:44.315066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:44.315066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:44.330231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ee4cc5e5590c44f0a5cb142b1e4c0832, implied_role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:44.331936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:44.360066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1458/2890] 10.222.0.13 () {58 vars in 1346 bytes} [Wed Nov 10 03:59:44 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832/implies/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:44.361286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:44.384266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4db39-64df-4012-9ce5-897ee3961302 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:44.530337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:44.531218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:44.531501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:44.531775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/113f98b498764a6cbd5e2b2eded29501` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:44.548646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 03:59:44.568231 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Could not find domain: 113f98b498764a6cbd5e2b2eded29501.: keystone.exception.DomainNotFound: Could not find domain: 113f98b498764a6cbd5e2b2eded29501. Nov 10 03:59:44.569533 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1433/2891] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:44 2021] PATCH /identity/v3/domains/113f98b498764a6cbd5e2b2eded29501 => generated 112 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 03:59:44.573888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:44.590536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02dafa-db25-49f7-a1eb-52c9522afe82 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:44.603876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:44.604789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:44.605076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:44.605351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/users/b7a613abdb314f8fb874c386ed29bddb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:44.606732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b7a613abdb314f8fb874c386ed29bddb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:44.611194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:44.726348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:44.746678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:44.751853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:44.753625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:44.782717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a613abdb314f8fb874c386ed29bddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:44.865043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1459/2892] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:44 2021] DELETE /identity/v3/users/b7a613abdb314f8fb874c386ed29bddb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:44.869182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:44.871180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:44.898168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a6c3-ae2f-4bd7-88a8-ece63355d5f0 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:45.013859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:45.014841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:45.015187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:45.015464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/bdd1bf022d554d21a8b99c727add16d6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:45.017000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bdd1bf022d554d21a8b99c727add16d6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:45.018228 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:45.018228 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 03:59:45.018228 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 03:59:45.019089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:45.066009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role bdd1bf022d554d21a8b99c727add16d6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:45.066333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.067007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.070803 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1434/2893] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:44 2021] DELETE /identity/v3/roles/bdd1bf022d554d21a8b99c727add16d6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:45.074707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:45.097327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e85a-aa0b-4000-86e2-935303ee2551 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:45.257283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:45.258280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:45.260314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:45.260867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/groups/8ef01e63757840d5bc927e4a2ece082a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:45.267151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8ef01e63757840d5bc927e4a2ece082a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:45.268744 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 03:59:45.268744 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 03:59:45.268744 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 03:59:45.270493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:45.468887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1460/2894] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 03:59:45 2021] DELETE /identity/v3/groups/8ef01e63757840d5bc927e4a2ece082a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:45.475567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:45.481570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:45.507828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6e39-bf37-4fc5-8ae0-2093cc1a2087 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:45.705737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:45.708925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:45.709239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:45.709524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/projects/e07b179ea18c4b83a0319ae5264c6e49` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:45.713184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e07b179ea18c4b83a0319ae5264c6e49)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:45.715107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:45.849262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07b179ea18c4b83a0319ae5264c6e49', 'request_id': 'req-9e7dc803-8524-4806-b73a-281931aa1e4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.880297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07b179ea18c4b83a0319ae5264c6e49', 'request_id': 'req-9e7dc803-8524-4806-b73a-281931aa1e4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.910451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07b179ea18c4b83a0319ae5264c6e49', 'request_id': 'req-9e7dc803-8524-4806-b73a-281931aa1e4d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.960808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] The token cache is being invalidate because project e07b179ea18c4b83a0319ae5264c6e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:45.961089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.962837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:45.971393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:45.971949 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1435/2895] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:45 2021] DELETE /identity/v3/projects/e07b179ea18c4b83a0319ae5264c6e49 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:45.973271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:46.007979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4e1c-2c4c-4cae-8198-ca8d85594b2c tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:46.099648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:46.101903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:46.103567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:46.104257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:46.107619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e094558a3d814c3cb4b95fc05d687471)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:46.110776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:46.145549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.147133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.182917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.183553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.190512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:46.197377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1461/2896] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 03:59:45 2021] PATCH /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471 => generated 277 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:46.205667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc803-8524-4806-b73a-281931aa1e4d tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:46.315241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:46.316334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:46.316647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:46.319009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/domains/e094558a3d814c3cb4b95fc05d687471` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:46.338000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e094558a3d814c3cb4b95fc05d687471)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:46.339678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:46.400784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.409831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.556242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.579492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.610713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.632458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] The token cache is being invalidate because project e094558a3d814c3cb4b95fc05d687471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:46.633364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.634793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.652679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.673888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.674879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e094558a3d814c3cb4b95fc05d687471', 'request_id': 'req-b750a1b1-f197-4228-8838-226af9afbb56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.684584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1436/2897] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 03:59:46 2021] DELETE /identity/v3/domains/e094558a3d814c3cb4b95fc05d687471 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:46.688361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:46.690194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:46.706750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43329-9122-449f-bf9b-6b60a384553a tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:46.771756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:46.772443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:46.772888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:46.773241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/47883565102c47dcab55cf8811240a78` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:46.775440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_role(role_id=47883565102c47dcab55cf8811240a78)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:46.777289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:46.845697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 47883565102c47dcab55cf8811240a78 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:46.846123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.847468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:46.850726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1462/2898] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:46 2021] DELETE /identity/v3/roles/47883565102c47dcab55cf8811240a78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:46.855578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:46.858409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:46.874172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a1b1-f197-4228-8838-226af9afbb56 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:46.972053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:46.973338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:46.973625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:46.973902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/87d890d426884dbdad21dcbbf53888a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:46.975937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_role(role_id=87d890d426884dbdad21dcbbf53888a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:46.977656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:47.056016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role 87d890d426884dbdad21dcbbf53888a9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:47.056248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.056949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.059469 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1437/2899] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:46 2021] DELETE /identity/v3/roles/87d890d426884dbdad21dcbbf53888a9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:47.063255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:47.079248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:47.148795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd074-bc04-442e-a05d-18198a35f001 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:47.345769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969aa36a47fa4930bbced24c2b60f685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b33ab7e45f46c0857c5677bb7b7875', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:47.346813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:47.358571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:47.359125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] PATH_INFO: `/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:47.361804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee4cc5e5590c44f0a5cb142b1e4c0832)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:47.366628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:47.449784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invalidating the token cache because role ee4cc5e5590c44f0a5cb142b1e4c0832 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:47.450538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.452318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d18969-5c1c-4011-9240-03d46fdc8494 tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.455018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1463/2900] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:47 2021] DELETE /identity/v3/roles/ee4cc5e5590c44f0a5cb142b1e4c0832 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:47.458666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:47.460375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:47.643513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f64b9-5486-4932-a7a3-e7ea8a24fece tempest-RolesV3TestJSON-1700689835 tempest-RolesV3TestJSON-1700689835-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:47.746666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:47.747809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:47.748394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:47.748843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] PATH_INFO: `/v3/users/54944dfb19ff4e5aaf18d101ccfa1c6c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:47.750251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54944dfb19ff4e5aaf18d101ccfa1c6c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:47.752533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:47.846620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54944dfb19ff4e5aaf18d101ccfa1c6c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.860104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54944dfb19ff4e5aaf18d101ccfa1c6c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.861152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54944dfb19ff4e5aaf18d101ccfa1c6c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.892755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54944dfb19ff4e5aaf18d101ccfa1c6c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.908239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54944dfb19ff4e5aaf18d101ccfa1c6c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:47.921468 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1438/2901] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:47 2021] DELETE /identity/v3/users/54944dfb19ff4e5aaf18d101ccfa1c6c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:47.923233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:47.924034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:47.925179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:47.955909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:47.955909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:48.116094 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1464/2902] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 03:59:48.181770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:48.183369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:48.335133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10901554-5ac8-40d0-ac8a-82d6027f3e3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:48.347595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:48.348269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:48.348548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:48.348849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:48.365741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:48.370252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:48.393890 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1439/2903] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:49.223746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:49.225480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:49.292174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e992f-7004-423a-ab9b-b584229abf79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:49.328906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:49.330093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:49.330534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:49.330976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] PATH_INFO: `/v3/projects/e820974013534b01bd497f65ddf15f1e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:49.332399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e820974013534b01bd497f65ddf15f1e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:49.334618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:49.473047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e820974013534b01bd497f65ddf15f1e', 'request_id': 'req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.498472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e820974013534b01bd497f65ddf15f1e', 'request_id': 'req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.507377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e820974013534b01bd497f65ddf15f1e', 'request_id': 'req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.535846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] The token cache is being invalidate because project e820974013534b01bd497f65ddf15f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:49.536563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.538067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f08f4ecf-1f3e-40c3-adbd-7990e2245c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.545263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:49.557655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1465/2904] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:49 2021] DELETE /identity/v3/projects/e820974013534b01bd497f65ddf15f1e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:49.574908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f14d-e970-432a-a113-7fdd79046be7 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:49.767110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:49.768253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:49.769078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:49.769628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] PATH_INFO: `/v3/users/969aa36a47fa4930bbced24c2b60f685` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:49.771749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=969aa36a47fa4930bbced24c2b60f685)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:49.776854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:49.880792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969aa36a47fa4930bbced24c2b60f685'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.889565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969aa36a47fa4930bbced24c2b60f685'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.890888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969aa36a47fa4930bbced24c2b60f685'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.913991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969aa36a47fa4930bbced24c2b60f685'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.930461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969aa36a47fa4930bbced24c2b60f685'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:49.956360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1440/2905] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:49 2021] DELETE /identity/v3/users/969aa36a47fa4930bbced24c2b60f685 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:50.085374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378e55-54f2-40ac-9177-30506a76d493 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:50.085687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378e55-54f2-40ac-9177-30506a76d493 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:50.085976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378e55-54f2-40ac-9177-30506a76d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:50.121728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-09378e55-54f2-40ac-9177-30506a76d493 None None] MFA Rules not processed for user `babb6fa91c674360b017571d83afc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:50.123580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-09378e55-54f2-40ac-9177-30506a76d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:50.255272 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1466/2906] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:50 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:50.796744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:50.798313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:50.931425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74a43-7422-4396-98af-58f5b00e30ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:50.943922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:50.945158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:50.945661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:50.946679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] PATH_INFO: `/v3/projects/46b33ab7e45f46c0857c5677bb7b7875` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:50.948353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b33ab7e45f46c0857c5677bb7b7875)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:50.950823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.032892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b33ab7e45f46c0857c5677bb7b7875', 'request_id': 'req-df64b864-becf-4d9a-8a97-ba98d65559a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:51.050883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b33ab7e45f46c0857c5677bb7b7875', 'request_id': 'req-df64b864-becf-4d9a-8a97-ba98d65559a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:51.059292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b33ab7e45f46c0857c5677bb7b7875', 'request_id': 'req-df64b864-becf-4d9a-8a97-ba98d65559a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:51.105465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] The token cache is being invalidate because project 46b33ab7e45f46c0857c5677bb7b7875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:51.106096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:51.108962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df64b864-becf-4d9a-8a97-ba98d65559a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:51.111396 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1441/2907] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:50 2021] DELETE /identity/v3/projects/46b33ab7e45f46c0857c5677bb7b7875 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:51.117225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.117574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.118665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.154035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:51.155772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:51.286622 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1467/2908] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:51.287175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.287420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.287737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.331923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:51.333186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:51.358350 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1442/2909] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:51.363517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.380171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951cf0d-216f-4e20-90d6-19d005d175f1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.386941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.390981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.391552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.391988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.393925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:51.394420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.413511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.435654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.437426 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1468/2910] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:51.450127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c6f2e-a324-4ce5-b9af-e5537e77e24b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.461202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.462418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.462691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.462959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.463668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.469040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.545933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1443/2911] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:51 2021] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:51.549172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.561725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a37ac-813f-4322-9d66-42e054505dc2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.721379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.722334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.722800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.723216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.724149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.728211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.778243 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1469/2912] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:51 2021] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:51.782441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.809159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a550f-c697-421c-8697-22103c9ae077 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.814566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.815248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.815528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.815804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.817269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.819063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.842077 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1444/2913] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:51 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:51.845349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.858439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250b794-4fd0-42b6-a75a-668a66cc5e74 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.867862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.869482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.869916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.870506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.871632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.874191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7496-f836-43a1-9f14-207cc148ed94 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.893970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1470/2914] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:51 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 03:59:51.897940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:51.911442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078103-a1b0-4031-83c2-7ca2633edeca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:51.919270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:51.920175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.920456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.920767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] PATH_INFO: `/v3/projects/23ffe092a3e548b4a4f339adfaa1073c/users/5e33a9cba691479aa9bf2344a108066d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.939126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ffe092a3e548b4a4f339adfaa1073c, user_id=5e33a9cba691479aa9bf2344a108066d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:51.942030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:51.985287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a2a-ea2b-4f4f-9a2c-e4d46df00548 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:51.985590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a2a-ea2b-4f4f-9a2c-e4d46df00548 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:51.985877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a2a-ea2b-4f4f-9a2c-e4d46df00548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:51.987438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1445/2915] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:51 2021] PUT /identity/v3/projects/23ffe092a3e548b4a4f339adfaa1073c/users/5e33a9cba691479aa9bf2344a108066d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:52.019261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5d031a2a-ea2b-4f4f-9a2c-e4d46df00548 None None] MFA Rules not processed for user `5e33a9cba691479aa9bf2344a108066d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:52.021072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5d031a2a-ea2b-4f4f-9a2c-e4d46df00548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:52.132718 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1471/2916] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:51 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:52.135225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.147662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b589e0-2710-4692-999c-b256b7649e92 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.157632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.159132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.159580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.173335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.176577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.182649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.183150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.185523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.186898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.238389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:52.242380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:52.366278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1472/2917] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:52.384047 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1446/2918] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 03:59:52 2021] POST /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials => generated 921 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:52.384748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.397652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398ac2-bfbe-4854-8445-06ccd113b8fc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.403643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.405706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.406369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.407315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/e8028efd6d2541ea983fdcab28a90617` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.411825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:delete_access_rule(user_id=5e33a9cba691479aa9bf2344a108066d, access_rule_id=e8028efd6d2541ea983fdcab28a90617)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.414644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.477775 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Nov 10 03:59:52.479814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1473/2919] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 10 03:59:52 2021] DELETE /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/e8028efd6d2541ea983fdcab28a90617 => generated 89 bytes in 96 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Nov 10 03:59:52.495014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.496727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4a8c-b66a-4ac1-83af-93e4f43558db tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.510077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.511405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.511990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.512507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials/3e2b9f098ac448e2a5a868581e4a3d8e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.542641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e33a9cba691479aa9bf2344a108066d, application_credential_id=3e2b9f098ac448e2a5a868581e4a3d8e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.546066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.616369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1447/2920] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 03:59:52 2021] DELETE /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials/3e2b9f098ac448e2a5a868581e4a3d8e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:52.620792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.640011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c7f0-d6b1-49d8-8723-a1e6dda759e1 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.654036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.656513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.657116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.658610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.662012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:list_access_rules(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.663796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.684296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1474/2921] 10.222.0.13 () {58 vars in 1259 bytes} [Wed Nov 10 03:59:52 2021] GET /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules => generated 369 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:52.687128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.701003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f5455-e293-4d53-8e42-da73de7fdaed tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.721557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.722943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.723377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.723828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/e8028efd6d2541ea983fdcab28a90617` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.725728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:delete_access_rule(user_id=5e33a9cba691479aa9bf2344a108066d, access_rule_id=e8028efd6d2541ea983fdcab28a90617)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.728526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.772764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1448/2922] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 10 03:59:52 2021] DELETE /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/e8028efd6d2541ea983fdcab28a90617 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:52.778355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.795818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bad-cfc3-4ea8-9102-d5066f326478 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.813046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.814318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.815504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.816072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.818939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:list_access_rules(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.838787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:52.845600 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1475/2923] 10.222.0.13 () {58 vars in 1259 bytes} [Wed Nov 10 03:59:52 2021] GET /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules => generated 158 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:52.854426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:52.869463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b78e28-9f59-4872-9591-536884b5872f tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:52.889511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:52.892133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:52.894978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:52.896168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:52.900250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:52.906687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.045553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1449/2924] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 03:59:52 2021] POST /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials => generated 920 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:53.050157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.060574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.066906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:53.067268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf879-4059-4b72-bd31-62436be7a0cf tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.085288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.086273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.089177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.090791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.095997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:list_access_rules(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.098178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.119211 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1476/2925] 10.222.0.13 () {58 vars in 1259 bytes} [Wed Nov 10 03:59:53 2021] GET /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules => generated 369 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:53.125600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.137589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:53.198434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad989-fdcd-4cfa-b1d5-319e72aba593 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.204810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.205471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.206687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.206985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.209130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:53.235012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.236833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.267941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1450/2926] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:53.269190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.280815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd07a4-9f42-48c3-b860-c13847904905 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.307644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.312012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.316391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682b2a-b17f-421e-a26b-92901bdf3e24 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.318888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.319860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.334935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.335746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.336030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.336345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.340014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.341754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:53.343301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.365804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.369546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.392155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1477/2927] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:53.618904 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1451/2928] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 03:59:53 2021] POST /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/application_credentials => generated 921 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:53.623228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.637249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d3a33-fc49-4d1c-b773-d40467c24574 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.652138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e33a9cba691479aa9bf2344a108066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ffe092a3e548b4a4f339adfaa1073c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.653348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.653777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.654212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/a744e4eac9d04194adf9529688396709` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.655647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorizing `identity:get_access_rule(user_id=5e33a9cba691479aa9bf2344a108066d, access_rule_id=a744e4eac9d04194adf9529688396709)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.657131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b460f02-3329-4d4b-b6c9-671b4ef017d3 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.675844 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1478/2929] 10.222.0.13 () {58 vars in 1358 bytes} [Wed Nov 10 03:59:53 2021] GET /identity/v3/users/5e33a9cba691479aa9bf2344a108066d/access_rules/a744e4eac9d04194adf9529688396709 => generated 229 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 03:59:53.682527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:53.816365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484400-68cd-4097-a962-b6ce8dac3cb9 tempest-AccessRulesV3Test-1676062289 tempest-AccessRulesV3Test-1676062289-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:53.835567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:53.837163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:53.837464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:53.837733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] PATH_INFO: `/v3/users/5e33a9cba691479aa9bf2344a108066d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:53.839801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e33a9cba691479aa9bf2344a108066d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:53.841742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:53.972691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e33a9cba691479aa9bf2344a108066d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:53.991644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e33a9cba691479aa9bf2344a108066d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:53.993103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e33a9cba691479aa9bf2344a108066d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:54.076908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e33a9cba691479aa9bf2344a108066d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:54.107511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e33a9cba691479aa9bf2344a108066d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:54.126498 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1452/2930] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 03:59:53 2021] DELETE /identity/v3/users/5e33a9cba691479aa9bf2344a108066d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:54.127710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:54.127996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:54.128267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:54.174980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:54.176555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:54.419679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1479/2931] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:54.433762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:54.436087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:54.620883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e25b9-7c4b-4683-aee8-dd38819b71a7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:54.625678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:54.626385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:54.626802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:54.627136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:54.641064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:54.643351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34571493-cdba-4e3e-9481-0475970d9bfa service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:54.673314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1453/2932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 03:59:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 03:59:56.876913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:56.878407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:56.890616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc423-b3eb-4010-8455-e64e3c9057ce None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:56.895746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:56.896871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:56.897316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:56.897792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] PATH_INFO: `/v3/projects/23ffe092a3e548b4a4f339adfaa1073c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:56.899853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ffe092a3e548b4a4f339adfaa1073c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:56.902125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:56.963833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ffe092a3e548b4a4f339adfaa1073c', 'request_id': 'req-0ff195d3-a03c-489b-9bab-111329203c92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:56.969902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ffe092a3e548b4a4f339adfaa1073c', 'request_id': 'req-0ff195d3-a03c-489b-9bab-111329203c92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:56.980274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ffe092a3e548b4a4f339adfaa1073c', 'request_id': 'req-0ff195d3-a03c-489b-9bab-111329203c92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:57.001117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] The token cache is being invalidate because project 23ffe092a3e548b4a4f339adfaa1073c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 03:59:57.002151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:57.003186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ff195d3-a03c-489b-9bab-111329203c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:57.011615 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1480/2933] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 03:59:56 2021] DELETE /identity/v3/projects/23ffe092a3e548b4a4f339adfaa1073c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:57.012489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.013030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.013116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.033037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:57.034326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:57.109694 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1454/2934] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:57.111525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.111829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.112091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.158117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:57.159347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:57.183165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1481/2935] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:57.187618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.199981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e105-46ab-4611-9300-b08ad4aa4261 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.210236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.210910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.211188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.212031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.212806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 03:59:57.213112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.214808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.230689 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1455/2936] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 03:59:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 03:59:57.231562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.240792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdddee5-2071-4a79-8847-b2ee570677f1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.247662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.248692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.249355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.249867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.250802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.252934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.292878 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1482/2937] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 03:59:57.297140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.307460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80608b4-9c19-4d64-8073-29c76a4a44b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.368111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.368849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.369222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.369893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.370814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.372764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.399540 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1456/2938] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 03:59:57.403496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.428467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf4956-b01a-43c7-bb93-5b1fc282a468 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.436685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.437775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.438512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.439021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.440709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.453752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.471141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1483/2939] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:57.474961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.485392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340035c-5ef6-4c9a-b2a8-344290d5b428 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.495253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.496122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.496552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.497118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.498006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.500411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d5d4e-c05a-4f3a-a3f7-5a4c1e865cd1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.516664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1457/2940] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 03:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 03:59:57.516813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.529620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f97be-8562-4170-a349-3805f460ae6a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.537229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.538242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.538590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.538948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] PATH_INFO: `/v3/projects/157fe2bd078d444d99aedf1711fca242/users/2eeb4c5b33b747e4992048c192ea1797/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.559943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157fe2bd078d444d99aedf1711fca242, user_id=2eeb4c5b33b747e4992048c192ea1797, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:57.564468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:57.593232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1484/2941] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 03:59:57 2021] PUT /identity/v3/projects/157fe2bd078d444d99aedf1711fca242/users/2eeb4c5b33b747e4992048c192ea1797/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 03:59:57.595602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153088-1c7d-4090-8c8b-52e1e5cbc8d4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.595889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153088-1c7d-4090-8c8b-52e1e5cbc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.596161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153088-1c7d-4090-8c8b-52e1e5cbc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.624359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-53153088-1c7d-4090-8c8b-52e1e5cbc8d4 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:57.625774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-53153088-1c7d-4090-8c8b-52e1e5cbc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:57.708939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1458/2942] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:57.716717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:57.729297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccad4-d015-49ca-a381-78e05458d9f7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:57.734882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:57.735742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.736193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.737282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.785650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:57.818276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1485/2943] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:57.933991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5c63-ec40-4b7c-bee0-27ede6a57ddc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:57.934353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5c63-ec40-4b7c-bee0-27ede6a57ddc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:57.934704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5c63-ec40-4b7c-bee0-27ede6a57ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:57.953919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e7bc5c63-ec40-4b7c-bee0-27ede6a57ddc None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:57.955373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e7bc5c63-ec40-4b7c-bee0-27ede6a57ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:58.014204 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1459/2944] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 03:59:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:58.029416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:58.031574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:58.109027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ebbd-3aca-4cf9-9fa4-cb5870b5369f tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:58.114464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:58.115137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:58.115425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:58.115699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:58.125442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 03:59:58.127076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c2c73-fb13-4081-b504-fefa5af543dc service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 03:59:58.136825 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1486/2945] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 03:59:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 03:59:58.824507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:58.825009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:58.825463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:58.854921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:58.856330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:58.865523 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1460/2946] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:58 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 03:59:58.871191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:58.871563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:58.871783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:58.891792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:58.893667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:58.908263 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1487/2947] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 03:59:58.909805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:58.937966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f1ac-f511-4d2f-b70b-20ccacaf43fb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:58.944367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:58.945453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:58.946563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:58.947295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:58.993900 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 10 03:59:58.995420 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1461/2948] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 03:59:58 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 188 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 03:59:58.999776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:59.012319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a222556-45d7-4830-a589-0ed90145ce26 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:59.018004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846921de-fcfb-4adb-bcc4-75d01e3baf21 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:59.020048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846921de-fcfb-4adb-bcc4-75d01e3baf21 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:59.020339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846921de-fcfb-4adb-bcc4-75d01e3baf21 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:59.020642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846921de-fcfb-4adb-bcc4-75d01e3baf21 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:59.065095 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-846921de-fcfb-4adb-bcc4-75d01e3baf21 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 10 03:59:59.066646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1488/2949] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 03:59:58 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 188 bytes in 67 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 03:59:59.071515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 03:59:59.082694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d9a1b-d9dc-4425-82d3-d6109b1b41a9 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 03:59:59.087769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07dc6e-089c-4225-bf01-515cea77127c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 03:59:59.088635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07dc6e-089c-4225-bf01-515cea77127c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:59.088952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07dc6e-089c-4225-bf01-515cea77127c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:59.089228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07dc6e-089c-4225-bf01-515cea77127c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:59.141914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b07dc6e-089c-4225-bf01-515cea77127c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 03:59:59.154770 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1462/2950] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 03:59:59 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 03:59:59.408891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76add25-2795-4920-963f-ee16237f53b1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 03:59:59.409432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76add25-2795-4920-963f-ee16237f53b1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 03:59:59.409864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76add25-2795-4920-963f-ee16237f53b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 03:59:59.448756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c76add25-2795-4920-963f-ee16237f53b1 None None] MFA Rules not processed for user `28439236f513404989b79da765cd70d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 03:59:59.453635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c76add25-2795-4920-963f-ee16237f53b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 03:59:59.579654 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1489/2951] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 03:59:59 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:00.160324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4659-f606-49ec-932a-d5a9f87f669a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:00.161436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4659-f606-49ec-932a-d5a9f87f669a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:00.161935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4659-f606-49ec-932a-d5a9f87f669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:00.191679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ff8b4659-f606-49ec-932a-d5a9f87f669a None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:00.213956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ff8b4659-f606-49ec-932a-d5a9f87f669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:00.225577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1463/2952] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:00 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:00.231106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fc798-0451-4e21-a97d-38221eff257e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:00.231739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fc798-0451-4e21-a97d-38221eff257e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:00.232088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fc798-0451-4e21-a97d-38221eff257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:00.281239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-496fc798-0451-4e21-a97d-38221eff257e None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:00.285319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-496fc798-0451-4e21-a97d-38221eff257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:00.289748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f593-334b-4797-a571-9c91c1a6658b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:00.290275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f593-334b-4797-a571-9c91c1a6658b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:00.290884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f593-334b-4797-a571-9c91c1a6658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:00.324932 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1490/2953] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:00.331190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fc798-0451-4e21-a97d-38221eff257e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:00.335127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9285f593-334b-4797-a571-9c91c1a6658b None None] MFA Rules not processed for user `2e9fa45517c0412c82e0f85634858963`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:00.337880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9285f593-334b-4797-a571-9c91c1a6658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:00.366135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fc798-0451-4e21-a97d-38221eff257e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:00.385857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f793-bd28-4af1-a864-c3dfea5f18a1 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:00.391117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f793-bd28-4af1-a864-c3dfea5f18a1 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:00.391586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f793-bd28-4af1-a864-c3dfea5f18a1 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:00.391971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f793-bd28-4af1-a864-c3dfea5f18a1 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:00.437466 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1464/2954] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:00 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 10 04:00:00.524399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ab0f793-bd28-4af1-a864-c3dfea5f18a1 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:00.546599 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1491/2955] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:00 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:01.551919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:01.552766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:01.553227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:01.593410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:01.594839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:01.598576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1465/2956] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:01 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 10 04:00:01.603592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c24a6-2da8-448a-925f-1ccc78dc4a61 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:01.604081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c24a6-2da8-448a-925f-1ccc78dc4a61 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:01.604193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c24a6-2da8-448a-925f-1ccc78dc4a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:01.636150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5d3c24a6-2da8-448a-925f-1ccc78dc4a61 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:01.637682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5d3c24a6-2da8-448a-925f-1ccc78dc4a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:01.650664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:01.652770 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1492/2957] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:01 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:01.676245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2b3f7-6196-4e04-a272-2c0df98fbd75 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:01.687737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f747d-e3f2-4b5a-b7b9-a3da19b0f3e8 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:01.688846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f747d-e3f2-4b5a-b7b9-a3da19b0f3e8 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:01.689324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f747d-e3f2-4b5a-b7b9-a3da19b0f3e8 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:01.689820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f747d-e3f2-4b5a-b7b9-a3da19b0f3e8 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:01.771573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-253f747d-e3f2-4b5a-b7b9-a3da19b0f3e8 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:01.819387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1466/2958] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:01 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:02.825486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:02.826525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:02.827077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:02.850472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:02.851691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:02.860826 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1493/2959] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:02 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:02.862220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e154b-ad78-48d0-90ba-25e96d80e40c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:02.863060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e154b-ad78-48d0-90ba-25e96d80e40c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:02.863352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e154b-ad78-48d0-90ba-25e96d80e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:02.885655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5c1e154b-ad78-48d0-90ba-25e96d80e40c None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:02.886969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5c1e154b-ad78-48d0-90ba-25e96d80e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:02.894637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1467/2960] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:02.899698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:02.912231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f374a-dc14-4210-b5ad-9f4dd657f3e2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:02.917634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b0c2-646b-43dd-8231-de6dd7a17dd5 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:02.918579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b0c2-646b-43dd-8231-de6dd7a17dd5 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:02.918931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b0c2-646b-43dd-8231-de6dd7a17dd5 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:02.919217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b0c2-646b-43dd-8231-de6dd7a17dd5 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:02.963520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a45b0c2-646b-43dd-8231-de6dd7a17dd5 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:02.984981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1494/2961] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:02 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:03.988083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3af50-69c2-48a0-bb1c-f0ad1b11febd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:03.989231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3af50-69c2-48a0-bb1c-f0ad1b11febd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:03.990017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3af50-69c2-48a0-bb1c-f0ad1b11febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:04.019351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-71e3af50-69c2-48a0-bb1c-f0ad1b11febd None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:04.021150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-71e3af50-69c2-48a0-bb1c-f0ad1b11febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:04.029266 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1468/2962] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:03 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 10 04:00:04.723696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:04.724278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:04.724691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:04.728440 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1495/2963] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:00:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:00:04.733849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636908f5-ef10-4fb6-b82f-762c27df13a4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:04.734143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636908f5-ef10-4fb6-b82f-762c27df13a4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:04.734402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636908f5-ef10-4fb6-b82f-762c27df13a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:04.760531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-636908f5-ef10-4fb6-b82f-762c27df13a4 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:04.763450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-636908f5-ef10-4fb6-b82f-762c27df13a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:04.899600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1469/2964] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:00:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:04.934553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:04.936970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:04.975906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f76b7-b0c8-4f79-a00e-3adb79e174e1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:04.992463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:04.993685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:04.995040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:04.999152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.020553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:05.022461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5547eb-0bb6-43ca-bad4-b2b6de1862d1 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:05.035020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239125-ca7f-409a-af25-2778ad858c21 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:05.035917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239125-ca7f-409a-af25-2778ad858c21 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:05.036360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239125-ca7f-409a-af25-2778ad858c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.064314 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1496/2965] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:05.071641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-86239125-ca7f-409a-af25-2778ad858c21 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:05.077348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-86239125-ca7f-409a-af25-2778ad858c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:05.101373 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1470/2966] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:05.109177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2b6-29d0-43a5-95eb-9b0f2b4b5651 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:05.111175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2b6-29d0-43a5-95eb-9b0f2b4b5651 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:05.111175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2b6-29d0-43a5-95eb-9b0f2b4b5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.142462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cdb3d2b6-29d0-43a5-95eb-9b0f2b4b5651 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:05.144127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cdb3d2b6-29d0-43a5-95eb-9b0f2b4b5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:05.150799 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1497/2967] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:05 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 10 04:00:05.154581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc20-1d70-4228-9dfe-ec7a7037556b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:05.155029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc20-1d70-4228-9dfe-ec7a7037556b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:05.155874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc20-1d70-4228-9dfe-ec7a7037556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.258353 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-5e6ebc20-1d70-4228-9dfe-ec7a7037556b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:00:05.260087 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1471/2968] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:05 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 107 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:00:05.266056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c6c9-ed99-4584-9fb3-77f959d98122 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:05.266650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c6c9-ed99-4584-9fb3-77f959d98122 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:05.267137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c6c9-ed99-4584-9fb3-77f959d98122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.357758 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2903c6c9-ed99-4584-9fb3-77f959d98122 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:00:05.360550 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1498/2969] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:05 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 96 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:00:05.365024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:05.365303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:05.365579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:05.406445 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:00:05.408734 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1472/2970] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:05 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 45 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:00:16.425186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6625f-b56b-4f92-878d-58ba2a344190 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:16.425667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6625f-b56b-4f92-878d-58ba2a344190 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:16.425924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6625f-b56b-4f92-878d-58ba2a344190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:16.475465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-25c6625f-b56b-4f92-878d-58ba2a344190 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:16.476884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-25c6625f-b56b-4f92-878d-58ba2a344190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:16.484974 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1499/2971] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:16 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:16.489192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:16.502346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b89273-c9c8-4a90-903b-80f2eb02f4c2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:16.506733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d00681-981a-4301-ba71-955e7c708a0b tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:16.508666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d00681-981a-4301-ba71-955e7c708a0b tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:16.509056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d00681-981a-4301-ba71-955e7c708a0b tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:16.509410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d00681-981a-4301-ba71-955e7c708a0b tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:16.556465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a9d00681-981a-4301-ba71-955e7c708a0b tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:16.569347 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1473/2972] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:16 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:17.575386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2d48-868f-45f3-be33-196ec7c7c63c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.575795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2d48-868f-45f3-be33-196ec7c7c63c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.575944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2d48-868f-45f3-be33-196ec7c7c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.595300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f43c2d48-868f-45f3-be33-196ec7c7c63c None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:17.596481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f43c2d48-868f-45f3-be33-196ec7c7c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:17.600144 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1500/2973] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:17.605619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23148de-7d69-405e-9ae6-8ecc9f8323da None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.606110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23148de-7d69-405e-9ae6-8ecc9f8323da None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.606196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23148de-7d69-405e-9ae6-8ecc9f8323da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.621901 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f23148de-7d69-405e-9ae6-8ecc9f8323da None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 10 04:00:17.623271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405199-f68b-41a5-a774-b1db8504accf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.623467 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1474/2974] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/auth/tokens => generated 80 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 04:00:17.623646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405199-f68b-41a5-a774-b1db8504accf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.623922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405199-f68b-41a5-a774-b1db8504accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.628536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f4f-c4b7-41c5-9e88-979c9b6f5fe9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.629333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f4f-c4b7-41c5-9e88-979c9b6f5fe9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.629705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f4f-c4b7-41c5-9e88-979c9b6f5fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.653554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-49405199-f68b-41a5-a774-b1db8504accf None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:17.654778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-49405199-f68b-41a5-a774-b1db8504accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:17.685906 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-142d3f4f-c4b7-41c5-9e88-979c9b6f5fe9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:00:17.688538 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1475/2975] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 61 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:00:17.694832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f49b3-38d2-4a77-b9e1-e268f607027b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.695332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f49b3-38d2-4a77-b9e1-e268f607027b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.696000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f49b3-38d2-4a77-b9e1-e268f607027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.724672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1501/2976] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:17.743349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b61f49b3-38d2-4a77-b9e1-e268f607027b None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:17.745987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b61f49b3-38d2-4a77-b9e1-e268f607027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:17.756086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1476/2977] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:17.759737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405199-f68b-41a5-a774-b1db8504accf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:17.770406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405199-f68b-41a5-a774-b1db8504accf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:17.775106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf43f0-50c5-4f83-bd6e-f198363aa676 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:17.781405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf43f0-50c5-4f83-bd6e-f198363aa676 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:17.781405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf43f0-50c5-4f83-bd6e-f198363aa676 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:17.781597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf43f0-50c5-4f83-bd6e-f198363aa676 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:17.860417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0dcf43f0-50c5-4f83-bd6e-f198363aa676 tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:17.879585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1502/2978] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:17 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:18.261530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed05e-deb3-4234-bd34-7773f5c4a5dd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:18.261817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed05e-deb3-4234-bd34-7773f5c4a5dd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:18.262090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed05e-deb3-4234-bd34-7773f5c4a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:18.298010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-611ed05e-deb3-4234-bd34-7773f5c4a5dd None None] MFA Rules not processed for user `babb6fa91c674360b017571d83afc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:18.299285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-611ed05e-deb3-4234-bd34-7773f5c4a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:18.376794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1477/2979] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:18 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:18.884646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:18.885475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:18.885755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:18.903087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:18.904272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:18.907538 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1503/2980] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:18 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:18.912291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e32f-f84a-4441-8b68-237a8dcc4c0a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:18.912811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e32f-f84a-4441-8b68-237a8dcc4c0a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:18.912976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e32f-f84a-4441-8b68-237a8dcc4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:18.932185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ee60e32f-f84a-4441-8b68-237a8dcc4c0a None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:18.933434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee60e32f-f84a-4441-8b68-237a8dcc4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:18.940417 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1478/2981] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:18.944788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:18.958274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda17f-1489-49ab-aa64-7a29389ac26b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:18.962517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e87b8b-0ccb-4820-84c6-2ba080d41b6c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:18.963355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87b8b-0ccb-4820-84c6-2ba080d41b6c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:18.963633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87b8b-0ccb-4820-84c6-2ba080d41b6c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:18.963903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87b8b-0ccb-4820-84c6-2ba080d41b6c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:19.014557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c3e87b8b-0ccb-4820-84c6-2ba080d41b6c tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:19.024717 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1504/2982] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:18 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:20.030353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:20.030915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:20.031159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:20.050729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:20.052035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:20.059158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1479/2983] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:20 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:20.060649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c31d-0eaa-4fdc-aaa0-a2212df1f006 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:20.061119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c31d-0eaa-4fdc-aaa0-a2212df1f006 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:20.061214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c31d-0eaa-4fdc-aaa0-a2212df1f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:20.085719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5fc6c31d-0eaa-4fdc-aaa0-a2212df1f006 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:20.087370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5fc6c31d-0eaa-4fdc-aaa0-a2212df1f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:20.102824 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1505/2984] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:20.107448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:20.136915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c8a83-b8a1-4970-ad36-587835ff6847 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:20.146508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4bb8-ce1e-432d-afd8-cea12956bf5a tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeb4c5b33b747e4992048c192ea1797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '157fe2bd078d444d99aedf1711fca242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:20.147639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4bb8-ce1e-432d-afd8-cea12956bf5a tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:20.148078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4bb8-ce1e-432d-afd8-cea12956bf5a tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:20.148797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4bb8-ce1e-432d-afd8-cea12956bf5a tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797/password` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:20.230690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3fcb4bb8-ce1e-432d-afd8-cea12956bf5a tempest-IdentityV3UsersTest-249542113 tempest-IdentityV3UsersTest-249542113-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:20.243397 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1480/2985] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:00:20 2021] POST /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797/password => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:21.250705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:21.251185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:21.251185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:21.272774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:21.274653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:21.280720 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1506/2986] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:21 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:00:22.284150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369769-0d55-48c6-b0dd-404d5f0161b7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:22.285715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369769-0d55-48c6-b0dd-404d5f0161b7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:22.286081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369769-0d55-48c6-b0dd-404d5f0161b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:22.308785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8b369769-0d55-48c6-b0dd-404d5f0161b7 None None] MFA Rules not processed for user `2eeb4c5b33b747e4992048c192ea1797`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:22.310489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b369769-0d55-48c6-b0dd-404d5f0161b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:22.320016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1481/2987] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:22.327905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:22.404161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0644185-7828-4fc9-853e-c68c5b2cb763 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:22.408539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:22.409433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:22.410353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:22.410633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] PATH_INFO: `/v3/users/2eeb4c5b33b747e4992048c192ea1797` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:22.411875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeb4c5b33b747e4992048c192ea1797)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:22.413845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:22.478869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:22.487361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:22.488403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:22.489014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:22.499459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeb4c5b33b747e4992048c192ea1797'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:22.530483 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1507/2988] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:22 2021] DELETE /identity/v3/users/2eeb4c5b33b747e4992048c192ea1797 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:22.545373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:22.545676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:22.546027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:22.582139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:22.583778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:22.674709 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1482/2989] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:22.694641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:22.697986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:22.764548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58fce4-2561-4d6b-aa25-4db74119d82f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:22.769072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:22.769964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:22.770409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:22.772536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:22.786969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:22.789412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671eb5d-fcf8-45ad-9ed1-53a5e54cdd75 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:22.803873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1508/2990] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:23.284592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.286113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:23.316420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b495a2-6ebf-41ed-a02f-98c40598f100 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.327935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.329261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.329597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.330074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] PATH_INFO: `/v3/projects/157fe2bd078d444d99aedf1711fca242` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.331766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157fe2bd078d444d99aedf1711fca242)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.333804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.397998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157fe2bd078d444d99aedf1711fca242', 'request_id': 'req-d075e42b-9eae-4feb-bc48-e8510e93c4d1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:23.404409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157fe2bd078d444d99aedf1711fca242', 'request_id': 'req-d075e42b-9eae-4feb-bc48-e8510e93c4d1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:23.410667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157fe2bd078d444d99aedf1711fca242', 'request_id': 'req-d075e42b-9eae-4feb-bc48-e8510e93c4d1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:23.425217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] The token cache is being invalidate because project 157fe2bd078d444d99aedf1711fca242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:23.425737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:23.426563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d075e42b-9eae-4feb-bc48-e8510e93c4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:23.428285 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1483/2991] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:23 2021] DELETE /identity/v3/projects/157fe2bd078d444d99aedf1711fca242 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:23.436288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.436805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.437100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.455387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:23.456690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:23.523948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1509/2992] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:23.530733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc844-d415-4283-8729-be97547df26e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.531079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc844-d415-4283-8729-be97547df26e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.531418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc844-d415-4283-8729-be97547df26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.550222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-522dc844-d415-4283-8729-be97547df26e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:23.551429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-522dc844-d415-4283-8729-be97547df26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:23.560547 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1484/2993] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:23.565340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.575503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97f8c-66c7-414d-8f65-35444af21540 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.581669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.582401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.582748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.583024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.583756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:00:23.584062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.585707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f8ade-be8e-4777-adaa-4726830c5af6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.597343 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1510/2994] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:00:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:00:23.602282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dc844-d415-4283-8729-be97547df26e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.610818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e5c9-7efc-4770-988d-beb0721dcfd9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.611098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e5c9-7efc-4770-988d-beb0721dcfd9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.611373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e5c9-7efc-4770-988d-beb0721dcfd9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.612086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dc844-d415-4283-8729-be97547df26e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.613287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1511/2995] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:00:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:00:23.616935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.618200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.618476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.618584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.618743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.618838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.619120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.620092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.622025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.637835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:23.639211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:23.647531 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1485/2996] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:23.651555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.701526 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1512/2997] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:23.711591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b0db-7976-4757-8a0a-ecaa7a18a78a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.716171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.716884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.717594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.717594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.718119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.719995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.722851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.724178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:23.738660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24950218-0b13-474d-96c5-19438ab698c9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.740074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1486/2998] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:23.744021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.753112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f78c-1f9a-4a50-bded-2dc6b97f77cd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.757659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.758342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.758623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.758892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.759611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.761190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.770687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1487/2999] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:00:23.775122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.784549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81063dd-1034-49d7-b13f-750b33076d1d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.789775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.790617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.790888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.791154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] PATH_INFO: `/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc/users/ce1d916c2ca64eb3b7c4e19cfef67152/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.800917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.801499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.801858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.802164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.806853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2792b267fc8d40f9ac78ea7a23bc21cc, user_id=ce1d916c2ca64eb3b7c4e19cfef67152, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.809634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.813855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.815570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.823348 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1488/3000] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:23 2021] PUT /identity/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc/users/ce1d916c2ca64eb3b7c4e19cfef67152/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:23.825839 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1513/3001] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:00:23.827143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.892926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbb363-39f1-4b2a-99ef-cab57362e50f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.898317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.899514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.899790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.900057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.900812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.902371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c81a9-d924-4d50-b137-8a2102369db3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.916664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1489/3002] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:00:23.918118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:23.928590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f2a18-e45b-460c-b91c-aac127ef746d service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:23.933468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:23.934436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.934819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.935061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] PATH_INFO: `/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc/users/ce1d916c2ca64eb3b7c4e19cfef67152/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.937224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2792b267fc8d40f9ac78ea7a23bc21cc, user_id=ce1d916c2ca64eb3b7c4e19cfef67152, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:23.939904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:23.951385 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1514/3003] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:23 2021] PUT /identity/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc/users/ce1d916c2ca64eb3b7c4e19cfef67152/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:23.962954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:23.963288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:23.963563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:23.992661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] MFA Rules not processed for user `ce1d916c2ca64eb3b7c4e19cfef67152`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:23.993920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:24.062649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1490/3004] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:23 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:24.067185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.132648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f4eb7-44f3-43c9-8ad7-a2543f61c7d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.138258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.139055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.139186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.139513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.140427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.142910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.170124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1515/3005] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:24 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:24.173857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.187755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2acdaa-8aed-4f1c-b412-837db6868fbe None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.255338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.256038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.256389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.256705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.257668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.261028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.283362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1491/3006] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:24 2021] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:24.288066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.301218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14900cc-20fd-4747-9da2-50c10ac49ba9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.306837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.307512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.307789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.308088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.308985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.310730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.329241 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1516/3007] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:24.330561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.342934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3483123-c3c3-4f5b-ada1-4c5679eddf45 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.348481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.349788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.349960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.350264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.351057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.352729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102718a9-c48d-4964-a369-a4ee8720a9b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.363895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1492/3008] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:24 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:24.368311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.378354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420549b-56ec-4db6-8033-0344b9b71620 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.383922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.384719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.385012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.385137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.385345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.385460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.385675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] PATH_INFO: `/v3/projects/6b598ddf482040a796d6d6dfe5da864d/users/fd4b66834da74999a34402a06fbcaac0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.402242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b598ddf482040a796d6d6dfe5da864d, user_id=fd4b66834da74999a34402a06fbcaac0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.404882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9bfa-bcc8-47bb-90c9-c4570dc27fc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.406306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:24.407528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:24.422191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1517/3009] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:24 2021] PUT /identity/v3/projects/6b598ddf482040a796d6d6dfe5da864d/users/fd4b66834da74999a34402a06fbcaac0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:24.433797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.434086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.434361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.466392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] MFA Rules not processed for user `fd4b66834da74999a34402a06fbcaac0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:24.468016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:24.495507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1493/3010] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:00:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:24.506844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.508700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:24.541313 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1518/3011] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:24 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:24.553107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:24.554482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:24.585729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d675814-0ff5-4a4c-8cdc-c08f6f227bc0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.636700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.637436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.637790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.638159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.651280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec6bf-0e85-40a6-a9fe-2bb82d1db971 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:24.655174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:24.655850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:24.656121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:24.656393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:24.708372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.710067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.721488 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1494/3012] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:00:24.734733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:24.736169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92921b28-fd8d-475a-8f9d-45ba8f9b34fe service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:24.749088 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1519/3013] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:24 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:00:25.063561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:25.160212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ceda-3c90-4724-a5e5-a579fe7dde1a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:25.166841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:25.168679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:25.168679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:25.168679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] PATH_INFO: `/v3/users/ce1d916c2ca64eb3b7c4e19cfef67152` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:25.170094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1d916c2ca64eb3b7c4e19cfef67152)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:25.173597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:25.252966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1d916c2ca64eb3b7c4e19cfef67152'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:25.261243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1d916c2ca64eb3b7c4e19cfef67152'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:25.262017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1d916c2ca64eb3b7c4e19cfef67152'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:25.275600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1d916c2ca64eb3b7c4e19cfef67152'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:25.286738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1d916c2ca64eb3b7c4e19cfef67152'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:25.300808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1495/3014] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:25 2021] DELETE /identity/v3/users/ce1d916c2ca64eb3b7c4e19cfef67152 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:25.302584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:25.302893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:25.303683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:25.320063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:25.321421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:25.392111 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1520/3015] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:25.400199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:25.402479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:25.468563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f40c-015e-4344-840e-689b495ccea3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:25.472777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:25.473421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:25.473700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:25.473978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:25.484785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:25.487176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:25.499174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1496/3016] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:25.916444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:25.918326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:25.949006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0069c-b23d-4c46-ba54-25600965aff4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:25.958521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:25.961450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:25.962079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:25.962514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] PATH_INFO: `/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:25.964489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2792b267fc8d40f9ac78ea7a23bc21cc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:25.967477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:26.044961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2792b267fc8d40f9ac78ea7a23bc21cc', 'request_id': 'req-b1e95443-5ba1-4400-b7ec-958d588569c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.057664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2792b267fc8d40f9ac78ea7a23bc21cc', 'request_id': 'req-b1e95443-5ba1-4400-b7ec-958d588569c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.067076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2792b267fc8d40f9ac78ea7a23bc21cc', 'request_id': 'req-b1e95443-5ba1-4400-b7ec-958d588569c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.087080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] The token cache is being invalidate because project 2792b267fc8d40f9ac78ea7a23bc21cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:26.087816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.088703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.090788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1521/3017] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:25 2021] DELETE /identity/v3/projects/2792b267fc8d40f9ac78ea7a23bc21cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:26.094647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:26.106564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114421b-fe30-40af-a9fe-c7960e2b0838 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:26.180252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:26.181158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:26.181440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:26.181775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] PATH_INFO: `/v3/users/fd4b66834da74999a34402a06fbcaac0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:26.182937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4b66834da74999a34402a06fbcaac0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:26.185202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:26.245548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4b66834da74999a34402a06fbcaac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.256699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4b66834da74999a34402a06fbcaac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.257494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4b66834da74999a34402a06fbcaac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.270685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4b66834da74999a34402a06fbcaac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.278890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64c65249-bb08-4008-85fa-72740ff2d70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4b66834da74999a34402a06fbcaac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.285630 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1497/3018] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:26 2021] DELETE /identity/v3/users/fd4b66834da74999a34402a06fbcaac0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:26.763382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:26.764939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:26.787488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95443-5ba1-4400-b7ec-958d588569c1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:26.860168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:26.861506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:26.861796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:26.862076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] PATH_INFO: `/v3/projects/6b598ddf482040a796d6d6dfe5da864d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:26.865661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b598ddf482040a796d6d6dfe5da864d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:26.868987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:26.918896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b598ddf482040a796d6d6dfe5da864d', 'request_id': 'req-251d7c04-89a0-4174-af80-60eb2dc3984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.924598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b598ddf482040a796d6d6dfe5da864d', 'request_id': 'req-251d7c04-89a0-4174-af80-60eb2dc3984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.930605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b598ddf482040a796d6d6dfe5da864d', 'request_id': 'req-251d7c04-89a0-4174-af80-60eb2dc3984d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.942320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] The token cache is being invalidate because project 6b598ddf482040a796d6d6dfe5da864d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:26.942599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.943222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-251d7c04-89a0-4174-af80-60eb2dc3984d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:26.945096 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1522/3019] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:26 2021] DELETE /identity/v3/projects/6b598ddf482040a796d6d6dfe5da864d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:26.953021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:26.953544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:26.953965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:26.977967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:26.979197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:27.054182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1498/3020] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:27.062044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.062044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.062280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.089672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:27.090885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:27.101000 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1523/3021] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:27.105043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.115236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1889ff-f928-4229-918c-098cc31b6759 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.120851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.121893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.122409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.123020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.123971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:00:27.124499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.126585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.145879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1499/3022] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:00:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:00:27.157211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.168268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bf62-e64f-46d9-8e27-e86ca56fdbf7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.173407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.174077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.174514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.174921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.175791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.177739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.206395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1524/3023] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:27.210488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.221361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d84d1-e8ac-45bb-9eb2-0134b53f85d8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.284125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.284745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.285025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.285301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.285999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.287968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.310405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1500/3024] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:27.314512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.325319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152194f6-0740-45c9-8fa7-c0d2733e9c96 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.329924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.330567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.330843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.331120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.331848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.333452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.344267 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1525/3025] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:27.348237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.357840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596504-203f-4553-bc97-874c302dd09d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.362345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.362985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.363255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.363522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.364239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.365829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0de84-661a-4599-81c5-bd1f00201c61 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.375888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1501/3026] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:27.379809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.389787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfc1f-a245-4043-b7b2-43ed5ee608c2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.394302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.395154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.395433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.395702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] PATH_INFO: `/v3/projects/9a28a16a9ad74864b95c6cd730fdd987/users/9f14ad993352443ab5d33f59f4f523b1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.410010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28a16a9ad74864b95c6cd730fdd987, user_id=9f14ad993352443ab5d33f59f4f523b1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.412569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.426136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1526/3027] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:27 2021] PUT /identity/v3/projects/9a28a16a9ad74864b95c6cd730fdd987/users/9f14ad993352443ab5d33f59f4f523b1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:27.437284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.437569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.437841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.464567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] MFA Rules not processed for user `9f14ad993352443ab5d33f59f4f523b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:27.465770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:27.529932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1502/3028] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:27.534483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.602039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2af14-bf00-428d-84e1-785eba792eb1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.607103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.608072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.608579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.609094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.610097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.612078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.644788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1527/3029] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:27.646227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.660800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748519ea-7057-42a8-a0c7-27630e2f8dd2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.724222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.726001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.726001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.726316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.727662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.729665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.761819 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1503/3030] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:27.765979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.782097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5efc6-d907-4888-b4af-d8e74f07a99c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.789881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.790484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.790760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.791030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.791766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.793391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.806101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1528/3031] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:27.813698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.824624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1fcd-bbd5-4c88-b614-999bf19a91b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.830803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.831666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.832074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.832451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.833332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.835017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0297e04-c525-467d-857b-e9c8f899c2ed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.846888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1504/3032] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:27.852083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:27.863084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab5060-2d1a-41f4-bd74-79b31fc23140 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:27.868064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:27.868976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.869262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.869545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] PATH_INFO: `/v3/projects/83cbdbd7df1245dc82f0c514d4869a5e/users/f352b3b8a00a4608866cc1acd99c353e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.892652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cbdbd7df1245dc82f0c514d4869a5e, user_id=f352b3b8a00a4608866cc1acd99c353e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:27.895286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:27.908766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1529/3033] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:27 2021] PUT /identity/v3/projects/83cbdbd7df1245dc82f0c514d4869a5e/users/f352b3b8a00a4608866cc1acd99c353e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:27.918770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-45b4-4d72-8185-1106524d93c6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:27.919155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-45b4-4d72-8185-1106524d93c6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:27.919404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-45b4-4d72-8185-1106524d93c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:27.950402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0c733cca-45b4-4d72-8185-1106524d93c6 None None] MFA Rules not processed for user `f352b3b8a00a4608866cc1acd99c353e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:27.951606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c733cca-45b4-4d72-8185-1106524d93c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.014381 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1505/3034] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:27 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:28.031281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:28.033087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.090808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bee6e4-319a-4006-a49e-5135a878d8aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:28.094447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:28.095080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.095442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.095820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.152420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:28.154052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:28.163762 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1530/3035] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:28 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:28.261262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.261537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.261810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.280807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:28.282012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.342432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1506/3036] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:00:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:28.355385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:28.356842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.423423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0358-39c6-4b35-91b9-dc96df71cc3a service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:28.428917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:28.430193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.430547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.430884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.439729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:28.441324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb2b3-1bca-4b6d-95a3-87bd285da76b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:28.450321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1531/3037] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:00:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:00:28.663139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:28.665091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.676197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f75a1-c23c-4f02-a08d-0f310950da58 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:28.680422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:28.681155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.681434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.681704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.690110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:28.691548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:28.700898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1507/3038] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:28 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:28.785888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.786213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.786439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.810628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:28.811824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:28.819552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1532/3039] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:00:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:28.838348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:28.849983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6984a-6cde-49b3-af09-f58787308252 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:28.857262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:28.857802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:28.858708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:28.858708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:28.866886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:28.869043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f46d6e-4cb3-4d58-ae99-5c70c2528636 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:28.877268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1508/3040] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:00:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:00:29.004232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:29.068706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc55e-b588-4874-9c99-60407aca9111 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:29.074711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:29.075569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:29.075844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:29.076110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] PATH_INFO: `/v3/users/9f14ad993352443ab5d33f59f4f523b1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:29.077334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f14ad993352443ab5d33f59f4f523b1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:29.079204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:29.125522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f14ad993352443ab5d33f59f4f523b1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.132529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f14ad993352443ab5d33f59f4f523b1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.133306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f14ad993352443ab5d33f59f4f523b1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.134073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f14ad993352443ab5d33f59f4f523b1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.141393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f14ad993352443ab5d33f59f4f523b1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.158823 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1533/3041] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:29 2021] DELETE /identity/v3/users/9f14ad993352443ab5d33f59f4f523b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:29.163349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:29.163902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:29.164575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:29.183124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:29.184343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:29.242213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1509/3042] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:29.252768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:29.254240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:29.311222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6eac-1cc3-4734-8c48-c910e2fcd376 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:29.314937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:29.315593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:29.315907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:29.316136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:29.325775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:29.327112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:29.337080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1534/3043] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:29.747263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:29.749059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:29.796586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7ff1e-cdc2-4c94-b77d-a9fa7257e36e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:29.802458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:29.803540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:29.803968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:29.804387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] PATH_INFO: `/v3/projects/9a28a16a9ad74864b95c6cd730fdd987` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:29.807651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a28a16a9ad74864b95c6cd730fdd987)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:29.809870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:29.927324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a28a16a9ad74864b95c6cd730fdd987', 'request_id': 'req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.944102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a28a16a9ad74864b95c6cd730fdd987', 'request_id': 'req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.957542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a28a16a9ad74864b95c6cd730fdd987', 'request_id': 'req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.985805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] The token cache is being invalidate because project 9a28a16a9ad74864b95c6cd730fdd987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:29.986660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.987554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:29.989737 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1510/3044] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:29 2021] DELETE /identity/v3/projects/9a28a16a9ad74864b95c6cd730fdd987 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:29.994297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:30.005154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59c1c-2556-42f5-96dd-e1bb3b24ebf5 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:30.079813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:30.082509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:30.083111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:30.083635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] PATH_INFO: `/v3/users/f352b3b8a00a4608866cc1acd99c353e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:30.085283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f352b3b8a00a4608866cc1acd99c353e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:30.088373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:30.151302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f352b3b8a00a4608866cc1acd99c353e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.159331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f352b3b8a00a4608866cc1acd99c353e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.160582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f352b3b8a00a4608866cc1acd99c353e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.161485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f352b3b8a00a4608866cc1acd99c353e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.173214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b101906a-7c7c-46c1-88ea-7fa44cb66edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f352b3b8a00a4608866cc1acd99c353e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.198922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1535/3045] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:29 2021] DELETE /identity/v3/users/f352b3b8a00a4608866cc1acd99c353e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:30.703693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:30.705649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:30.725120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6df28-d1a9-4e61-a89b-9ea914e9a7c5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:30.812186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:30.813514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:30.814149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:30.814879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] PATH_INFO: `/v3/projects/83cbdbd7df1245dc82f0c514d4869a5e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:30.816596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cbdbd7df1245dc82f0c514d4869a5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:30.821161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:30.878911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cbdbd7df1245dc82f0c514d4869a5e', 'request_id': 'req-65fee467-821a-43a4-8908-e419ac96b36b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.888286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cbdbd7df1245dc82f0c514d4869a5e', 'request_id': 'req-65fee467-821a-43a4-8908-e419ac96b36b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.893030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cbdbd7df1245dc82f0c514d4869a5e', 'request_id': 'req-65fee467-821a-43a4-8908-e419ac96b36b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.910809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] The token cache is being invalidate because project 83cbdbd7df1245dc82f0c514d4869a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:30.911442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.912379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65fee467-821a-43a4-8908-e419ac96b36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:30.914585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1511/3046] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:30 2021] DELETE /identity/v3/projects/83cbdbd7df1245dc82f0c514d4869a5e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:30.921757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:30.922394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:30.922844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:30.944517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:30.947483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:31.032513 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1536/3047] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:31.042122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.042409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.042683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.065824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:31.067534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:31.082289 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1512/3048] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:31.087284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.099242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63315b9a-2408-4779-acde-9c5dfef63e18 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.105515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.106444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.107026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.107371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.108599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:00:31.109269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.110929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.128793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1537/3049] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:00:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:00:31.131297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.142073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5be8-d587-4c01-8b7a-f54f30a9ba9f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.158481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.159170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.159438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.159711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.160751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.162781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.193669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1513/3050] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:31.199763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.211877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287378d-29ac-45cb-8068-f13ea671a16f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.323640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.324895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.325435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.325930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.327026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.330084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.358760 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1538/3051] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/users => generated 305 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:31.363064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.377374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eb999-34c1-4a0a-9bdf-c8bc285df479 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.383874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.385435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.385802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.386177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.387428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.388930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.401112 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1514/3052] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:31.406585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.424043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c4a5-54b8-47ea-8592-46f12cc5c823 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.430040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.430788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.431677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.431677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.432201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.433925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8eb87-6a71-4bce-847f-027f1d0d5875 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.446008 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1539/3053] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:31.450758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.462049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b512a7-73c0-4a7c-8ad9-629fdeba4629 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.467907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.468890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.469190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.469943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] PATH_INFO: `/v3/projects/7572ebe87af14e9ba2092c738de93fbb/users/86e6d4f48bb54cee9de66d3b199164c6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.486476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7572ebe87af14e9ba2092c738de93fbb, user_id=86e6d4f48bb54cee9de66d3b199164c6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.489414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.505027 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1515/3054] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:31 2021] PUT /identity/v3/projects/7572ebe87af14e9ba2092c738de93fbb/users/86e6d4f48bb54cee9de66d3b199164c6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:31.518256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.518952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.518952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.577161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] MFA Rules not processed for user `86e6d4f48bb54cee9de66d3b199164c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:31.578735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:31.703599 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1540/3055] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:31.707522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.788479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2eb10-61b0-4cb1-97a5-8806405cf411 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.794129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.795045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.795326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.795635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.796382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.798390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.833076 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1516/3056] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/projects => generated 411 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:31.834277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.858869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865379d-5b0c-4760-a15d-eaf8d5254ae4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:31.931703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:31.932333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:31.932593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:31.932887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:31.933636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:31.935572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:31.973660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1541/3057] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:31 2021] POST /identity/v3/users => generated 312 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:31.978173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:31.997042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516a5b1-e1f2-42a8-8682-e1a6e6f4af7b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:32.001794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:32.002697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.002978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.003255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.003994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:32.005678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:32.020543 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1517/3058] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:32.021402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:32.031927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814f675-98d6-402c-a007-3fbad7914147 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:32.041684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:32.042583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.042858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.043125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] PATH_INFO: `/v3/projects/581a199bea484a469b31b5d90f573f0a/users/395d374099504e7e8c020de957a5ed2e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.063570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581a199bea484a469b31b5d90f573f0a, user_id=395d374099504e7e8c020de957a5ed2e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:32.066263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:32.082927 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1542/3059] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:32 2021] PUT /identity/v3/projects/581a199bea484a469b31b5d90f573f0a/users/395d374099504e7e8c020de957a5ed2e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:32.087541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:32.098150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b46c4-bb62-440a-b9c4-55130c1dfd8e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:32.188241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:32.189550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.189904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.190588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.191802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:32.193699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82951-5cf1-42e7-9b1e-dfcc65eb22c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:32.208835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1518/3060] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:32 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:32.213655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:32.228180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6cead-7f26-4832-ac10-b9b2f065d795 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:32.235078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:32.236372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.237172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.237461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] PATH_INFO: `/v3/projects/581a199bea484a469b31b5d90f573f0a/users/395d374099504e7e8c020de957a5ed2e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.240220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581a199bea484a469b31b5d90f573f0a, user_id=395d374099504e7e8c020de957a5ed2e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:32.243869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:32.261888 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1543/3061] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:32 2021] PUT /identity/v3/projects/581a199bea484a469b31b5d90f573f0a/users/395d374099504e7e8c020de957a5ed2e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:32.274539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.275238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.275828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.332127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] MFA Rules not processed for user `395d374099504e7e8c020de957a5ed2e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:32.334058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:32.458833 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1519/3062] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:32 2021] POST /identity/v3/auth/tokens => generated 3345 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:32.467907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:32.470303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:32.530739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5f61-f2c9-4567-9972-954670558296 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:32.534452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:32.535140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:32.535416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:32.535683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:32.544898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:32.546296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7c2ac-e766-42ff-9233-a8b473c1d1b4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:32.555457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1544/3063] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:32 2021] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:00:34.719909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:34.793402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bdd2d-2f91-41e6-bedb-836e1df71be1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:34.800227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:34.804406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:34.804406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:34.804406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] PATH_INFO: `/v3/users/86e6d4f48bb54cee9de66d3b199164c6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:34.804406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e6d4f48bb54cee9de66d3b199164c6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:34.810263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:34.900077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e6d4f48bb54cee9de66d3b199164c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:34.909604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e6d4f48bb54cee9de66d3b199164c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:34.910742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e6d4f48bb54cee9de66d3b199164c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:34.933380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e6d4f48bb54cee9de66d3b199164c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:34.945799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e6d4f48bb54cee9de66d3b199164c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:34.970673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1520/3064] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:34 2021] DELETE /identity/v3/users/86e6d4f48bb54cee9de66d3b199164c6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:34.973124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735b0d-b2a6-4d5c-b007-507275224a9b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:34.973659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735b0d-b2a6-4d5c-b007-507275224a9b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:34.973901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735b0d-b2a6-4d5c-b007-507275224a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:35.000754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d9735b0d-b2a6-4d5c-b007-507275224a9b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:35.002769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9735b0d-b2a6-4d5c-b007-507275224a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:35.090674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1545/3065] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:35.100835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:35.103732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:35.163096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:35.163380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:35.163652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:35.171723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12512-d372-4b8b-a673-6ce7e672b2e3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:35.176668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:35.177462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:35.177741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:35.178102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:35.183761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:35.185098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:35.189620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:35.191632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:35.204649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1521/3066] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:35.246749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1546/3067] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:35.692832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:35.694325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:35.713986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700f97-93b4-49a5-ad05-d9660cd5c1bd service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:35.722013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:35.724344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:35.724851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:35.725638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] PATH_INFO: `/v3/projects/7572ebe87af14e9ba2092c738de93fbb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:35.727315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7572ebe87af14e9ba2092c738de93fbb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:35.729504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:35.789634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7572ebe87af14e9ba2092c738de93fbb', 'request_id': 'req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:35.797818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7572ebe87af14e9ba2092c738de93fbb', 'request_id': 'req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:35.805001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7572ebe87af14e9ba2092c738de93fbb', 'request_id': 'req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:35.820814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] The token cache is being invalidate because project 7572ebe87af14e9ba2092c738de93fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:35.821341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:35.822357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:35.845160 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1522/3068] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:35 2021] DELETE /identity/v3/projects/7572ebe87af14e9ba2092c738de93fbb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:35.845905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:35.861459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79848acc-bc6d-4250-8abb-7b736b8b91ff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:35.941651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:35.943282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:35.943846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:35.944287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] PATH_INFO: `/v3/users/395d374099504e7e8c020de957a5ed2e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:35.948521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395d374099504e7e8c020de957a5ed2e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:35.950613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:36.049119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395d374099504e7e8c020de957a5ed2e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.062971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395d374099504e7e8c020de957a5ed2e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.063719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395d374099504e7e8c020de957a5ed2e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.064354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395d374099504e7e8c020de957a5ed2e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.074288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a47d2773-53fd-41d3-ad81-0334d83fbdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395d374099504e7e8c020de957a5ed2e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.101965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1547/3069] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:35 2021] DELETE /identity/v3/users/395d374099504e7e8c020de957a5ed2e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:36.434694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:36.436358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:36.452419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4f0a7-e8f1-4ec9-ac9e-7c9bfa9ae67d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:36.525593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:36.526540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:36.526881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:36.527259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] PATH_INFO: `/v3/projects/581a199bea484a469b31b5d90f573f0a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:36.528811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=581a199bea484a469b31b5d90f573f0a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:36.531095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:36.590366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581a199bea484a469b31b5d90f573f0a', 'request_id': 'req-8497c451-cd2a-4542-be39-29f4b776a01c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.596023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581a199bea484a469b31b5d90f573f0a', 'request_id': 'req-8497c451-cd2a-4542-be39-29f4b776a01c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.602875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581a199bea484a469b31b5d90f573f0a', 'request_id': 'req-8497c451-cd2a-4542-be39-29f4b776a01c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.621231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] The token cache is being invalidate because project 581a199bea484a469b31b5d90f573f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:36.621871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.622734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8497c451-cd2a-4542-be39-29f4b776a01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:36.627783 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1523/3070] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:36 2021] DELETE /identity/v3/projects/581a199bea484a469b31b5d90f573f0a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:36.633839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:36.634225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:36.634715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:36.655570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:36.656909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:36.719068 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1548/3071] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:36.728170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:36.728800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:36.728800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:36.746757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:36.748194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:36.756332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1524/3072] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:36.760763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:36.772639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538a2e4-cc66-4ba6-be03-72c6bf5bca5b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:36.779200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:36.780160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:36.780287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:36.780657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:36.781382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:00:36.781743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:36.783603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:36.800460 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1549/3073] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:00:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:00:36.805600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:36.822314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ea478-65bf-4b1d-96f1-02f4d5e70df1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:36.842227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:36.843586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:36.844197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:36.844690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:36.853931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:36.853931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:36.881211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1525/3074] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:36 2021] POST /identity/v3/projects => generated 395 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:36.887003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:36.901087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab7518-940c-4872-bdaf-efba2325aa03 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:37.010508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:37.011842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.012670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.013233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.015324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:37.019558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:37.060415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1550/3075] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:36 2021] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:37.065821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:37.092014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbaa00-9f27-4264-8d63-d345fa1038cc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:37.108594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:37.115187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.116094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.116530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.117700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:37.120992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:37.143671 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1526/3076] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:37.148843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:37.160433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fca49-8d09-47e3-aa8f-652732ead205 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:37.168107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:37.169248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.169760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.170232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.171225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:37.173182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf143eb3-0609-41e0-bbe3-77a5239ae141 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:37.185332 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1551/3077] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:00:37.189748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:37.223377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acbc4-f80d-4a16-9ed8-bb164566ee6d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:37.232855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:37.235483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.235895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.236418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] PATH_INFO: `/v3/projects/03858c7c818644f1a0b3d203f8b24a78/users/9edc1ddb11cf41b8a2de2625d0f62f8b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.268562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03858c7c818644f1a0b3d203f8b24a78, user_id=9edc1ddb11cf41b8a2de2625d0f62f8b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:37.271997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:37.306107 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1527/3078] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:37 2021] PUT /identity/v3/projects/03858c7c818644f1a0b3d203f8b24a78/users/9edc1ddb11cf41b8a2de2625d0f62f8b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:00:37.318219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.319039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.319589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.352585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] MFA Rules not processed for user `9edc1ddb11cf41b8a2de2625d0f62f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:37.353931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:37.440584 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1552/3079] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:37 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:37.455916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:37.458201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:37.547112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45df3f0-7ea3-42a0-a77a-7a1c3d852506 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:37.552685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:37.553757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:37.555481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:37.556240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:37.586815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:37.588478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:37.604134 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1528/3080] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:37 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:00:38.197365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:38.199753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:38.316109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1aac8-715b-45e3-90c0-d7dd312ff3f0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:38.325547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:38.326735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:38.327048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:38.327343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] PATH_INFO: `/v3/users/babb6fa91c674360b017571d83afc6a2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:38.329155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=babb6fa91c674360b017571d83afc6a2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:38.331766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:38.401237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babb6fa91c674360b017571d83afc6a2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:38.410058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babb6fa91c674360b017571d83afc6a2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:38.410803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babb6fa91c674360b017571d83afc6a2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:38.411436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babb6fa91c674360b017571d83afc6a2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:38.426140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5336e0b8-e648-4677-8a12-7ad6fc50b04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babb6fa91c674360b017571d83afc6a2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:38.448699 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1553/3081] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:00:38 2021] DELETE /identity/v3/users/babb6fa91c674360b017571d83afc6a2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:38.867475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:38.895533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c5be-1faf-43ef-8e68-c0f3f34723aa service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:39.039352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:39.041496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.041775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.044602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] PATH_INFO: `/v3/projects/3c429da1ce66472ea906f7e8cf5e4dd8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.049529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c429da1ce66472ea906f7e8cf5e4dd8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:39.062569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:39.158263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c429da1ce66472ea906f7e8cf5e4dd8', 'request_id': 'req-870c79c0-1080-464d-98e7-d696752d5134'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:39.170416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c429da1ce66472ea906f7e8cf5e4dd8', 'request_id': 'req-870c79c0-1080-464d-98e7-d696752d5134'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:39.207762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c429da1ce66472ea906f7e8cf5e4dd8', 'request_id': 'req-870c79c0-1080-464d-98e7-d696752d5134'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:39.239800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] The token cache is being invalidate because project 3c429da1ce66472ea906f7e8cf5e4dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:00:39.240164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:39.241425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-870c79c0-1080-464d-98e7-d696752d5134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:00:39.243523 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1529/3082] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:00:38 2021] DELETE /identity/v3/projects/3c429da1ce66472ea906f7e8cf5e4dd8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:39.251065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.252005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.253113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.300090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:39.304145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:39.454781 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1554/3083] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:39.465593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.466482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.467840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.505482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:39.507169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:39.525720 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1530/3084] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:39.530363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:39.547150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d23b8f-8c01-4783-a7ae-4edba23bb69b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:39.559225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:39.560716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.561483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.562212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.565265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:00:39.566462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:39.569395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:39.603948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1555/3085] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:00:39.608585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:39.621419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b78bb-25a6-4fdf-880d-c8a027eacad0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:39.628265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:39.628967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.629428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.630223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.631156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:39.635591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:39.705414 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1531/3086] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:00:39 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:00:39.710113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:39.743378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92944-badd-450b-a3b7-6ea2ca96282c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:39.969933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:39.971930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:39.973656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:39.973656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:39.974488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:39.981035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:40.017134 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1556/3087] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:00:39 2021] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:00:40.021053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:40.035321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368f40-c174-454c-9b54-a6227ec7ce2f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:40.045650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:40.047012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:40.049003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:40.049255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:40.050130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:40.051929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:40.079545 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1532/3088] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:40 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:00:40.084895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:40.095949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbed0-2f26-4a55-b48a-00ac67deafa7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:40.105351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:40.106394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:40.106811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:40.107316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:40.115512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:40.118723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9b6f-83c0-4383-9ae6-f4dbf18734da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:40.143379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1557/3089] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:00:40 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:00:40.148938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:40.162423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4e2fc-87f1-437e-9a75-2a5a12a389df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:40.178027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:40.189970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:40.189970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:40.190460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] PATH_INFO: `/v3/projects/e9986f60f3d449caa2bd8b4dc8fef2ba/users/28874f14f2c64a7a9e3770cc7e5d3371/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:40.236417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9986f60f3d449caa2bd8b4dc8fef2ba, user_id=28874f14f2c64a7a9e3770cc7e5d3371, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:40.239759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:40.265350 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1533/3090] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:00:40 2021] PUT /identity/v3/projects/e9986f60f3d449caa2bd8b4dc8fef2ba/users/28874f14f2c64a7a9e3770cc7e5d3371/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:00:40.275941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0f4a-7037-4301-bdc8-da4d21cd0cd0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:40.276858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0f4a-7037-4301-bdc8-da4d21cd0cd0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:40.277486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0f4a-7037-4301-bdc8-da4d21cd0cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:40.325020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-568f0f4a-7037-4301-bdc8-da4d21cd0cd0 None None] MFA Rules not processed for user `28874f14f2c64a7a9e3770cc7e5d3371`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:40.327773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-568f0f4a-7037-4301-bdc8-da4d21cd0cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:40.434457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1558/3091] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:40 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:40.447508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:40.450764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:40.555781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451e6f-e061-4f23-8672-ccd79efc5c57 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:40.564094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:40.565735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:40.567540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:40.569251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:40.587380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:40.592272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:40.608432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1534/3092] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:00:40 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:00:41.785325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a30c-03bf-41da-a3d8-62d8d03661d2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:41.785936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a30c-03bf-41da-a3d8-62d8d03661d2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:41.785936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a30c-03bf-41da-a3d8-62d8d03661d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:41.813893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5813a30c-03bf-41da-a3d8-62d8d03661d2 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:41.815776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5813a30c-03bf-41da-a3d8-62d8d03661d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:41.961444 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1559/3093] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:00:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:41.966497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:41.968269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:42.090640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37795-fae7-4045-9f6b-353e357969a7 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:42.101766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:42.113645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:42.114510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:42.117707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:42.145146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:42.147395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:42.165984 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1535/3094] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:00:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:00:43.672357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b860-df68-4631-9f1f-4d796984ba56 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:43.672947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b860-df68-4631-9f1f-4d796984ba56 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:43.672947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b860-df68-4631-9f1f-4d796984ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:43.697190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8df5b860-df68-4631-9f1f-4d796984ba56 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:43.699692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8df5b860-df68-4631-9f1f-4d796984ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:43.711354 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1560/3095] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:00:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:43.727431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:43.739886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9a27-c2cc-4926-ae3d-79261dc82967 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:43.749060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:43.750014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:43.750311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:43.750794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:43.767337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:43.772645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:43.804041 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1536/3096] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:00:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:00:45.576141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcbfb-2feb-4ab7-92c1-274e13b70d44 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:45.577724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcbfb-2feb-4ab7-92c1-274e13b70d44 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:45.578035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcbfb-2feb-4ab7-92c1-274e13b70d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:45.610135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-232fcbfb-2feb-4ab7-92c1-274e13b70d44 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:45.611351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-232fcbfb-2feb-4ab7-92c1-274e13b70d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:45.632137 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1561/3097] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:00:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:45.646348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:00:45.658300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a027a7c-b15b-4240-af88-2d8fdcd825ed service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:00:45.664487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:00:45.665338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:45.665773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:45.666223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:45.676287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:00:45.677901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3050402-8cd9-4821-9051-33efb93afa6e service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:00:45.686372 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1537/3098] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:00:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:00:45.974431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888871-5977-402c-8c6e-b5c445c06ffe None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:45.974712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888871-5977-402c-8c6e-b5c445c06ffe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:45.974985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888871-5977-402c-8c6e-b5c445c06ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:46.013928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1f888871-5977-402c-8c6e-b5c445c06ffe None None] MFA Rules not processed for user `28874f14f2c64a7a9e3770cc7e5d3371`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:46.015538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1f888871-5977-402c-8c6e-b5c445c06ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:46.032123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1562/3099] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:00:46.545367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa020f7-c119-4a07-89b6-7ca5ff4a1c9b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:46.545644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa020f7-c119-4a07-89b6-7ca5ff4a1c9b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:46.546362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa020f7-c119-4a07-89b6-7ca5ff4a1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:46.583720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9aa020f7-c119-4a07-89b6-7ca5ff4a1c9b None None] MFA Rules not processed for user `28874f14f2c64a7a9e3770cc7e5d3371`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:46.588030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9aa020f7-c119-4a07-89b6-7ca5ff4a1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:46.623702 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1538/3100] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:47.730027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef88876-7c94-4778-ba15-dea24a7e6648 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:47.730957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef88876-7c94-4778-ba15-dea24a7e6648 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:47.731285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef88876-7c94-4778-ba15-dea24a7e6648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:47.763142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2ef88876-7c94-4778-ba15-dea24a7e6648 None None] MFA Rules not processed for user `2e9fa45517c0412c82e0f85634858963`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:47.774362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2ef88876-7c94-4778-ba15-dea24a7e6648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:47.906781 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1563/3101] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:54.360637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:54.361416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:54.361695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:54.410094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] MFA Rules not processed for user `0620c1e55c3e4dadaa37890c7951e274`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:54.416637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:54.542133 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1539/3102] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:54 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:00:54.600028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b27fa-d8b7-43a9-951a-987c7b5305a5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:00:54.600580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b27fa-d8b7-43a9-951a-987c7b5305a5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:00:54.600831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b27fa-d8b7-43a9-951a-987c7b5305a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:00:54.637142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d85b27fa-d8b7-43a9-951a-987c7b5305a5 None None] MFA Rules not processed for user `25402f2151994aaa812407c629812b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:00:54.639496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d85b27fa-d8b7-43a9-951a-987c7b5305a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:00:54.725977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1564/3103] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:00:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:02.567067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:02.570628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:02.690511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd1c1b-161e-4a20-b110-fa3447a83d21 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:02.697832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:02.698975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:02.700098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:02.702428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] PATH_INFO: `/v3/users/9edc1ddb11cf41b8a2de2625d0f62f8b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:02.703186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9edc1ddb11cf41b8a2de2625d0f62f8b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:02.706372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:02.809256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9edc1ddb11cf41b8a2de2625d0f62f8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:02.826913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9edc1ddb11cf41b8a2de2625d0f62f8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:02.827497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9edc1ddb11cf41b8a2de2625d0f62f8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:02.872145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9edc1ddb11cf41b8a2de2625d0f62f8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:02.887804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9edc1ddb11cf41b8a2de2625d0f62f8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:02.907155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1540/3104] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:02 2021] DELETE /identity/v3/users/9edc1ddb11cf41b8a2de2625d0f62f8b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:02.908166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:02.908889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:02.908889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:02.941285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:02.943558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:03.075756 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1565/3105] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:03.089838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:03.092290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:03.227971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150dd9-73a5-427a-b7e6-92e525c94bb6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:03.236911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:03.237886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:03.239087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:03.241747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:03.277488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:03.280940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b7646-7930-4922-8489-b5f8fe1bd156 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:03.311519 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1541/3106] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:03.665559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:03.668727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:03.713341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def102e6-47d5-47b4-ac30-96b69ba4f7d9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:03.754407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:03.756113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:03.756854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:03.757518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] PATH_INFO: `/v3/projects/03858c7c818644f1a0b3d203f8b24a78` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:03.762259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03858c7c818644f1a0b3d203f8b24a78)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:03.765802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:03.841096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03858c7c818644f1a0b3d203f8b24a78', 'request_id': 'req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:03.857042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03858c7c818644f1a0b3d203f8b24a78', 'request_id': 'req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:03.866014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03858c7c818644f1a0b3d203f8b24a78', 'request_id': 'req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:03.887262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] The token cache is being invalidate because project 03858c7c818644f1a0b3d203f8b24a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:03.887840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:03.888363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e3d8bddf-033b-4df5-b4dc-8aae4ab2d10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:03.890445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1566/3107] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:03 2021] DELETE /identity/v3/projects/03858c7c818644f1a0b3d203f8b24a78 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:03.896303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:03.896825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:03.896953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:03.932275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:03.934121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:04.047447 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1542/3108] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:04.055504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.056599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.057032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.098686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:04.100441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:04.114795 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1567/3109] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:04.119032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.136477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c46b05-831e-430d-a38d-5808a482a374 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.151408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.152173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.152453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.156309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.158383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:04.159584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.164161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.192650 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1543/3110] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:04.195331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.215856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87b71-5018-4ccb-89fa-7339d5fba2b8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.228969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.230782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.232187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.232815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.233977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.252494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7dd88-950c-4e6e-a838-e42089c03c34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.325822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1568/3111] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:04 2021] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:04.330911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.389593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b5bc-c456-47f6-a02a-5093aff6d7b0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.483699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.484508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.485004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.509050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:04.510948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:04.541337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.544581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.544581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.545786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.546612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.551555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.586534 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1544/3112] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:04 2021] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:04.588835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.603716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce99a-f516-43e9-86a8-6395b7f0d945 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.607577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1569/3113] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:04 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:04.611610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.612370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.613173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.613476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.614800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.617984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.633225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.635210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:04.647749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1545/3114] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:04 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:04.659002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.688961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2a88-ca3a-4f1d-a9cf-ac802786e24d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.701613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.702742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.704104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.704392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.706467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.710927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.747216 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1546/3115] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:04 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:04.748949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:04.786039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1b8b-047d-4dcb-b2c6-cfe63dfc34d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.800103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.801832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.803139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf784fd-b685-4a25-9fdc-95ec333e461c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:04.803906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.806117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] PATH_INFO: `/v3/projects/a7064dbebd844554a250466764be4d9b/users/d649f8b166ce4db2aa7c133e36b7bc27/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.818381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:04.819283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.820010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.823163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.844437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.853358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007eb76-6c60-4f03-a3dc-c156836756eb service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.853577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7064dbebd844554a250466764be4d9b, user_id=d649f8b166ce4db2aa7c133e36b7bc27, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:04.858051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:04.886593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1570/3116] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:01:04.896739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1547/3117] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:04 2021] PUT /identity/v3/projects/a7064dbebd844554a250466764be4d9b/users/d649f8b166ce4db2aa7c133e36b7bc27/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:04.930718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:04.931802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:04.932150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:04.994011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] MFA Rules not processed for user `d649f8b166ce4db2aa7c133e36b7bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:04.995237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:05.167781 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1571/3118] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:04 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:05.178602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:05.180833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:05.315989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46eb-98d6-4257-9e81-3d3a2fb4963f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:05.326551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:05.329229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:05.330109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:05.330634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:05.348749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:05.351130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242450e-6f01-4954-9f3c-a350f0728bed service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:05.367168 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1548/3119] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:05 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:06.227412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:06.419257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d657b6-cfb5-4ef5-8e69-1495de0bd1ad None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:06.424075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:06.437404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:06.437670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:06.439926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] PATH_INFO: `/v3/users/d649f8b166ce4db2aa7c133e36b7bc27` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:06.443883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d649f8b166ce4db2aa7c133e36b7bc27)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:06.447452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:06.577397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd649f8b166ce4db2aa7c133e36b7bc27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:06.596830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd649f8b166ce4db2aa7c133e36b7bc27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:06.599062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd649f8b166ce4db2aa7c133e36b7bc27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:06.601498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd649f8b166ce4db2aa7c133e36b7bc27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:06.617574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd649f8b166ce4db2aa7c133e36b7bc27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:06.651634 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1572/3120] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:06 2021] DELETE /identity/v3/users/d649f8b166ce4db2aa7c133e36b7bc27 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:06.656063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:06.656702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:06.656702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:06.702497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:06.712214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:06.890869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1549/3121] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:06.901477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:06.904856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:07.026103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351458e-d28c-47cb-a459-38117bd0c9de admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:07.031195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:07.031955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:07.032281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:07.032557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:07.061657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:07.063469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ee7b-703a-4457-8c01-0c7bcc9e0b89 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:07.079274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1573/3122] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:07.672721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:07.674278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:07.701740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebf640-f3d3-4d5f-a934-479c89de58ee None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:07.709460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:07.710714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:07.711164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:07.711736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] PATH_INFO: `/v3/projects/a7064dbebd844554a250466764be4d9b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:07.728423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7064dbebd844554a250466764be4d9b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:07.731653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:07.897306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7064dbebd844554a250466764be4d9b', 'request_id': 'req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:07.909182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7064dbebd844554a250466764be4d9b', 'request_id': 'req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:07.922748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7064dbebd844554a250466764be4d9b', 'request_id': 'req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:07.958739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] The token cache is being invalidate because project a7064dbebd844554a250466764be4d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:07.959042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:07.961287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c501bfe-b42e-4a0a-9e13-7f5e7854934c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:07.962882 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1550/3123] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:07 2021] DELETE /identity/v3/projects/a7064dbebd844554a250466764be4d9b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:07.969080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:07.970041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:07.970490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:07.993903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:07.995698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:08.121809 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1574/3124] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:08.130880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.131790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.132233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.168294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:08.169664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:08.185008 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1551/3125] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:08.190820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.225700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c171e-4ac5-4389-9c67-0a46c9aa74cc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.239020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.239799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.240082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.241318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.244994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:08.245344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.247138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.278560 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1575/3126] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:08.283025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.294776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc5d8-9c08-4c31-80c2-9cdc3269f98b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.306367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.307219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.307611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.307988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.308848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.310941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.368786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.369149 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1552/3127] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:08 2021] POST /identity/v3/projects => generated 405 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:08.388698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866b19-dd0a-4e42-a03c-0181d832f011 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.519949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.519949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.520289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.520376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.521181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.526820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.565486 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1576/3128] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:08 2021] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:08.566673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.583661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7027492-fbca-45b2-92fb-70ccf5a1e12e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.601481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.603564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.603564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.603564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.604066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.611824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.648770 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1553/3129] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:08.650529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.667022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45008c-d647-40f7-87d4-a07c7362a77c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.685098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.686199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.686636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.687042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.687935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.691622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c478d5c-c6d0-4a56-8af8-f732e3b18502 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.717152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1577/3130] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:08.722268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:08.736011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a309d04-2347-4b94-b503-dc52b191b57a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:08.757574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:08.759151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.759600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.760047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] PATH_INFO: `/v3/projects/0d189e0cb2b24206a37a0604bb55e5d7/users/853731d3ab46489ebce820612b172480/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.788013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d189e0cb2b24206a37a0604bb55e5d7, user_id=853731d3ab46489ebce820612b172480, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:08.791239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:08.815379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1554/3131] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:08 2021] PUT /identity/v3/projects/0d189e0cb2b24206a37a0604bb55e5d7/users/853731d3ab46489ebce820612b172480/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:08.830994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:08.831578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:08.832222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:08.866714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] MFA Rules not processed for user `853731d3ab46489ebce820612b172480`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:08.867926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:08.981031 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1578/3132] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:08 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:08.985504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.146328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532fd9-aa74-4210-a20d-2b46ac943a92 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.157637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.158705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.159150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.159578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.160718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.162982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.209072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1555/3133] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:08 2021] POST /identity/v3/projects => generated 405 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:09.221298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.236931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cac2e-c7d0-4a00-9f1e-6cd9498c2cdb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.334076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.335319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.336044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.336564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.337521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.340997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.374001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1579/3134] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:09 2021] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:09.378208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.410634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba72d7-9386-4471-b8bb-7ad37345cacd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.426957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.427666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.428313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.428439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.429949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.431559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.452693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1556/3135] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:09 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:09.456992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.474340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e969e5-73f3-4848-8acd-0afe83fb3141 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.482557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.483491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.484120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.484466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] PATH_INFO: `/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3/users/689accdde28a47888388977250222b02/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.524881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb11d1b7ab5d48b8b8c1ed86b08a0da3, user_id=689accdde28a47888388977250222b02, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.527672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.565459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1580/3136] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:09 2021] PUT /identity/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3/users/689accdde28a47888388977250222b02/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:09.566685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.580661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee618e9-cd56-498e-a413-58953ef78391 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.707363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.708137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.709104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.709491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.710578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.712466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a7a09-46e1-4912-9ec8-e69bd60b508f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.724999 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1557/3137] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:09 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:09.728943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:09.744973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291e6a-1090-4a86-a477-c516590e87ac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:09.751318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:09.752559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.753041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.753652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] PATH_INFO: `/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3/users/689accdde28a47888388977250222b02/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.758727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb11d1b7ab5d48b8b8c1ed86b08a0da3, user_id=689accdde28a47888388977250222b02, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:09.761668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff8550-b995-475e-976e-667f36f7881c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:09.776140 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1581/3138] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:09 2021] PUT /identity/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3/users/689accdde28a47888388977250222b02/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:09.789421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22590-ab79-4920-93d9-ccf64928ad99 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:09.789925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22590-ab79-4920-93d9-ccf64928ad99 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:09.790240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22590-ab79-4920-93d9-ccf64928ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:09.873267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c8c22590-ab79-4920-93d9-ccf64928ad99 None None] MFA Rules not processed for user `689accdde28a47888388977250222b02`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:09.875368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c8c22590-ab79-4920-93d9-ccf64928ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:10.035580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1558/3139] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:09 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:10.047321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfe12-260d-4a5b-8448-3ab960e33595 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:10.047907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfe12-260d-4a5b-8448-3ab960e33595 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:10.047907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfe12-260d-4a5b-8448-3ab960e33595 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:10.050561 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1582/3140] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 10 04:01:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:01:10.057156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:10.057671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:10.058221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:10.132884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] MFA Rules not processed for user `7e779dee8d114aa890e1725ef72b0ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:10.134117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:10.251449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bfe12-260d-4a5b-8448-3ab960e33595 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:10.253651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1559/3141] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 04:01:10 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:10.273930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bfe12-260d-4a5b-8448-3ab960e33595 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:10.280409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:10.281297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:10.281626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:10.281902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:10.324172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:10.325950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175472e-4282-45b7-ae7f-d37d6c546eea service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:10.341436 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1583/3142] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:10 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:01:10.651808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:10.820932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0608d-69dc-423a-896a-cb6fdd8a3277 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:10.840062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:10.841424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:10.858550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:10.859119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] PATH_INFO: `/v3/users/853731d3ab46489ebce820612b172480` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:10.867457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853731d3ab46489ebce820612b172480)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:10.869769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:10.952168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853731d3ab46489ebce820612b172480'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:10.972851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853731d3ab46489ebce820612b172480'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:10.976126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853731d3ab46489ebce820612b172480'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:11.005528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:11.005968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:11.006215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:11.013711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853731d3ab46489ebce820612b172480'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:11.030258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-10980f37-4d44-47ec-b8be-f3386c2ec2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853731d3ab46489ebce820612b172480'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:11.040497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:11.041264 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1560/3143] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:10 2021] DELETE /identity/v3/users/853731d3ab46489ebce820612b172480 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:11.044890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:11.049174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:11.049807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:11.050308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:11.101399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:11.105469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:11.121365 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1584/3144] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:11.143438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:11.149652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:11.199752 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1561/3145] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:11.209333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:11.212237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:11.256762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba3db6-fdf5-4dac-b732-92476380b9b4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:11.266476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:11.267113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:11.267499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:11.267699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:11.279047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:11.280691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:11.290763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1585/3146] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:01:11.293738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7b2ec-735b-4ead-bf5b-50f973b9c767 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:11.299287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:11.300551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:11.301150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:11.301460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:11.314011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:11.316584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:11.329529 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1562/3147] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:01:12.005201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:12.007401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:12.041487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8632a-408c-4e64-9fc0-60d367ec64b8 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:12.066343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:12.070620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:12.071973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:12.075701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] PATH_INFO: `/v3/projects/0d189e0cb2b24206a37a0604bb55e5d7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:12.079321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d189e0cb2b24206a37a0604bb55e5d7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:12.109045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:12.217985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d189e0cb2b24206a37a0604bb55e5d7', 'request_id': 'req-05534512-09b9-49d0-af78-2c306ced953e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.229039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d189e0cb2b24206a37a0604bb55e5d7', 'request_id': 'req-05534512-09b9-49d0-af78-2c306ced953e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.248753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d189e0cb2b24206a37a0604bb55e5d7', 'request_id': 'req-05534512-09b9-49d0-af78-2c306ced953e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.285092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] The token cache is being invalidate because project 0d189e0cb2b24206a37a0604bb55e5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:12.285792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.287326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.295057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1586/3148] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:12 2021] DELETE /identity/v3/projects/0d189e0cb2b24206a37a0604bb55e5d7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:12.296387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:12.311026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620e4c-0230-4527-9526-5c3ce62bd5f5 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:12.421685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:12.422773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:12.423087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:12.423443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] PATH_INFO: `/v3/users/689accdde28a47888388977250222b02` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:12.425442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] RBAC: Authorizing `identity:delete_user(user_id=689accdde28a47888388977250222b02)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:12.427655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:12.554033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689accdde28a47888388977250222b02'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.566675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689accdde28a47888388977250222b02'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.567431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689accdde28a47888388977250222b02'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.592843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689accdde28a47888388977250222b02'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.610343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ef57c451-1c50-4e19-b28b-9c80bcda860d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689accdde28a47888388977250222b02'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:12.622845 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1563/3149] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:12 2021] DELETE /identity/v3/users/689accdde28a47888388977250222b02 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:13.261725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:13.263755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:13.307006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534512-09b9-49d0-af78-2c306ced953e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:13.389647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:13.391096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:13.391733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:13.392172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] PATH_INFO: `/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:13.393637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb11d1b7ab5d48b8b8c1ed86b08a0da3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:13.396117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:13.519486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb11d1b7ab5d48b8b8c1ed86b08a0da3', 'request_id': 'req-e937158f-d485-48ad-a5e6-2a2de57076b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:13.531799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb11d1b7ab5d48b8b8c1ed86b08a0da3', 'request_id': 'req-e937158f-d485-48ad-a5e6-2a2de57076b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:13.540690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb11d1b7ab5d48b8b8c1ed86b08a0da3', 'request_id': 'req-e937158f-d485-48ad-a5e6-2a2de57076b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:13.561173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] The token cache is being invalidate because project fb11d1b7ab5d48b8b8c1ed86b08a0da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:13.561762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:13.562927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e937158f-d485-48ad-a5e6-2a2de57076b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:13.572635 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1587/3150] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:13 2021] DELETE /identity/v3/projects/fb11d1b7ab5d48b8b8c1ed86b08a0da3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:13.574017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:13.575466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:13.575466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:13.608484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:13.610535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:13.773566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:13.774502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:13.774954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:13.785149 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1564/3151] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:13.803293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:13.805148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:13.827443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:13.843144 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1588/3152] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:13.845553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7611a8-1dcd-4685-af58-ba17f5cec184 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:13.879335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:13.880097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:13.885091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:13.885413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:13.889186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:13.889548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:13.894825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:13.937888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1565/3153] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:13.944599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:13.956809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438910d9-e6d3-4126-969e-a74a7042213a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:13.970236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:13.970942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:13.971256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:13.971530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:13.972438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:13.974618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:14.026610 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1589/3154] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:13 2021] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:14.031210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:14.065491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454474a-7143-48c5-a46d-a6f2511aeff7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:14.265358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:14.266396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.266807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.267421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.272943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:14.276722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:14.327893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1566/3155] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:14 2021] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:14.331808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:14.361269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834bc05-5130-47f2-9823-5797008edb0b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:14.376704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:14.381722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.382306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.384592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.385640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:14.390376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:14.426625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1590/3156] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:14 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:14.430352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:14.451309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff33ac-a560-43a4-9ac5-abf5e8b7adf4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:14.464504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:14.465501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.467401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.467973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.468969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:14.471830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484fdd-0640-46d5-8be5-1618d7966568 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:14.502558 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1567/3157] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:14 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:14.505839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:14.520058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593af2-f695-45ee-a11e-64c8b5ab0a92 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:14.542814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:14.544649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.544649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.544649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] PATH_INFO: `/v3/projects/77c7f1a880694c2e9bbbc7f139d3e2c0/users/16755828e6b247039fb1d435d3b30654/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.583076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c7f1a880694c2e9bbbc7f139d3e2c0, user_id=16755828e6b247039fb1d435d3b30654, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:14.599504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:14.660661 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1591/3158] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:14 2021] PUT /identity/v3/projects/77c7f1a880694c2e9bbbc7f139d3e2c0/users/16755828e6b247039fb1d435d3b30654/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:14.682374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.682982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.682982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.731052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] MFA Rules not processed for user `16755828e6b247039fb1d435d3b30654`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:14.732410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:14.850355 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1568/3159] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:14 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:14.854901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:14.965342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d116e-7bdd-488b-af87-89c3dbcd4df8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:14.971750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:14.972589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:14.973068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:14.976305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:14.981425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:14.985769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.035458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1592/3160] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:14 2021] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:15.038498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.054709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf9ccc-f271-482d-b981-6b1db75a491e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.179823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.182089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.182249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.183169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.184447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.186692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.216263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1569/3161] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:15 2021] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:15.217261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.239107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93ee-c619-4357-8b85-f4b3753345fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.246539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.247270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.247568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.247838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.249651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.255335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.276826 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1593/3162] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:15 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:15.278258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.297221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0a15-b580-4b4d-aa81-9600db4312c7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.304442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.307913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.309627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.315065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] PATH_INFO: `/v3/projects/1130251e63154623823c6f2c9293a1ae/users/847259b661674094b504cbb42081be9e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.349439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1130251e63154623823c6f2c9293a1ae, user_id=847259b661674094b504cbb42081be9e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.354176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.382800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1570/3163] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:15 2021] PUT /identity/v3/projects/1130251e63154623823c6f2c9293a1ae/users/847259b661674094b504cbb42081be9e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:15.387598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.408980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe467a5-eb5f-4670-8271-115818595b60 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.560362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.561346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.561632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.562407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.563253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.564923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b80f4-2f63-4b5a-ba62-3ad5df68836b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.591569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1594/3164] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:15 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:15.595666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.614992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8923-d230-4176-962f-0907abe03bc3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.622371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.623273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.624816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.625275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] PATH_INFO: `/v3/projects/1130251e63154623823c6f2c9293a1ae/users/847259b661674094b504cbb42081be9e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.627634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1130251e63154623823c6f2c9293a1ae, user_id=847259b661674094b504cbb42081be9e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.630856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:15.664268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1571/3165] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:15 2021] PUT /identity/v3/projects/1130251e63154623823c6f2c9293a1ae/users/847259b661674094b504cbb42081be9e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:15.678857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.679322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.679686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.734533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] MFA Rules not processed for user `847259b661674094b504cbb42081be9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:15.737997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:15.876089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1595/3166] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:15 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:15.887030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:15.889644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:15.963367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7251-d1cc-48b7-b142-fa8f9194e4ca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:15.967895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:15.968863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:15.968863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:15.969314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:15.981714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:15.983836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655fc1-8920-4d4b-9501-fe982d00239f service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:16.008740 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1572/3167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:15 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:16.246622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:16.260155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f1d0-4bd3-4329-ad69-9f5ff1cc7596 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:16.267118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:16.268427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:16.269147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:16.269660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:16.361754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:16.365443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:16.406054 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1596/3168] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:16 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:19.904677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:19.905679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:19.906171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:19.944729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:19.946366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:19.977222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:20.061546 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1573/3169] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:01:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:20.082298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:20.082537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d9db-04e6-416c-a2d6-0d600c791886 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:20.085401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:20.093914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:20.094801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:20.095076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:20.095512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] PATH_INFO: `/v3/users/16755828e6b247039fb1d435d3b30654` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:20.097311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16755828e6b247039fb1d435d3b30654)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:20.100397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:20.189054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16755828e6b247039fb1d435d3b30654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:20.191557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f30a-12f7-4f88-b480-89e25d710aa2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:20.200007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16755828e6b247039fb1d435d3b30654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:20.201293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16755828e6b247039fb1d435d3b30654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:20.202229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16755828e6b247039fb1d435d3b30654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:20.205234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:20.205967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:20.206465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:20.206465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:20.212362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-32f9e104-4ef2-4cb1-bb5e-f1184eac5d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16755828e6b247039fb1d435d3b30654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:20.212546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:20.235017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:20.236633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:20.241588 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1597/3170] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:19 2021] DELETE /identity/v3/users/16755828e6b247039fb1d435d3b30654 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:20.243269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:20.243641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:20.246423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:20.252698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1574/3171] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:01:20.267059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:20.268479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:20.345699 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1598/3172] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:20.357149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:20.358276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:20.435177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9275-128e-4b3c-8eda-4e11cdc5fcb0 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:20.502174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:20.503303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:20.503869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:20.504704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:20.517093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:20.518694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:20.536835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1575/3173] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:21.054559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:21.055985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:21.075247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f7f6-d5ba-40ec-9b70-769f1ef260f1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:21.081962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:21.082941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.083309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.083662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] PATH_INFO: `/v3/projects/77c7f1a880694c2e9bbbc7f139d3e2c0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.085567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c7f1a880694c2e9bbbc7f139d3e2c0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:21.088052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:21.202601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c7f1a880694c2e9bbbc7f139d3e2c0', 'request_id': 'req-47991ac8-1d26-49a4-a18b-f35af4147e5e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.210716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c7f1a880694c2e9bbbc7f139d3e2c0', 'request_id': 'req-47991ac8-1d26-49a4-a18b-f35af4147e5e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.221760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c7f1a880694c2e9bbbc7f139d3e2c0', 'request_id': 'req-47991ac8-1d26-49a4-a18b-f35af4147e5e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.245555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] The token cache is being invalidate because project 77c7f1a880694c2e9bbbc7f139d3e2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:21.245752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.246741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47991ac8-1d26-49a4-a18b-f35af4147e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.248684 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1599/3174] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:21 2021] DELETE /identity/v3/projects/77c7f1a880694c2e9bbbc7f139d3e2c0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:21.252423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:21.266516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c735e2-4bc5-4f58-9b99-240ad4ad0d24 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:21.338942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177b03b-1efe-4621-a9ee-38ad86212a95 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.339680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177b03b-1efe-4621-a9ee-38ad86212a95 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.339966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177b03b-1efe-4621-a9ee-38ad86212a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.375007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3177b03b-1efe-4621-a9ee-38ad86212a95 None None] MFA Rules not processed for user `28439236f513404989b79da765cd70d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:21.376231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3177b03b-1efe-4621-a9ee-38ad86212a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:21.400663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:21.402328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.402620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.403234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] PATH_INFO: `/v3/users/847259b661674094b504cbb42081be9e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.405196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=847259b661674094b504cbb42081be9e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:21.407544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:21.465693 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1600/3175] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:21 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:21.467041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a993c7-cad8-4ba6-b222-ea1d7c56edd6 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.467319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a993c7-cad8-4ba6-b222-ea1d7c56edd6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.467597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a993c7-cad8-4ba6-b222-ea1d7c56edd6 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.477024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1601/3176] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:01:21 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:01:21.478320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.478772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.479038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.503105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:21.504694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:21.508058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847259b661674094b504cbb42081be9e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.524820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847259b661674094b504cbb42081be9e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.525865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847259b661674094b504cbb42081be9e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.559764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847259b661674094b504cbb42081be9e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.570982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847259b661674094b504cbb42081be9e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:21.602568 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1576/3177] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:21 2021] DELETE /identity/v3/users/847259b661674094b504cbb42081be9e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:21.608749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1602/3178] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:01:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:21.638977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:21.640675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:21.780391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50224c86-7ba2-40b8-92bd-da0a5a48c4cc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:21.786291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:21.787604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:21.787938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:21.788280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:21.798607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:21.815827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c99d-6517-4956-81f4-8bbad5a4dec8 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:21.836578 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1577/3179] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:22.133843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:22.135832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:22.174831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539b2b-b518-4381-9782-98c045f36a33 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:22.294311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:22.296092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.296537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.296993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] PATH_INFO: `/v3/projects/1130251e63154623823c6f2c9293a1ae` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.298506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1130251e63154623823c6f2c9293a1ae)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:22.301205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:22.366578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1130251e63154623823c6f2c9293a1ae', 'request_id': 'req-04452f39-a093-44f9-8789-0c188b4d6895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:22.375136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1130251e63154623823c6f2c9293a1ae', 'request_id': 'req-04452f39-a093-44f9-8789-0c188b4d6895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:22.383609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1130251e63154623823c6f2c9293a1ae', 'request_id': 'req-04452f39-a093-44f9-8789-0c188b4d6895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:22.403617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] The token cache is being invalidate because project 1130251e63154623823c6f2c9293a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:22.404031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:22.404836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04452f39-a093-44f9-8789-0c188b4d6895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:22.406743 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1603/3180] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:22 2021] DELETE /identity/v3/projects/1130251e63154623823c6f2c9293a1ae => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:22.413770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.414371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.414371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.451450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:22.452711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:22.548236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1578/3181] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:22.557506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.558147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.558789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.587350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:22.591954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:22.622168 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1604/3182] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:22.623641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:22.638280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2f738-08f2-4b61-9ee4-d7c444b03ace None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:22.645551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:22.647190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.647550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.647931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.648943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:22.649746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:22.651662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:22.670814 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1579/3183] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:22.674940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:22.686156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4a54-1c40-4f31-a4cd-3f4510f7e42c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:22.704011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:22.705010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.705289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.705559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.706294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:22.708177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:22.754721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1605/3184] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:22 2021] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:22.759402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:22.785061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0de240-c11d-470f-8824-57bde6968924 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:22.930315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:22.931010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:22.931445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:22.931721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:22.932429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:22.934431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:22.971647 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1580/3185] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:22 2021] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:22.975424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:22.991290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb25b-7373-4587-856c-95f1e5c929fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:23.005133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:23.007430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:23.007973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:23.008452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:23.009591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:23.012725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:23.028649 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1606/3186] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:22 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:23.031741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:23.042049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8bfba-64f4-4498-8d2e-909607a4ac81 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:23.058093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:23.059200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:23.059707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:23.060192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:23.061223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:23.063929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56931-145e-4ff1-8abc-313b1cfecab8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:23.087429 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1581/3187] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:23.091297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:23.105318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7f49-eaba-4c5e-92d8-3a128e0e2267 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:23.122116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:23.125599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:23.126055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:23.126892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] PATH_INFO: `/v3/projects/5c153fdbf1fe4871b9e76a63be97966e/users/e2fbdead370445f69a87cf85cb118861/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:23.179621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c153fdbf1fe4871b9e76a63be97966e, user_id=e2fbdead370445f69a87cf85cb118861, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:23.188725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:23.216949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1607/3188] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:23 2021] PUT /identity/v3/projects/5c153fdbf1fe4871b9e76a63be97966e/users/e2fbdead370445f69a87cf85cb118861/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:23.308937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:23.309268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:23.309472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:23.386968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] MFA Rules not processed for user `e2fbdead370445f69a87cf85cb118861`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:23.390430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:23.633893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1582/3189] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:23 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:23.639841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:23.863050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c55fe8-4e7a-4e57-8903-03a43ee6d607 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:23.880187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:23.881229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:23.881509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:23.881810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:23.882528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:23.889380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8e6e9-088c-45f3-8df9-0e363bf89883 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:23.954646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1608/3190] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:23 2021] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:23.959306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:23.974086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855668-ac63-4d20-a378-b0d7423400fa None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.058866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50cb42-d5fe-483e-b00b-2f2691278f24 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.059552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50cb42-d5fe-483e-b00b-2f2691278f24 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.060046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50cb42-d5fe-483e-b00b-2f2691278f24 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.063012 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1609/3191] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:01:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:01:24.073199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.073785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.074307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.101069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:24.102967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:24.103794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.107775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.108097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.108447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.109487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.113218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.158258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1583/3192] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:23 2021] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:24.162631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.192134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab55df-2443-4f20-820e-3aa95e4e5157 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.205263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.206515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.207888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.209781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.210874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.215536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.240310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1584/3193] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:24.245374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.263742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1610/3194] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:24 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:24.271135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5ba7-bccd-41c6-a55f-152e428369fb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.282230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.284047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.285071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.285818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] PATH_INFO: `/v3/projects/7a830940d418467da0c13a91a15d41d2/users/7b0b2f0917b94ba0900b1a122bf0ef72/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.319444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.320651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a830940d418467da0c13a91a15d41d2, user_id=7b0b2f0917b94ba0900b1a122bf0ef72, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.326563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:24.327046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.352229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1585/3195] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:24 2021] PUT /identity/v3/projects/7a830940d418467da0c13a91a15d41d2/users/7b0b2f0917b94ba0900b1a122bf0ef72/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:24.356642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.378621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff13e6-0033-441f-84e5-2b8f23a2f975 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.567713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c4a6-e333-4355-80e8-01402159de03 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.577376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.577976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.578256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.578605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.580697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.580975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.581585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.582614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.583204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.583491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.610531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.612400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e716721-b7fb-4d2f-a7c9-07e481babbeb service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.613077 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1586/3196] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:24.616531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.644143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448226ae-4d93-4d1d-9a5b-d91b33646c74 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:24.652158 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1611/3197] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:01:24.658760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:24.660056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.660627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.661390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] PATH_INFO: `/v3/projects/7a830940d418467da0c13a91a15d41d2/users/7b0b2f0917b94ba0900b1a122bf0ef72/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.665020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a830940d418467da0c13a91a15d41d2, user_id=7b0b2f0917b94ba0900b1a122bf0ef72, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:24.669483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:24.727210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1587/3198] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:24 2021] PUT /identity/v3/projects/7a830940d418467da0c13a91a15d41d2/users/7b0b2f0917b94ba0900b1a122bf0ef72/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:24.737481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3713fa-49df-410d-9f73-6a18e4067eba None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:24.737751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3713fa-49df-410d-9f73-6a18e4067eba None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:24.738027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3713fa-49df-410d-9f73-6a18e4067eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:24.789277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fa3713fa-49df-410d-9f73-6a18e4067eba None None] MFA Rules not processed for user `7b0b2f0917b94ba0900b1a122bf0ef72`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:24.791528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fa3713fa-49df-410d-9f73-6a18e4067eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:24.960953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1612/3199] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:24 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:24.972275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:24.975239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:25.097314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9213995-ffcb-4c63-9075-c69f27637ec8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:25.111158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:25.112929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:25.113412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:25.114153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:25.133146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:25.135580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15598e05-01f8-4fab-b39b-38dc474bc9bc service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:25.150158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1588/3200] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:24 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:25.175750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:25.176310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:25.176948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:25.179623 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1613/3201] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:01:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:01:25.186397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:25.187446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:25.187983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:25.232397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:25.239706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:25.268824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:25.272965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:25.305999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe6c66-9a6c-41a9-8b24-11ba53bb01a4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:25.315458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:25.318288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:25.318843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:25.321016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:25.393141 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1589/3202] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:01:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:25.427864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:25.451207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47067cb1-ff8c-4dbb-87db-2fe7ff5e754c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:25.451458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:25.454957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:25.466526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:25.467187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:25.467462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:25.467925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:25.471222 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1614/3203] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:25 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:01:25.482786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:25.484705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d440ae-4cdc-43fc-964a-ef461fce8dfe service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:25.497556 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1590/3204] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:29.271159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:29.354947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9cde5-829c-4d98-9e55-3b963168db4f service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:29.360878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:29.362119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:29.362119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:29.362342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] PATH_INFO: `/v3/users/e2fbdead370445f69a87cf85cb118861` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:29.363361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fbdead370445f69a87cf85cb118861)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:29.365896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:29.417679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fbdead370445f69a87cf85cb118861'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:29.425033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fbdead370445f69a87cf85cb118861'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:29.426147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fbdead370445f69a87cf85cb118861'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:29.426891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fbdead370445f69a87cf85cb118861'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:29.441820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fbdead370445f69a87cf85cb118861'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:29.460181 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1615/3205] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:29 2021] DELETE /identity/v3/users/e2fbdead370445f69a87cf85cb118861 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:29.461932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:29.462538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:29.462898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:29.482548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:29.483858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:29.548845 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1591/3206] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:29.559745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:29.561271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:29.632804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff601d-22c8-4aca-8698-8fffac4f56ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:29.636464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:29.637145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:29.637423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:29.637865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:29.647317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:29.648934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:29.659731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1616/3207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:30.216286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:30.217906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:30.231165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57913cc-a557-4492-b095-5a643d66dc45 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:30.238788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:30.240430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:30.240950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:30.241440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] PATH_INFO: `/v3/projects/5c153fdbf1fe4871b9e76a63be97966e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:30.242923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c153fdbf1fe4871b9e76a63be97966e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:30.245159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:30.303221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c153fdbf1fe4871b9e76a63be97966e', 'request_id': 'req-1de7271a-bb7a-45df-bce8-270a4e573e25'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.310475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c153fdbf1fe4871b9e76a63be97966e', 'request_id': 'req-1de7271a-bb7a-45df-bce8-270a4e573e25'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.321419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c153fdbf1fe4871b9e76a63be97966e', 'request_id': 'req-1de7271a-bb7a-45df-bce8-270a4e573e25'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.338040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] The token cache is being invalidate because project 5c153fdbf1fe4871b9e76a63be97966e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:30.338256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.339498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de7271a-bb7a-45df-bce8-270a4e573e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.341465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1592/3208] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:30 2021] DELETE /identity/v3/projects/5c153fdbf1fe4871b9e76a63be97966e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:30.345353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:30.354954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b6234-963f-429f-ac59-b91b8559cd5f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:30.424673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:30.425950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:30.426382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:30.427929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] PATH_INFO: `/v3/users/7b0b2f0917b94ba0900b1a122bf0ef72` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:30.429607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0b2f0917b94ba0900b1a122bf0ef72)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:30.431655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:30.548157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0b2f0917b94ba0900b1a122bf0ef72'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.558034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0b2f0917b94ba0900b1a122bf0ef72'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.561315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0b2f0917b94ba0900b1a122bf0ef72'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.562781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0b2f0917b94ba0900b1a122bf0ef72'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.576024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0b2f0917b94ba0900b1a122bf0ef72'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:30.617018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1617/3209] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:30 2021] DELETE /identity/v3/users/7b0b2f0917b94ba0900b1a122bf0ef72 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:31.120844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:31.122748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:31.123189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:31.148897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:31.150399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:31.236538 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1593/3210] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:31.253087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:31.256529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:31.403959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deed558-4a15-4b25-99e1-464f6157d8b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:31.409796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:31.410637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:31.411002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:31.411344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:31.420587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:31.422404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957355-3959-4fed-b6f6-28212e4cf550 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:31.432741 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1618/3211] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:01:31.446202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:31.448993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:31.632041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ca642-a414-46b3-94f1-809568ff79bc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:31.653280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:31.654163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:31.654431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:31.657074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] PATH_INFO: `/v3/projects/7a830940d418467da0c13a91a15d41d2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:31.659972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a830940d418467da0c13a91a15d41d2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:31.676196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:31.787830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a830940d418467da0c13a91a15d41d2', 'request_id': 'req-eca4062c-8bf1-4b59-b633-72ba7218cf26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:31.797930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a830940d418467da0c13a91a15d41d2', 'request_id': 'req-eca4062c-8bf1-4b59-b633-72ba7218cf26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:31.817038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a830940d418467da0c13a91a15d41d2', 'request_id': 'req-eca4062c-8bf1-4b59-b633-72ba7218cf26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:31.842485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] The token cache is being invalidate because project 7a830940d418467da0c13a91a15d41d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:31.844184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:31.846704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eca4062c-8bf1-4b59-b633-72ba7218cf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:31.852302 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1594/3212] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:31 2021] DELETE /identity/v3/projects/7a830940d418467da0c13a91a15d41d2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:31.859515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:31.859995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:31.860436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:31.902759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:31.904018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:32.011874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.012076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.012332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.013313 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1619/3213] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:32.039153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:32.041794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:32.060554 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1595/3214] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:32.063224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.082233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae0b1-eadb-4b78-89ab-9c51e822cdd7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.089356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.090335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.090820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.091241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.092135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:32.092590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.094823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.114199 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1620/3215] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:32.118635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.135937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668cb3-ee95-488f-84f1-a6969078b0ce None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.144528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.145640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.145924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.146726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.150909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.154933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.218229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1596/3216] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:32 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:32.222614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.239202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f18d-49fe-47b5-aec1-960c30907308 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.367976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.371929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.373379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.375431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.376256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.379978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.443552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.446309 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1621/3217] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:32 2021] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:32.461841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ef81-08f8-41bb-a5c1-78fd5404cc41 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.481738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.482596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.483730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.485337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.487178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.493289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.532215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1597/3218] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:32 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:32.535970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.576033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359141-3ef1-45fa-8b12-7dce46ee3837 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.591593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.593463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.595079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.595571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.596522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.601488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f924-a43b-48a8-a002-ffdb3bb5050c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.634564 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1622/3219] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:32 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:32.635285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:32.656487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f63542-6927-46a6-8ab4-a74da7575aea admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:32.682364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:32.685356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.697312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.698532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] PATH_INFO: `/v3/projects/3dc5ce71921c40ea9d0eda16e7d89220/users/f41f7a917db543a995e003b8badc6540/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.728010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc5ce71921c40ea9d0eda16e7d89220, user_id=f41f7a917db543a995e003b8badc6540, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:32.732550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:32.764712 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1598/3220] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:32 2021] PUT /identity/v3/projects/3dc5ce71921c40ea9d0eda16e7d89220/users/f41f7a917db543a995e003b8badc6540/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:32.765333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:32.765657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:32.765922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:32.848558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] MFA Rules not processed for user `f41f7a917db543a995e003b8badc6540`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:32.849912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:33.013595 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1623/3221] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:32 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:33.018400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.145688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ea75-7a01-4255-b98d-970f0810c4dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.155527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.156280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.156821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.157289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.158205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.161381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.225552 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1599/3222] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:33 2021] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:33.227429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.241079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a559-46a2-4bc7-af8d-57133ebc077d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.321984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.322630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.322991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.323282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.324125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.327079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.362226 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1624/3223] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:33 2021] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:33.370032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.383192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00dab9-b8ca-4d08-960b-5ea5af84e92a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.388817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.389772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.390067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.390541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.391296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.393853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.415618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1600/3224] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:33 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:33.419558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.431863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa979-0514-45fd-826d-9f3a83187151 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.443787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.445050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.445490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.446132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] PATH_INFO: `/v3/projects/88be9870163a47d6a7f639013ad1fa73/users/66dede9e7bf54b0f996b0ef126282014/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.469947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88be9870163a47d6a7f639013ad1fa73, user_id=66dede9e7bf54b0f996b0ef126282014, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.474435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.495955 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1625/3225] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:33 2021] PUT /identity/v3/projects/88be9870163a47d6a7f639013ad1fa73/users/66dede9e7bf54b0f996b0ef126282014/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:33.497095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.514872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72b49-d89b-4996-a30b-64fe8c6f8922 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.624305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.625018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.625472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.625936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.626966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.629593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a863-46b9-4ce6-8ad7-2dcdbce8b144 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.643040 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1601/3226] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:33 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:33.647373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.661176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe434f-9ec5-49b2-8952-f47d775cffc5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:33.668083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:33.669036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.669506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.669949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] PATH_INFO: `/v3/projects/88be9870163a47d6a7f639013ad1fa73/users/66dede9e7bf54b0f996b0ef126282014/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.672337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88be9870163a47d6a7f639013ad1fa73, user_id=66dede9e7bf54b0f996b0ef126282014, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:33.675811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:33.704501 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1626/3227] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:33 2021] PUT /identity/v3/projects/88be9870163a47d6a7f639013ad1fa73/users/66dede9e7bf54b0f996b0ef126282014/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:33.704730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:33.705061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:33.705362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:33.739053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] MFA Rules not processed for user `66dede9e7bf54b0f996b0ef126282014`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:33.743367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:33.879752 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1602/3228] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:33 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:33.890844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:33.892911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:34.057845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430222e-a15a-4506-bda7-abeba6aaa229 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:34.065544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:34.068645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:34.069322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:34.069456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:34.095179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:34.098808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e47579-7a27-4a98-84bb-a02c2d2fe0f0 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:34.131945 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1627/3229] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:33 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:34.354467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:34.563045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f005-8084-4f35-8eef-fa68b7669723 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:34.585718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:34.586957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:34.587493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:34.587948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] PATH_INFO: `/v3/users/f41f7a917db543a995e003b8badc6540` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:34.592932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41f7a917db543a995e003b8badc6540)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:34.598260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:34.738686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41f7a917db543a995e003b8badc6540'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:34.752597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41f7a917db543a995e003b8badc6540'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:34.753708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41f7a917db543a995e003b8badc6540'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:34.776778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41f7a917db543a995e003b8badc6540'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:34.800382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41f7a917db543a995e003b8badc6540'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:34.828706 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1603/3230] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:34 2021] DELETE /identity/v3/users/f41f7a917db543a995e003b8badc6540 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:34.832370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:34.835091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:34.835812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:34.873785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:34.875275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:35.096997 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1628/3231] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:35.111414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:35.115088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:35.250783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9fbfe-4a2d-4258-96c5-eae061a31496 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:35.262643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:35.265140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:35.265472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:35.265671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:35.300535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:35.304123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:35.335570 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1604/3232] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:36.564083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:36.568353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:36.597857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fec51-7f7b-4232-adb2-3a7398c6a59d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:36.617714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:36.619083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:36.619590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:36.620146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] PATH_INFO: `/v3/projects/3dc5ce71921c40ea9d0eda16e7d89220` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:36.622248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc5ce71921c40ea9d0eda16e7d89220)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:36.625483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:36.757827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc5ce71921c40ea9d0eda16e7d89220', 'request_id': 'req-38c710f9-61ab-4b75-b792-3c60ae44aad8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:36.773328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc5ce71921c40ea9d0eda16e7d89220', 'request_id': 'req-38c710f9-61ab-4b75-b792-3c60ae44aad8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:36.784070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc5ce71921c40ea9d0eda16e7d89220', 'request_id': 'req-38c710f9-61ab-4b75-b792-3c60ae44aad8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:36.809511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] The token cache is being invalidate because project 3dc5ce71921c40ea9d0eda16e7d89220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:36.810152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:36.811020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:36.816299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1629/3233] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:36 2021] DELETE /identity/v3/projects/3dc5ce71921c40ea9d0eda16e7d89220 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:36.818088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:36.847710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395e8e1-65b6-4af7-95fb-ee02d00a5184 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:36.942853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:36.944828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:36.945143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:36.945413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] PATH_INFO: `/v3/users/66dede9e7bf54b0f996b0ef126282014` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:36.947806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dede9e7bf54b0f996b0ef126282014)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:36.950166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:37.023188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dede9e7bf54b0f996b0ef126282014'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.033411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dede9e7bf54b0f996b0ef126282014'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.034212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dede9e7bf54b0f996b0ef126282014'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.051673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dede9e7bf54b0f996b0ef126282014'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.062413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbfe8419-620f-463c-a4b5-f2e23a5441e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dede9e7bf54b0f996b0ef126282014'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.071443 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1605/3234] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:36 2021] DELETE /identity/v3/users/66dede9e7bf54b0f996b0ef126282014 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:37.651940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:37.653937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:37.676404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c710f9-61ab-4b75-b792-3c60ae44aad8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:37.842055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:37.846641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:37.847156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:37.847586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] PATH_INFO: `/v3/projects/88be9870163a47d6a7f639013ad1fa73` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:37.849923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=88be9870163a47d6a7f639013ad1fa73)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:37.852240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:37.922836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88be9870163a47d6a7f639013ad1fa73', 'request_id': 'req-0b4abca4-a557-4076-a035-5c7a672cc8fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.933613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88be9870163a47d6a7f639013ad1fa73', 'request_id': 'req-0b4abca4-a557-4076-a035-5c7a672cc8fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.942099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88be9870163a47d6a7f639013ad1fa73', 'request_id': 'req-0b4abca4-a557-4076-a035-5c7a672cc8fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.974192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] The token cache is being invalidate because project 88be9870163a47d6a7f639013ad1fa73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:37.974760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.975660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b4abca4-a557-4076-a035-5c7a672cc8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:37.981645 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1630/3235] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:37 2021] DELETE /identity/v3/projects/88be9870163a47d6a7f639013ad1fa73 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:37.987253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:37.988069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:37.988521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.029337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:38.033513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:38.220245 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1606/3236] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:38.224461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.224963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.227054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.264459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:38.266325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:38.284274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1631/3237] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:38.285502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.305094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3f47-8a67-4971-ad03-5b0c9d2cedb9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.314978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.318438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.318438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.318438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.318438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:38.318438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.319408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.344952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1607/3238] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:01:38.346364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.366780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f26a18-c449-4437-840e-d629c4a901ca None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.373929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.374955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.375535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.375982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.376749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.379263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.417858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1632/3239] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:38 2021] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:38.422061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.436153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63b88-1bb4-408e-b936-a6b60fdda7dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.592149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.595397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.595397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.595630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.599642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.602105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.648389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.654349 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1608/3240] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:38 2021] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:38.660191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07411a-df0f-4b4b-82f3-199a8250f7db admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.669452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.671433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.671976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.671976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.673811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.675454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.705759 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1633/3241] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:38.710072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.727318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5661-57f6-4794-83b5-15bda507b3af admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.734296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.734971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.735278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.735531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.736269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.737891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64cd2a-e3f5-4489-8182-3218a8c7d81d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.761418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1609/3242] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:38.761866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:38.777167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fd0f7-9917-41b4-8a78-b80020f185c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:38.804650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:38.808417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.809663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.811519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] PATH_INFO: `/v3/projects/1b59f4c9b40848b09b95b066d8a10b0a/users/d88783a7dc4b4151bc7860b88112dbd0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.861656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b59f4c9b40848b09b95b066d8a10b0a, user_id=d88783a7dc4b4151bc7860b88112dbd0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:38.869368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:38.913746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1634/3243] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:38 2021] PUT /identity/v3/projects/1b59f4c9b40848b09b95b066d8a10b0a/users/d88783a7dc4b4151bc7860b88112dbd0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:38.926175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:38.926462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:38.926751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:38.972551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] MFA Rules not processed for user `d88783a7dc4b4151bc7860b88112dbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:38.977177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:39.123009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1610/3244] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:38 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:39.127800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:39.290412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335de0cd-0b42-4784-8d7e-24a167003252 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:39.298887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:39.299842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:39.300336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:39.300855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:39.301803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:39.305225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:39.399890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1635/3245] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:39 2021] POST /identity/v3/projects => generated 389 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:39.403000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:39.425905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf917d-6a03-44c0-ab33-808fe461aed5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:39.678562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:39.679490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:39.681049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:39.682534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:39.683682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:39.687903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:39.745774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1611/3246] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:39 2021] POST /identity/v3/users => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:39.748527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:39.765563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb38c2-1d25-466d-a2bd-14f71a17220a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:39.789556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:39.792659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:39.795164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:39.795864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:39.799364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:39.803905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:39.830029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1636/3247] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:39.835805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:39.852950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51c4d-8e40-474e-aace-b82ed221a1df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:39.882315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:39.883194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:39.883431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:39.883735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] PATH_INFO: `/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca/users/bc8ee54b6971467ab1629784f58fa78d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:39.912474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1f8a3ee8734c168c27327a5faf0cca, user_id=bc8ee54b6971467ab1629784f58fa78d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:39.915225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:39.955624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1612/3248] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:39 2021] PUT /identity/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca/users/bc8ee54b6971467ab1629784f58fa78d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:39.960955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:39.983366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d336-d751-48cf-95ad-23a860afad03 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:40.146772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:40.147498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:40.147782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:40.148061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:40.150198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:40.151808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caac9a-f73d-422e-b9b8-ad231ebfca83 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:40.173583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1637/3249] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:40.174400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:40.198441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1cf08-3de9-49af-801a-3a1fc0754361 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:40.227004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:40.227937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:40.228215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:40.228575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] PATH_INFO: `/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca/users/bc8ee54b6971467ab1629784f58fa78d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:40.232827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1f8a3ee8734c168c27327a5faf0cca, user_id=bc8ee54b6971467ab1629784f58fa78d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:40.240010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:40.277390 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1613/3250] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:40 2021] PUT /identity/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca/users/bc8ee54b6971467ab1629784f58fa78d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:40.288933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:40.289221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:40.289533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:40.337856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] MFA Rules not processed for user `bc8ee54b6971467ab1629784f58fa78d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:40.340830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:40.426238 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1638/3251] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:40 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:40.434656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:40.436726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:40.515254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e342ad-4c67-4c70-a977-4f1d768ccdb1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:40.519218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:40.520052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:40.521319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:40.521786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:40.532187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:40.533818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3157a6-1a98-4175-b1a9-8c7ace88ea2c service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:40.557222 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1614/3252] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:40 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:40.736193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:40.861690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6199-5b1d-4b1a-9948-8ed10040c1d9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:40.872667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:40.873827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:40.874263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:40.874723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] PATH_INFO: `/v3/users/d88783a7dc4b4151bc7860b88112dbd0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:40.876112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88783a7dc4b4151bc7860b88112dbd0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:40.878202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:40.972009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88783a7dc4b4151bc7860b88112dbd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:40.981223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88783a7dc4b4151bc7860b88112dbd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:40.982234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88783a7dc4b4151bc7860b88112dbd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:40.983024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88783a7dc4b4151bc7860b88112dbd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:40.996362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88783a7dc4b4151bc7860b88112dbd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:41.044062 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1639/3253] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:40 2021] DELETE /identity/v3/users/d88783a7dc4b4151bc7860b88112dbd0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:41.049868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:41.050437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:41.050913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:41.073593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:41.075077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:41.146228 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1615/3254] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:41.156373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:41.157913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:41.228500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65e863-ab74-490b-927e-227f38af8bd7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:41.235778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:41.236550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:41.236958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:41.237375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:41.251901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:41.253580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:41.267558 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1640/3255] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:41.827843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:41.829485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:41.858288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32b9de-f409-4ece-87c1-6ca2f601887c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:41.878142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:41.879923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:41.880675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:41.880980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] PATH_INFO: `/v3/projects/1b59f4c9b40848b09b95b066d8a10b0a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:41.882735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b59f4c9b40848b09b95b066d8a10b0a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:41.884850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:41.963672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b59f4c9b40848b09b95b066d8a10b0a', 'request_id': 'req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:41.982886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b59f4c9b40848b09b95b066d8a10b0a', 'request_id': 'req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:41.993303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b59f4c9b40848b09b95b066d8a10b0a', 'request_id': 'req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.019918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] The token cache is being invalidate because project 1b59f4c9b40848b09b95b066d8a10b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:42.021831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.023997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.027839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1616/3256] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:41 2021] DELETE /identity/v3/projects/1b59f4c9b40848b09b95b066d8a10b0a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:42.032199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:42.048685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ec3-82be-44da-ba2e-9864e6b2bc03 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:42.199715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:42.200906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:42.203655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:42.204160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] PATH_INFO: `/v3/users/bc8ee54b6971467ab1629784f58fa78d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:42.206066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8ee54b6971467ab1629784f58fa78d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:42.211129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:42.351944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8ee54b6971467ab1629784f58fa78d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.390439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8ee54b6971467ab1629784f58fa78d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.412720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8ee54b6971467ab1629784f58fa78d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.412720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8ee54b6971467ab1629784f58fa78d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.439963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f705f43-6b93-4d15-9e78-cfbec673d5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8ee54b6971467ab1629784f58fa78d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:42.499770 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1641/3257] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:42 2021] DELETE /identity/v3/users/bc8ee54b6971467ab1629784f58fa78d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:43.311576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:43.314430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:43.348431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab8f84-4f36-4f09-ae43-b69d1dd2548e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:43.443204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:43.444204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:43.444547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:43.444961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] PATH_INFO: `/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:43.447134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1f8a3ee8734c168c27327a5faf0cca)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:43.450042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:43.541096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1f8a3ee8734c168c27327a5faf0cca', 'request_id': 'req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:43.559870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1f8a3ee8734c168c27327a5faf0cca', 'request_id': 'req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:43.569039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1f8a3ee8734c168c27327a5faf0cca', 'request_id': 'req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:43.602045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] The token cache is being invalidate because project 2c1f8a3ee8734c168c27327a5faf0cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:43.602685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:43.603522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e5b0e7b1-09b2-4950-b77a-05c9f5343e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:43.611253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1617/3258] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:43 2021] DELETE /identity/v3/projects/2c1f8a3ee8734c168c27327a5faf0cca => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:43.612135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:43.612659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:43.612773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:43.650345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:43.652695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:43.804385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:43.804385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:43.804385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:43.804747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1642/3259] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:43.836115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:43.837576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:43.851820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:43.857941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1618/3260] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:43.864622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747512ea-fb62-4496-b148-e34d51b782fc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:43.870187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:43.870869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:43.871292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:43.871576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:43.872375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:43.872742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:43.874694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:43.903316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:43.911507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1643/3261] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:43.915960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae410f16-fab2-49e8-a771-7a8b6980be2c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:43.921804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:43.922499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:43.922775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:43.923049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:43.923753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:43.925950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:43.970581 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1619/3262] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:43 2021] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:43.975451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:43.993417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b5ea-21f6-4335-81c9-84bf073a53aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:44.123421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:44.124088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:44.124513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:44.124914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:44.125750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:44.136392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:44.198304 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1644/3263] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:43 2021] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:44.200023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:44.226473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafab12-05d7-44c6-8e8b-354e66b696eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:44.243438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:44.244315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:44.244960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:44.245241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:44.274878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:44.279428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:44.320619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1620/3264] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:44.325147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:44.341162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e25ae8-d07c-42b5-9e4e-362728f1f6f3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:44.354194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:44.354771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:44.355583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:44.355583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:44.356073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:44.361143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8efcc1-ab77-4998-b1ae-ad154887e9af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:44.389872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1645/3265] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:44.391235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:44.432203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c1b1-3cf2-42f5-a610-d2eba8741aff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:44.451945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:44.454036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:44.455246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:44.457068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] PATH_INFO: `/v3/projects/1c6758f8760a445ba90c267b195104e7/users/222749743d0b46d5b055c53fc9ac3290/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:44.534665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6758f8760a445ba90c267b195104e7, user_id=222749743d0b46d5b055c53fc9ac3290, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:44.546216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:44.597857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:44.598325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:44.599299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:44.601822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1621/3266] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:44 2021] PUT /identity/v3/projects/1c6758f8760a445ba90c267b195104e7/users/222749743d0b46d5b055c53fc9ac3290/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:44.656149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] MFA Rules not processed for user `222749743d0b46d5b055c53fc9ac3290`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:44.658049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:44.895007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1646/3267] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:44.899622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.087068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b753d7-c161-48f0-9cd4-0429c0f02333 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.101528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.103064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.103571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.103860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.105784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.111463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:45.175857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1622/3268] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:44 2021] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:45.179591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.198392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e65e9-52ee-44cd-acbe-0c996102fb39 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.352209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.353047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.353415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.353548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.355178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.357616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:45.403106 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1647/3269] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:45 2021] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:45.407195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.423475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3eb9f-cfaa-4477-9650-f2b224bf2b2c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.431465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.432419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.432787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.433159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.434999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.437445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:45.459991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1623/3270] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:45.462446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.477621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d2e52-e4b5-4371-9a63-657e035bc20d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.489850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.491162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.491454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.491852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] PATH_INFO: `/v3/projects/2fe870e4af6a426f9e608659972457d9/users/647759d182af46998dd827b060c4f1d3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.527420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe870e4af6a426f9e608659972457d9, user_id=647759d182af46998dd827b060c4f1d3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.548768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311576a1-a5e0-4f07-84b9-2d8c7f306533 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:45.607171 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1648/3271] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:45 2021] PUT /identity/v3/projects/2fe870e4af6a426f9e608659972457d9/users/647759d182af46998dd827b060c4f1d3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:45.609476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.609891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.610090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.610200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.638738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd196f-0730-4e96-a683-e200278777a4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.649392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:45.650623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:45.737346 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1649/3272] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:45.757831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:45.760551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:45.915063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751c9d-39b0-4a50-a805-c2c22f10db35 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:45.931706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.932665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.933124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.934002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.957930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:45.961576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.963233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:45.964298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:45.964436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:45.966745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:45.967927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:45.978726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2b54e-7e3a-49ae-a1b1-3335b5454625 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:46.000835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1650/3273] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:01:46.025551 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1624/3274] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:46.026708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:46.058026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6fcf-d6e3-4be1-b04e-87c7a72bf0de service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:46.069307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:46.070496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:46.070962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:46.071240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] PATH_INFO: `/v3/projects/2fe870e4af6a426f9e608659972457d9/users/647759d182af46998dd827b060c4f1d3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:46.075768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe870e4af6a426f9e608659972457d9, user_id=647759d182af46998dd827b060c4f1d3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:46.090338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:46.117991 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1651/3275] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:46 2021] PUT /identity/v3/projects/2fe870e4af6a426f9e608659972457d9/users/647759d182af46998dd827b060c4f1d3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:46.129469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:46.129800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:46.130107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:46.185062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] MFA Rules not processed for user `647759d182af46998dd827b060c4f1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:46.186385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:46.366196 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1625/3276] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:46 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:46.373603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:46.375711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:46.522598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c217-1383-48e3-9b43-3cf14d3ba307 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:46.532495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:46.534688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:46.535559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:46.536857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:46.559698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:46.568870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bdef7-5b4f-42cf-ac91-932d4d82a94a service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:46.591147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1652/3277] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:46 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:47.527996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:47.739995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4998b-ce43-4d77-9bc7-0cd711ed8dea None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:47.752959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:47.753860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:47.754147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:47.754400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] PATH_INFO: `/v3/users/222749743d0b46d5b055c53fc9ac3290` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:47.755641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222749743d0b46d5b055c53fc9ac3290)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:47.757574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:47.828927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222749743d0b46d5b055c53fc9ac3290'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:47.835919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222749743d0b46d5b055c53fc9ac3290'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:47.836685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222749743d0b46d5b055c53fc9ac3290'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:47.849362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222749743d0b46d5b055c53fc9ac3290'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:47.859636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222749743d0b46d5b055c53fc9ac3290'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:47.873480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1626/3278] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:47 2021] DELETE /identity/v3/users/222749743d0b46d5b055c53fc9ac3290 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:47.875303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:47.875831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:47.876027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:47.904992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:47.906478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:48.008596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1653/3279] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:48.022076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:48.024542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:48.121244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57a09-7f6e-464d-baf2-30b424f9b808 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:48.131071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:48.132185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:48.132806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:48.133101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:48.148536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:48.150548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:48.161693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1627/3280] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:01:48.676235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:48.678296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:48.697508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1b7cf-2b62-43f2-909e-f4f9ae2f3c4c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:48.705231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:48.706426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:48.706706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:48.707252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] PATH_INFO: `/v3/projects/1c6758f8760a445ba90c267b195104e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:48.708593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6758f8760a445ba90c267b195104e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:48.711175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:48.813146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6758f8760a445ba90c267b195104e7', 'request_id': 'req-e59ac29d-3b65-471d-9186-f1348f15f374'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:48.845661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6758f8760a445ba90c267b195104e7', 'request_id': 'req-e59ac29d-3b65-471d-9186-f1348f15f374'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:48.865940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6758f8760a445ba90c267b195104e7', 'request_id': 'req-e59ac29d-3b65-471d-9186-f1348f15f374'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:48.893050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] The token cache is being invalidate because project 1c6758f8760a445ba90c267b195104e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:48.893765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:48.894000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:48.895560 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1654/3281] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:48 2021] DELETE /identity/v3/projects/1c6758f8760a445ba90c267b195104e7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:48.900131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:48.916643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081dcde-b2a0-46b2-99bc-a4e6613ec4e6 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:48.984127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:48.985392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:48.985901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:48.986320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] PATH_INFO: `/v3/users/647759d182af46998dd827b060c4f1d3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:48.988159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647759d182af46998dd827b060c4f1d3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:48.990505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:49.084257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647759d182af46998dd827b060c4f1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.092967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647759d182af46998dd827b060c4f1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.094142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647759d182af46998dd827b060c4f1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.113736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647759d182af46998dd827b060c4f1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.142744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f483158e-75d4-4965-8267-93860243ed13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647759d182af46998dd827b060c4f1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.153118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1628/3282] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:01:48 2021] DELETE /identity/v3/users/647759d182af46998dd827b060c4f1d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:49.612278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:49.613865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:49.653355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ac29d-3b65-471d-9186-f1348f15f374 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:49.765306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:49.766292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:49.766794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:49.767223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] PATH_INFO: `/v3/projects/2fe870e4af6a426f9e608659972457d9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:49.768826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe870e4af6a426f9e608659972457d9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:49.773915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:49.844256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe870e4af6a426f9e608659972457d9', 'request_id': 'req-6df6842e-fd67-42c8-a51e-149b0c520377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.852220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe870e4af6a426f9e608659972457d9', 'request_id': 'req-6df6842e-fd67-42c8-a51e-149b0c520377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.859672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe870e4af6a426f9e608659972457d9', 'request_id': 'req-6df6842e-fd67-42c8-a51e-149b0c520377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.878439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] The token cache is being invalidate because project 2fe870e4af6a426f9e608659972457d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:01:49.878828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.879549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6df6842e-fd67-42c8-a51e-149b0c520377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:01:49.881877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1655/3283] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:01:49 2021] DELETE /identity/v3/projects/2fe870e4af6a426f9e608659972457d9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:49.887677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:49.888213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:49.888793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:49.917965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:49.919299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:50.017493 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1629/3284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:01:50.027363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.027944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.028056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.055950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:50.057497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:50.076783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1656/3285] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:50.080160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.096347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6f4d-5317-4185-b080-f7dd479a77ed None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.111594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.112871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.113370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.113940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.115688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:01:50.116153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.117942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.142372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.151215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1630/3286] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:01:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:01:50.154704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3510808-1432-4c1d-8c25-25f2f3628a2b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.161576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.162303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.162785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.163289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.164242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.166957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.208523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.209310 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1657/3287] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:50 2021] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:50.229768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24119884-6466-4e95-98e8-77d440cbd148 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.340460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.341179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.341460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.342253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.342989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.346174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.377515 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1631/3288] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:50 2021] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:50.384031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.401084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224352-3bb2-4a7b-91e7-3ea704b9351d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.428548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.429861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.430252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.430561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.431323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.433240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.448460 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1658/3289] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:50.452560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.467166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d689bd7-fb01-419e-9140-0549058ecf1b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.483681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.484485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.484704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.484977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.486760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.487800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2bdf4-f71d-4967-bede-b3a80a8e9b99 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.507291 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1632/3290] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:01:50.508874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.529752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b8380-0dea-4858-b197-94701f350150 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:50.545548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:50.546560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.547357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.547643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] PATH_INFO: `/v3/projects/7bc5d858ae694d3480a3caa09d836cdc/users/d17fccaa5fc5428e9434a791f5860555/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.592120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc5d858ae694d3480a3caa09d836cdc, user_id=d17fccaa5fc5428e9434a791f5860555, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:50.595841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:50.636650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:50.637237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:50.637695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:50.640205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1659/3291] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:50 2021] PUT /identity/v3/projects/7bc5d858ae694d3480a3caa09d836cdc/users/d17fccaa5fc5428e9434a791f5860555/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:50.676223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] MFA Rules not processed for user `d17fccaa5fc5428e9434a791f5860555`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:50.678544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:50.846152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1633/3292] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:50 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:50.851286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:50.964532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2ed91-3496-4f32-b4f9-59a1a69885e2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.002699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.004019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.005623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.006879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.010853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.015952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.108383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1660/3293] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:50 2021] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:51.109083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.121805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116895-edcc-4729-9d6a-d3945a87ac91 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.249180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.250276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.250769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.251770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.252729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.256253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.298827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1634/3294] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:51 2021] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:01:51.300338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.322638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109004-effc-4f5d-8464-e1d5003ac17f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.329931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.331052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.331543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.332008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.333572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.335777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.347393 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1661/3295] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:51 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:51.351616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.365497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee65d-14c2-4a5c-a435-1e2638d9a901 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.372855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.373754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.374197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.374622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.375522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.377588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58540b-e384-4615-beab-ee969293031c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.392593 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1635/3296] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:51.397760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.410902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d7ba-12aa-43e3-8437-b20867a8e58f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.416088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.417020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.417560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.417840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] PATH_INFO: `/v3/projects/ecd14707726e4e9498a3e113d51a0f0a/users/b2bfce51bc234de1bd6a6def2d39a5aa/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.458873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd14707726e4e9498a3e113d51a0f0a, user_id=b2bfce51bc234de1bd6a6def2d39a5aa, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.462564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.492834 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1662/3297] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:51 2021] PUT /identity/v3/projects/ecd14707726e4e9498a3e113d51a0f0a/users/b2bfce51bc234de1bd6a6def2d39a5aa/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:51.504224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.504505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.505372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.565885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] MFA Rules not processed for user `b2bfce51bc234de1bd6a6def2d39a5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:51.582597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:51.766222 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1636/3298] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:51.770867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.899949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae024-1444-40ca-98a8-0a03d959d954 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:51.905103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:51.906522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:51.906522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:51.906723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:51.907427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:51.909738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:51.944924 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1663/3299] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:01:51 2021] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:51.948561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:51.964872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c6980-5632-412f-abb6-8fdc138e6ee9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:52.073326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:52.074008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.074287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.074561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.075287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:52.078641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:52.119797 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1637/3300] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:01:51 2021] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:01:52.124064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:52.141485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec015-fba9-4926-a97b-266c951b8443 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:52.149433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:52.150577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.151202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.151710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.152989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:52.156143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:52.170917 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1664/3301] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:52.175763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:52.216472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3a54-e67f-4e66-b05d-29213c6259a3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:52.235062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:52.235982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.236474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.236795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] PATH_INFO: `/v3/projects/5a3ef95733044c73a73e12f54a78d304/users/2fcf9b717cbe42afb06a820ff0b5efe3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.265562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3ef95733044c73a73e12f54a78d304, user_id=2fcf9b717cbe42afb06a820ff0b5efe3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:52.268818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:52.296703 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1638/3302] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:52 2021] PUT /identity/v3/projects/5a3ef95733044c73a73e12f54a78d304/users/2fcf9b717cbe42afb06a820ff0b5efe3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:01:52.300801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:52.327369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333939c-e44d-4e7b-a01a-495c25cb860b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:52.459857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:52.460545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.460852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.461129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.461885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:52.463604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b408d-bbd0-4f4c-b063-839b36d3fc77 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:52.492297 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1665/3303] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:01:52.497207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:52.509629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e066f7-0808-4a5a-b3a0-5c380dbbaded admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:52.515599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:52.516931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.517216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.517542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] PATH_INFO: `/v3/projects/5a3ef95733044c73a73e12f54a78d304/users/2fcf9b717cbe42afb06a820ff0b5efe3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.522077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3ef95733044c73a73e12f54a78d304, user_id=2fcf9b717cbe42afb06a820ff0b5efe3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:52.526557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:52.543792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1639/3304] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:01:52 2021] PUT /identity/v3/projects/5a3ef95733044c73a73e12f54a78d304/users/2fcf9b717cbe42afb06a820ff0b5efe3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:01:52.554276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:52.554590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:52.554864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:52.598548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] MFA Rules not processed for user `2fcf9b717cbe42afb06a820ff0b5efe3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:52.599933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:52.760357 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1666/3305] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:01:52 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:52.774121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:52.775888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:53.002027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f096-bf12-4ad3-ab90-bc316c7940e7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:53.021500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:53.022556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:53.023145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:53.023626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:53.164068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:53.169350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:53.190243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1640/3306] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:52 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:55.375096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:55.377187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:55.394738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413a0f-d745-4140-a30d-33f0e99191dd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:55.400177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:55.401310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:55.401310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:55.401519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:55.475299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:55.476811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d642a-1b17-4597-a38f-bde2df7d725c service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:55.494524 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1667/3307] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:55 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:56.786519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:56.805370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8a3b2-c2c2-4cc4-a500-2b57daaa7313 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:56.811128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:56.813019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:56.813609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:56.814117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:56.828459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:56.831319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:56.847910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1641/3308] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:01:56 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:01:56.886928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:56.887649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:56.887649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:56.933300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:01:56.934502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:57.144661 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1668/3309] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:01:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:01:57.164654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:01:57.168417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:01:57.323039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e706d36-ffc2-48c3-9878-ad0434f311dd service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:01:57.329752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:01:57.330601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:01:57.330884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:01:57.331162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:01:57.344410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:01:57.346732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7cc52-992d-4071-9a1a-5af04d3332b3 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:01:57.361812 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1642/3310] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:01:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:01.596376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:01.701349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035869-120e-4550-ba44-a5ec4073b892 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:01.708492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:01.709668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:01.710124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:01.710596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] PATH_INFO: `/v3/users/d17fccaa5fc5428e9434a791f5860555` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:01.712088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17fccaa5fc5428e9434a791f5860555)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:01.714302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:01.782579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17fccaa5fc5428e9434a791f5860555'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:01.790219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17fccaa5fc5428e9434a791f5860555'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:01.791046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17fccaa5fc5428e9434a791f5860555'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:01.793902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17fccaa5fc5428e9434a791f5860555'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:01.808447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17fccaa5fc5428e9434a791f5860555'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:01.836879 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1669/3311] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:01 2021] DELETE /identity/v3/users/d17fccaa5fc5428e9434a791f5860555 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:01.842177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:01.842744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:01.842853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:01.861325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:01.862621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:01.945994 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1643/3312] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:01.957873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:01.962173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:02.071042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda31de6-3ace-4bfb-bec4-63d6e118fcb7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:02.083889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:02.085115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:02.085410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:02.085689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:02.110050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:02.112293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d969-de79-4125-b0e0-5d4d7eef730f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:02.137005 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1670/3313] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:02.175796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:02.177754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:02.195380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed906f-e606-453f-b29f-50cbc8f9b65c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:02.213090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:02.213977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:02.214249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:02.214718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] PATH_INFO: `/v3/users/0620c1e55c3e4dadaa37890c7951e274` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:02.217060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0620c1e55c3e4dadaa37890c7951e274)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:02.219161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:02.310838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0620c1e55c3e4dadaa37890c7951e274'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:02.325096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0620c1e55c3e4dadaa37890c7951e274'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:02.326145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0620c1e55c3e4dadaa37890c7951e274'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:02.349997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0620c1e55c3e4dadaa37890c7951e274'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:02.366277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0620c1e55c3e4dadaa37890c7951e274'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:02.375062 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1644/3314] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:02 2021] DELETE /identity/v3/users/0620c1e55c3e4dadaa37890c7951e274 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:02.379499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80024-9975-47f2-bfb6-db474853382b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:02.379932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80024-9975-47f2-bfb6-db474853382b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:02.380322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80024-9975-47f2-bfb6-db474853382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:02.417413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2ca80024-9975-47f2-bfb6-db474853382b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:02.419024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2ca80024-9975-47f2-bfb6-db474853382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:02.543583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1671/3315] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:02.560594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:02.562310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:02.712874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897d4b-5c1c-49ab-8802-2117f1c70469 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:02.718620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:02.719465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:02.719905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:02.720349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:02.732366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:02.734792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:02.753809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1645/3316] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:03.114442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:03.114934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:03.115211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:03.157950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:03.161638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.258579 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1672/3317] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:03.299448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:03.306283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.329887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:03.332279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.378246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40da3-b40e-43b4-ba87-a9912046c592 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:03.390157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:03.391297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:03.391748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:03.392187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] PATH_INFO: `/v3/projects/a5ed7dce06584ab79a7dcbe1e5b27dc3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:03.393638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ed7dce06584ab79a7dcbe1e5b27dc3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:03.395933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:03.480540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074964-da1c-4ca9-b873-53ad05729862 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:03.489343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:03.490521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:03.491053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:03.491507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:03.505583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:03.509119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:03.510194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ed7dce06584ab79a7dcbe1e5b27dc3', 'request_id': 'req-73f05150-efd4-4d17-8253-9abdde35a35d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.527226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ed7dce06584ab79a7dcbe1e5b27dc3', 'request_id': 'req-73f05150-efd4-4d17-8253-9abdde35a35d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.534855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ed7dce06584ab79a7dcbe1e5b27dc3', 'request_id': 'req-73f05150-efd4-4d17-8253-9abdde35a35d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.537309 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1646/3318] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:03.543085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:03.545358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.561747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] The token cache is being invalidate because project a5ed7dce06584ab79a7dcbe1e5b27dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:03.561747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.565365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.569494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58119ba-c447-441d-ad0a-87fc16509779 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:03.569882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1673/3319] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:03 2021] DELETE /identity/v3/projects/a5ed7dce06584ab79a7dcbe1e5b27dc3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:03.570761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:03.576101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.721568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:03.722685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:03.723594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:03.723942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] PATH_INFO: `/v3/projects/7bc5d858ae694d3480a3caa09d836cdc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:03.725663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc5d858ae694d3480a3caa09d836cdc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:03.727782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:03.746939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05150-efd4-4d17-8253-9abdde35a35d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:03.762354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:03.763450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:03.763795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:03.763795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] PATH_INFO: `/v3/users/72da726789b54cddba470e3050054d43` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:03.773281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72da726789b54cddba470e3050054d43)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:03.775218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:03.835175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc5d858ae694d3480a3caa09d836cdc', 'request_id': 'req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.850738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc5d858ae694d3480a3caa09d836cdc', 'request_id': 'req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.863127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc5d858ae694d3480a3caa09d836cdc', 'request_id': 'req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.906359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] The token cache is being invalidate because project 7bc5d858ae694d3480a3caa09d836cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:03.908316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.911251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.926464 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1647/3320] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:03 2021] DELETE /identity/v3/projects/7bc5d858ae694d3480a3caa09d836cdc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:03.927167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:03.928758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:03.934853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72da726789b54cddba470e3050054d43'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.954687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72da726789b54cddba470e3050054d43'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.956110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72da726789b54cddba470e3050054d43'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.956898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72da726789b54cddba470e3050054d43'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:03.975228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72da726789b54cddba470e3050054d43'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.021759 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1674/3321] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:03 2021] DELETE /identity/v3/users/72da726789b54cddba470e3050054d43 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:04.088560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf201-cd22-43ad-b74c-fad6e35ee5b1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:04.199277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:04.202600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:04.203987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:04.207298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] PATH_INFO: `/v3/users/b2bfce51bc234de1bd6a6def2d39a5aa` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:04.213036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bfce51bc234de1bd6a6def2d39a5aa)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:04.220967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:04.323542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bfce51bc234de1bd6a6def2d39a5aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.334444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bfce51bc234de1bd6a6def2d39a5aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.337823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bfce51bc234de1bd6a6def2d39a5aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.361179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bfce51bc234de1bd6a6def2d39a5aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.385675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb214afa-a6dd-4223-b79b-fe51567140af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bfce51bc234de1bd6a6def2d39a5aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.415606 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1648/3322] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:03 2021] DELETE /identity/v3/users/b2bfce51bc234de1bd6a6def2d39a5aa => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:04.715764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:04.718237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:04.748430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29914fc8-77b6-462f-b13b-d7e8614e09b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:04.803508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-4561-4828-8063-1ebf325f3db0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:04.803981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-4561-4828-8063-1ebf325f3db0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:04.804360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-4561-4828-8063-1ebf325f3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:04.852974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:04.854103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:04.854585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:04.856209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] PATH_INFO: `/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:04.857709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71435cce1a1f43cfb13115ccdb6f8f1e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:04.860039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:04.898171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9d95de3c-4561-4828-8063-1ebf325f3db0 None None] MFA Rules not processed for user `28439236f513404989b79da765cd70d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:04.908345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9d95de3c-4561-4828-8063-1ebf325f3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:04.975273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71435cce1a1f43cfb13115ccdb6f8f1e', 'request_id': 'req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:04.987876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71435cce1a1f43cfb13115ccdb6f8f1e', 'request_id': 'req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.007120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71435cce1a1f43cfb13115ccdb6f8f1e', 'request_id': 'req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.030652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] The token cache is being invalidate because project 71435cce1a1f43cfb13115ccdb6f8f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:05.031136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.032750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f4552c4-08ac-4807-9fe0-1e39fcca9b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.039980 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1675/3323] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:04 2021] DELETE /identity/v3/projects/71435cce1a1f43cfb13115ccdb6f8f1e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:05.046459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.047060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.047529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.060637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1649/3324] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:04 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:05.098768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:05.100021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.293890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1676/3325] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:05.302173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.302501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.302784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.343597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:05.346917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.367294 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1650/3326] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:05.371347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.382352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c89e0f-9303-4fe4-835f-361e7618ef48 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.397336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.398105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.399747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.400110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.402758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:05.403153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.406251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.431094 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1677/3327] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:05.435283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.446063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e535e7-480f-4e2b-a41e-ef5be7fba05f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.453516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.454540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.454903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.455281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.456881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.460375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.475302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.477314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.500242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c2f3-d910-4566-9358-88d0cabcc1ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.527377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.531751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.534266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.535607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] PATH_INFO: `/v3/projects/ecd14707726e4e9498a3e113d51a0f0a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.538249 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1651/3328] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:05 2021] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:05.538397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd14707726e4e9498a3e113d51a0f0a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.540719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.541747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.646736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd14707726e4e9498a3e113d51a0f0a', 'request_id': 'req-9b7d8347-3603-4a69-878a-f04210e2ed75'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.658965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd14707726e4e9498a3e113d51a0f0a', 'request_id': 'req-9b7d8347-3603-4a69-878a-f04210e2ed75'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.667701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd14707726e4e9498a3e113d51a0f0a', 'request_id': 'req-9b7d8347-3603-4a69-878a-f04210e2ed75'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.688700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf23e5-52fd-46f8-a4b2-0a5cb1286a88 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.689910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] The token cache is being invalidate because project ecd14707726e4e9498a3e113d51a0f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:05.690076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.692505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.701348 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1678/3329] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:05 2021] DELETE /identity/v3/projects/ecd14707726e4e9498a3e113d51a0f0a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:05.705133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.709579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.758861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.759775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.760278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.760789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.761709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.763798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.792316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1652/3330] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:05 2021] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:05.800385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.805388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.810006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d8347-3603-4a69-878a-f04210e2ed75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.816364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.818184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.818467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.818819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] PATH_INFO: `/v3/users/2fcf9b717cbe42afb06a820ff0b5efe3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.820735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcf9b717cbe42afb06a820ff0b5efe3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.823314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.836970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3361-94dc-4936-afc3-b3eb32781875 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.873015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.873715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.874315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.874604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.876653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.877800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.893195 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1653/3331] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:05 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:05.896802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.903494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcf9b717cbe42afb06a820ff0b5efe3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.907606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4103eb-24f3-442b-9c35-6e815932ecd4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:05.912323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcf9b717cbe42afb06a820ff0b5efe3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.913060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcf9b717cbe42afb06a820ff0b5efe3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.913692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcf9b717cbe42afb06a820ff0b5efe3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.917104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:05.918025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:05.918782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:05.919434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:05.920988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:05.923749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:05.925198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2fcb1e-ceca-4329-a21f-f5af04d82448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcf9b717cbe42afb06a820ff0b5efe3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:05.939837 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1654/3332] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:05 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:05.941347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:05.946581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:05.955855 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1679/3333] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:05 2021] DELETE /identity/v3/users/2fcf9b717cbe42afb06a820ff0b5efe3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:05.972475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de5452-9f2d-4424-b9de-0febbcf79ee9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:06.108463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:06.112017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:06.112464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:06.112595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] PATH_INFO: `/v3/projects/b2b97e1083184979a13c16d12ec87aac/users/c97777c543744f398530e24ae6ba3409/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:06.162329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b97e1083184979a13c16d12ec87aac, user_id=c97777c543744f398530e24ae6ba3409, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:06.165191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:06.188627 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1655/3334] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:05 2021] PUT /identity/v3/projects/b2b97e1083184979a13c16d12ec87aac/users/c97777c543744f398530e24ae6ba3409/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:06.193816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:06.194106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:06.194388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:06.220836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:06.222328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:06.318397 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1680/3335] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:06.333329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:06.335723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:06.459514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc7a96-0de1-4580-a0d1-86eb69aba806 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:06.470159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:06.471437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:06.471901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:06.472333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:06.491621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:06.494676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebafea-9ecf-4a3b-9467-117be13ffd57 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:06.507863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1656/3336] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:07.521076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:07.523696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:07.544679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e96a9a-99a7-4ec1-9282-69d49b2345b5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:07.581655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:07.582583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:07.582922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:07.583229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] PATH_INFO: `/v3/projects/5a3ef95733044c73a73e12f54a78d304` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:07.585318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3ef95733044c73a73e12f54a78d304)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:07.588306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:07.698933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3ef95733044c73a73e12f54a78d304', 'request_id': 'req-49621490-efeb-4f02-b32a-12ead00d6d14'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:07.732455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3ef95733044c73a73e12f54a78d304', 'request_id': 'req-49621490-efeb-4f02-b32a-12ead00d6d14'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:07.743882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3ef95733044c73a73e12f54a78d304', 'request_id': 'req-49621490-efeb-4f02-b32a-12ead00d6d14'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:07.778307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] The token cache is being invalidate because project 5a3ef95733044c73a73e12f54a78d304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:07.779456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:07.779793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-49621490-efeb-4f02-b32a-12ead00d6d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:07.784724 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1681/3337] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:07 2021] DELETE /identity/v3/projects/5a3ef95733044c73a73e12f54a78d304 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:07.788799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:07.789755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:07.790196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:07.853885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:07.858497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:08.006194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1657/3338] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:08.006870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.006870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.006870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.089948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:08.091395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:08.128074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1682/3339] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:08.132402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.148774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fcb12-bde6-4805-a06f-f6396d08c99a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.167468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.168766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.169243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.169678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.170594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:08.171058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.172913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.205444 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1658/3340] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:08.209995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.223948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a13f-cc58-4968-801e-a87c2a96255f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.244296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.245291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.245747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.246523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.247437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.253666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.340656 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1683/3341] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:08 2021] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:08.345580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.365552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd06b1-aef2-4485-a2de-a123df82a367 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.500180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.500880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.501347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.501896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.502767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.507728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.554298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.555146 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1659/3342] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:08 2021] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:08.570041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ed52-d6c8-48fa-b12c-8258c85a24d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.579742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.580833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.581315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.581806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.584048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.586687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.611723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.625013 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1684/3343] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:08.634725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385d40-0d4c-47d0-9251-74a73d911305 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.644687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.647281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.647620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.648779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.651560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.656348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb0f8f-587a-442f-8d9c-15c7bffb4593 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.676663 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1660/3344] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:08.679480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.706616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab8bf-a9ba-4a49-91f4-2b5d9cd63d37 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:08.714303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:08.715941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.716412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.716916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] PATH_INFO: `/v3/projects/277c38a86cf147b4975c1a6e3cd149ba/users/f4d2b7c3dfeb4772b7cad1bf63c9d193/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.749759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277c38a86cf147b4975c1a6e3cd149ba, user_id=f4d2b7c3dfeb4772b7cad1bf63c9d193, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:08.753121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:08.782375 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1685/3345] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:08 2021] PUT /identity/v3/projects/277c38a86cf147b4975c1a6e3cd149ba/users/f4d2b7c3dfeb4772b7cad1bf63c9d193/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:08.785300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:08.785773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:08.786240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:08.860514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] MFA Rules not processed for user `f4d2b7c3dfeb4772b7cad1bf63c9d193`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:08.862689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:08.965585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1661/3346] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:08 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:08.979839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:08.982428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:09.085200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089e36-3dcb-4712-9869-760e83f46356 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:09.091291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:09.092684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:09.094349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:09.095040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:09.107263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:09.109326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:09.134629 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1686/3347] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:08 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:11.152104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:11.156148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:11.424578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a2c5-c1c7-4824-b81b-bd737fc3f348 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:11.430684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:11.431697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:11.432185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:11.432748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:11.436106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:11.441122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:11.473288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcb36-b131-4aa5-92a8-30b0030ebe22 service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:11.487244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:11.489299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:11.490018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:11.491003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:11.494276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:11.681568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:11.683755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:11.719608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1662/3348] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:11.721469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:11.725640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:11.790273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:11.792957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:11.843866 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1687/3349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:11.969985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7364d02-5a4c-4dfa-bc7d-871fdfe2eca6 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:11.983703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:11.985589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:11.985851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:11.986117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] PATH_INFO: `/v3/users/2e9fa45517c0412c82e0f85634858963` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:11.989239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9fa45517c0412c82e0f85634858963)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:11.991290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:12.111347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9fa45517c0412c82e0f85634858963'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:12.143495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9fa45517c0412c82e0f85634858963'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:12.145574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9fa45517c0412c82e0f85634858963'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:12.191036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9fa45517c0412c82e0f85634858963'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:12.212355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9fa45517c0412c82e0f85634858963'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:12.222141 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1663/3350] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:11 2021] DELETE /identity/v3/users/2e9fa45517c0412c82e0f85634858963 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:13.461880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:13.483829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421aee-0bee-4a57-9f7e-2f36d85c0e17 service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:13.629674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:13.630570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:13.630854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:13.631128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] PATH_INFO: `/v3/projects/ea64fdb2282844728c33886df39a303b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:13.636675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64fdb2282844728c33886df39a303b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:13.638019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:13.734475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64fdb2282844728c33886df39a303b', 'request_id': 'req-86dc4f61-bddb-471d-af2e-d8b5e7655933'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:13.744267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64fdb2282844728c33886df39a303b', 'request_id': 'req-86dc4f61-bddb-471d-af2e-d8b5e7655933'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:13.762668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64fdb2282844728c33886df39a303b', 'request_id': 'req-86dc4f61-bddb-471d-af2e-d8b5e7655933'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:13.783846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] The token cache is being invalidate because project ea64fdb2282844728c33886df39a303b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:13.784227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:13.784899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:13.791478 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1688/3351] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:13 2021] DELETE /identity/v3/projects/ea64fdb2282844728c33886df39a303b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:13.793063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:13.795699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:13.830546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eaad9-8691-450d-a616-c96171d25da5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:13.918129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:13.919565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:13.919565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:13.920063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] PATH_INFO: `/v3/users/a0fdcec722be4e3ea8206973268525e5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:13.926859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fdcec722be4e3ea8206973268525e5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:13.931081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:14.048596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fdcec722be4e3ea8206973268525e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:14.073728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fdcec722be4e3ea8206973268525e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:14.077793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fdcec722be4e3ea8206973268525e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:14.116563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fdcec722be4e3ea8206973268525e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:14.132075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-afc60d33-44f7-4d35-b271-69425ff0b0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fdcec722be4e3ea8206973268525e5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:14.158785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1664/3352] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:13 2021] DELETE /identity/v3/users/a0fdcec722be4e3ea8206973268525e5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:16.641230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:16.643210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:16.660946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4f61-bddb-471d-af2e-d8b5e7655933 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:16.780203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:16.782875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:16.783158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:16.783433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] PATH_INFO: `/v3/projects/f69075c08b63492db02e7433b0ba0ad0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:16.784841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69075c08b63492db02e7433b0ba0ad0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:16.787357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:16.890650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69075c08b63492db02e7433b0ba0ad0', 'request_id': 'req-9136b059-4c4a-4bea-b153-04f3109e02c6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:16.900806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69075c08b63492db02e7433b0ba0ad0', 'request_id': 'req-9136b059-4c4a-4bea-b153-04f3109e02c6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:16.909102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69075c08b63492db02e7433b0ba0ad0', 'request_id': 'req-9136b059-4c4a-4bea-b153-04f3109e02c6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:16.953195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] The token cache is being invalidate because project f69075c08b63492db02e7433b0ba0ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:16.953535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:16.954617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9136b059-4c4a-4bea-b153-04f3109e02c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:16.960698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1689/3353] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:16 2021] DELETE /identity/v3/projects/f69075c08b63492db02e7433b0ba0ad0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:16.963489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:16.964285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:16.964748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:16.985369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:16.986919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:17.064826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.065362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.065983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.067427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1665/3354] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:17.090526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:17.091638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:17.107056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1690/3355] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:17.107301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.124917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77697-8f55-4111-ab29-3ec4dca22317 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.138141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.138833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.139113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.139383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.140127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:17.140644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.142394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.170260 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1666/3356] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:17.175200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.191306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509bd6-b149-4b9b-86f6-5ede8380650b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.199943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.200707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.200989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.201263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.201976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.203864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.248227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1691/3357] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:17 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:17.248834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.267244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd18d1d-c3c8-4995-aacb-c75a881ef4bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.393082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.394089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.395105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.398106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.399567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.402739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.461925 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1667/3358] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:17 2021] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:17.466029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.486921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff87c-8009-4023-8505-fb743bf772d7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.493792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.494499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.494761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.495046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.495916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.502945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.522628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.533387 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1692/3359] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:17 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:17.534408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbd27-32e6-4398-8c71-bf356984294a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.541164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.541613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.542587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.542865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.543607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.545320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93513727-89d4-4ed8-8232-5196c58eed72 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.572956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1668/3360] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:17 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:17.577539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.599733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c012-a3d4-4f87-9d6f-d12772a939c4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:17.606945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:17.608526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.608851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.609353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] PATH_INFO: `/v3/projects/acdf3415c6054dddbc536042e2d8babc/users/453056be5c384bb5aa8803f537fb4fda/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.638129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdf3415c6054dddbc536042e2d8babc, user_id=453056be5c384bb5aa8803f537fb4fda, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:17.641239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:17.704529 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1693/3361] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:17 2021] PUT /identity/v3/projects/acdf3415c6054dddbc536042e2d8babc/users/453056be5c384bb5aa8803f537fb4fda/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:17.719309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:17.719449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:17.719753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:17.766962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] MFA Rules not processed for user `453056be5c384bb5aa8803f537fb4fda`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:17.768560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:17.887983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:17.891869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1669/3362] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:17 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:18.023146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873b36-43c0-41da-902c-77a1814a187c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.029704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.030482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.031539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.032068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.033435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.036108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.082021 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1694/3363] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:17 2021] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:18.086073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.118512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f197c-1a1e-4d23-9d09-e4cca012cc73 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.247930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.249419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.249926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.250388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.251398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.255325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.288726 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1670/3364] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:18 2021] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:18.291473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.311299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978753-d86a-4621-aee1-b8ae6a45a6da admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.320367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.321436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.322313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.323019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.324093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.326842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.349911 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1695/3365] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:18 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:18.354234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.378073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e4f32-f416-4cd5-9d85-6ea0c6c5c55e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.385469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.387841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.388775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.389119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] PATH_INFO: `/v3/projects/07d1a81066e441bc95a56b8ee7746c43/users/502b8f10db9c4d84bb4010e214ae4542/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.405582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d1a81066e441bc95a56b8ee7746c43, user_id=502b8f10db9c4d84bb4010e214ae4542, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.408220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.425406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1671/3366] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:18 2021] PUT /identity/v3/projects/07d1a81066e441bc95a56b8ee7746c43/users/502b8f10db9c4d84bb4010e214ae4542/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:18.431994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.446593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.450797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466312d2-5059-4f1e-8320-edad805b1a28 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.451665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:18.534470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.536724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.537208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.537717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.538736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.540796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.545883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620b63-f0a4-4930-a1e0-73d443258b77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.550921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.552270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.552562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.552865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.554798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:18.597141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1696/3367] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:18 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:18.604382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:18.614414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.618000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bed5-f862-4597-ac7a-7bb084e6e995 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.645247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9855-7912-4e83-815c-9b66e19dbb50 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:18.658950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:18.662810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.663453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.664414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] PATH_INFO: `/v3/projects/07d1a81066e441bc95a56b8ee7746c43/users/502b8f10db9c4d84bb4010e214ae4542/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.668659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1672/3368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:18.671050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d1a81066e441bc95a56b8ee7746c43, user_id=502b8f10db9c4d84bb4010e214ae4542, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:18.677807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:18.723288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1697/3369] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:18 2021] PUT /identity/v3/projects/07d1a81066e441bc95a56b8ee7746c43/users/502b8f10db9c4d84bb4010e214ae4542/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:18.723417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:18.723580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:18.723855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:18.784519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] MFA Rules not processed for user `502b8f10db9c4d84bb4010e214ae4542`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:18.786955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:18.998941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1673/3370] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:18 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:19.000185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:19.020631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463aacf-ab52-4950-a550-4d5cd991fc2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:19.053781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:19.058701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.059098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.059259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.069509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:19.071959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:19.073798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:19.118711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1698/3371] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:19.123127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:19.140305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608be79-6bf4-4152-bbb6-3af4b2313941 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:19.151884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:19.155047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.155631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.156013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.157333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:19.159750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:19.206222 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1674/3372] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:19 2021] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:19.208024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:19.221554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da6465-2dfe-4616-8d63-8e841ee2a0d6 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:19.306775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:19.307513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.307769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.307996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.308773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:19.309084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:19.310674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e47bf0-113c-47e8-82be-948247d286f4 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:19.335751 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1699/3373] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:19.662954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:19.668864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:19.779669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4dddc-456b-460c-864f-476cba41c94d tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:19.788094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:19.788712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.789163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.789761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.799645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:19.803384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:19.818591 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1675/3374] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:19 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:19.840019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5b662-3b27-4a4b-96c9-460b550d0973 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.840570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5b662-3b27-4a4b-96c9-460b550d0973 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.841254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5b662-3b27-4a4b-96c9-460b550d0973 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.843055 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1700/3375] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:19.850914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:19.863906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:19.874337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2342c-ad6b-4ece-b8a7-2c18d82299b5 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:19.880515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:19.881634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:19.882108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:19.882526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:19.884084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:get_project(project_id=59dc69f71c2f49bc9ea7d5c9aff4c034)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:19.886527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:19.888874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1676/3376] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:19 2021] GET /identity/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:20.013232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088148-abd3-4f2b-918a-7fa30644043c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.013420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088148-abd3-4f2b-918a-7fa30644043c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.013697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088148-abd3-4f2b-918a-7fa30644043c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.015958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1701/3377] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:20.022014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:20.043061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:20.060599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac73924-3987-4f91-a672-193e89164519 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:20.077353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:20.078407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.078789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.079163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.085552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:get_project(project_id=59dc69f71c2f49bc9ea7d5c9aff4c034)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:20.087911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:20.091330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1677/3378] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:20 2021] GET /identity/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034 => generated 371 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:20.170283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2088148-abd3-4f2b-918a-7fa30644043c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:20.210765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2088148-abd3-4f2b-918a-7fa30644043c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:20.229106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:20.229940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.230320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.230735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.232692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:20.238523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:20.240515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:20.287742 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1702/3379] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:20.294040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:20.315003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088567b-793b-4709-9115-4ee6759bb2b9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:20.340967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:20.342458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.346638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.347353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.348284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:20.352408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d995-00b2-43d0-b9d5-749525df4ab8 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:20.390493 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1678/3380] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:20 2021] POST /identity/v3/users => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:20.395512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:20.428064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d3560-a969-4c8b-8d27-eb953652d333 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:20.464125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:20.465972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.466359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.469252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.471946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:20.474831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:20.477201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:20.529419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1703/3381] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:20.588792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5528-2721-4717-84b5-9907e3cfb1ba None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.589178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5528-2721-4717-84b5-9907e3cfb1ba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.589343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5528-2721-4717-84b5-9907e3cfb1ba None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.592308 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1679/3382] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:02:20.604207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:20.633335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:20.653867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc1ac-e84e-436d-bb3d-47745e70da91 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:20.663365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:20.664560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.665093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.665680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.668509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:get_project(project_id=59dc69f71c2f49bc9ea7d5c9aff4c034)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:20.672411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:20.689700 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1704/3383] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:20 2021] GET /identity/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:20.958288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4764-e79a-4f20-b4a4-a3e2f7f95b54 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:20.959151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4764-e79a-4f20-b4a4-a3e2f7f95b54 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:20.960428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4764-e79a-4f20-b4a4-a3e2f7f95b54 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:20.962816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1680/3384] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:20.968743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:20.989915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:21.001693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d2f-c1c3-4620-897d-d4dcb90114eb tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:21.008026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:21.008946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:21.009413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:21.009694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:21.011037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:get_project(project_id=59dc69f71c2f49bc9ea7d5c9aff4c034)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:21.013389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:21.020736 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1705/3385] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:20 2021] GET /identity/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034 => generated 371 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:21.065156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4764-e79a-4f20-b4a4-a3e2f7f95b54 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:21.102139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4764-e79a-4f20-b4a4-a3e2f7f95b54 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:21.125481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:21.128040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:21.129034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:21.132422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/users/d510e60d44af46ccb8051e409cd513e2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:21.194394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d510e60d44af46ccb8051e409cd513e2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:21.201170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:21.318918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd510e60d44af46ccb8051e409cd513e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.343975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd510e60d44af46ccb8051e409cd513e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.345290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd510e60d44af46ccb8051e409cd513e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.359201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd510e60d44af46ccb8051e409cd513e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.396067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e4bde10-6249-4b8e-aff4-3f0dad238d46 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd510e60d44af46ccb8051e409cd513e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.409421 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1681/3386] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:21 2021] DELETE /identity/v3/users/d510e60d44af46ccb8051e409cd513e2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:21.413757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:21.415695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:21.438446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e5de-d3eb-4767-9466-4e2c22ae37a9 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:21.545021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:21.545520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:21.545887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:21.623481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502b8f10db9c4d84bb4010e214ae4542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d1a81066e441bc95a56b8ee7746c43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:21.624597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:21.625211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:21.625821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] PATH_INFO: `/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:21.627823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59dc69f71c2f49bc9ea7d5c9aff4c034)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:21.630975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:21.635132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] MFA Rules not processed for user `c97777c543744f398530e24ae6ba3409`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:21.636418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:21.778550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59dc69f71c2f49bc9ea7d5c9aff4c034', 'request_id': 'req-f81c4045-73b6-42ff-97b5-d1bd990db094'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.799011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59dc69f71c2f49bc9ea7d5c9aff4c034', 'request_id': 'req-f81c4045-73b6-42ff-97b5-d1bd990db094'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.822296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59dc69f71c2f49bc9ea7d5c9aff4c034', 'request_id': 'req-f81c4045-73b6-42ff-97b5-d1bd990db094'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.826155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1682/3387] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:21 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:21.845694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:21.847997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:21.849530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] The token cache is being invalidate because project 59dc69f71c2f49bc9ea7d5c9aff4c034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:21.849908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.850529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:21.852840 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1706/3388] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:21 2021] DELETE /identity/v3/projects/59dc69f71c2f49bc9ea7d5c9aff4c034 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:21.857998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:21.862027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.033730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4045-73b6-42ff-97b5-d1bd990db094 tempest-QuotasAdminTestV257-1046344460 tempest-QuotasAdminTestV257-1046344460-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:22.048022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:22.051024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:22.051517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:22.053079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] PATH_INFO: `/v3/users/453056be5c384bb5aa8803f537fb4fda` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:22.054597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=453056be5c384bb5aa8803f537fb4fda)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:22.056078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516604dc-6e68-4a39-ad1c-4ab18c75d540 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:22.063395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:22.169288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453056be5c384bb5aa8803f537fb4fda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:22.181172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453056be5c384bb5aa8803f537fb4fda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:22.185062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453056be5c384bb5aa8803f537fb4fda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:22.186119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:22.186119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:22.186413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:22.187312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453056be5c384bb5aa8803f537fb4fda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:22.187441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:22.190327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.204602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5412fa23-05ce-4ead-9b5a-b4fe31281b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453056be5c384bb5aa8803f537fb4fda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:22.272917 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1707/3389] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:21 2021] DELETE /identity/v3/users/453056be5c384bb5aa8803f537fb4fda => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:22.277539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:22.277827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:22.278108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:22.342221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:22.344524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:22.345431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:22.346661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.356591 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1683/3390] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:21 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:22.497255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1708/3391] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:22.507102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:22.508762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.510496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:22.512544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.529447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4417b2-9176-4382-b16b-a68c899a9f40 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:22.656728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf2f9-ee06-4227-af89-7c21cfe61295 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:22.665881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:22.668535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:22.669602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:22.669989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:22.693561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:22.697378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:22.698106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:22.698892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:22.700191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:22.700476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:22.706819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:22.724872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1709/3392] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:22.730011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:22.731917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:22.749410 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1684/3393] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:23.318215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:23.320462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:23.348694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577024-f5ae-412e-959f-6aa186539317 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:23.380063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:23.381215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:23.382145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:23.389905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] PATH_INFO: `/v3/projects/acdf3415c6054dddbc536042e2d8babc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:23.393495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdf3415c6054dddbc536042e2d8babc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:23.405388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:23.516106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdf3415c6054dddbc536042e2d8babc', 'request_id': 'req-d59b8911-51b4-463a-865e-4429b0f0fd16'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.529043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdf3415c6054dddbc536042e2d8babc', 'request_id': 'req-d59b8911-51b4-463a-865e-4429b0f0fd16'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.544433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdf3415c6054dddbc536042e2d8babc', 'request_id': 'req-d59b8911-51b4-463a-865e-4429b0f0fd16'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.571002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] The token cache is being invalidate because project acdf3415c6054dddbc536042e2d8babc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:23.571647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.575673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.581170 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1710/3394] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:23 2021] DELETE /identity/v3/projects/acdf3415c6054dddbc536042e2d8babc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:23.582550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:23.601067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140d98-595a-4ae1-917d-0ceb0eddd627 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:23.706229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:23.707251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:23.707538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:23.707832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] PATH_INFO: `/v3/users/502b8f10db9c4d84bb4010e214ae4542` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:23.709591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502b8f10db9c4d84bb4010e214ae4542)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:23.712687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:23.807750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502b8f10db9c4d84bb4010e214ae4542'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.837794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502b8f10db9c4d84bb4010e214ae4542'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.838836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502b8f10db9c4d84bb4010e214ae4542'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.881514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502b8f10db9c4d84bb4010e214ae4542'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.898193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed9ebfef-517e-4732-a7d2-0df632efd011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502b8f10db9c4d84bb4010e214ae4542'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:23.907267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1685/3395] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:23 2021] DELETE /identity/v3/users/502b8f10db9c4d84bb4010e214ae4542 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:24.551089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:24.553069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:24.584527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8911-51b4-463a-865e-4429b0f0fd16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:24.781141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:24.782393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:24.782894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:24.783384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] PATH_INFO: `/v3/projects/07d1a81066e441bc95a56b8ee7746c43` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:24.785828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d1a81066e441bc95a56b8ee7746c43)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:24.788168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:24.869083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d1a81066e441bc95a56b8ee7746c43', 'request_id': 'req-9c2d556a-71cc-4156-8c9d-7d86e7486947'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:24.876274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d1a81066e441bc95a56b8ee7746c43', 'request_id': 'req-9c2d556a-71cc-4156-8c9d-7d86e7486947'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:24.890203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d1a81066e441bc95a56b8ee7746c43', 'request_id': 'req-9c2d556a-71cc-4156-8c9d-7d86e7486947'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:24.923883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] The token cache is being invalidate because project 07d1a81066e441bc95a56b8ee7746c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:24.924389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:24.925183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9c2d556a-71cc-4156-8c9d-7d86e7486947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:24.927889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1711/3396] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:24 2021] DELETE /identity/v3/projects/07d1a81066e441bc95a56b8ee7746c43 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:24.934824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:24.935344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:24.935655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:24.956750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:24.958454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.045456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1686/3397] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:25.052278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.054267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.054680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.095666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:25.097237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.135842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.136802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1712/3398] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:25.141342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.151433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.156953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1b557-da60-4818-8904-2f3f030c7f1e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.167423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.168722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.169242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.169751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] PATH_INFO: `/v3/users/f4d2b7c3dfeb4772b7cad1bf63c9d193` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.172510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d2b7c3dfeb4772b7cad1bf63c9d193)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.185501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.188124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc9018-10c3-4df1-9bce-759fb3de936b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.207036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.208050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.209136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.209615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.212129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:25.212692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.218818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.242178 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1713/3399] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:25.246622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.261864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d2b7c3dfeb4772b7cad1bf63c9d193'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:25.269485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d2b7c3dfeb4772b7cad1bf63c9d193'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:25.270334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d2b7c3dfeb4772b7cad1bf63c9d193'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:25.279730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103c2c-339a-4a82-b44b-bc8b75fd23f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.283959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d2b7c3dfeb4772b7cad1bf63c9d193'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:25.295109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.297052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.297472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.297958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.299926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.302728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94a9ab09-8e0d-4f8c-b826-4657b289e7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d2b7c3dfeb4772b7cad1bf63c9d193'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:25.306066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.320101 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1687/3400] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:25 2021] DELETE /identity/v3/users/f4d2b7c3dfeb4772b7cad1bf63c9d193 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:25.325152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.325739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.326172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.356375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:25.358391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.384556 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1714/3401] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:25.388711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.391747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.481672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1688/3402] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:25.505974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.508692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.524960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e041-45d2-4db3-a8d8-88d84c0f216b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.533683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.534425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.535248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.535526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.536260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.538779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.601888 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1715/3403] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:25.604448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.627108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aca0d6-0e29-4e00-8a4c-f8d84d7a3523 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.641960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.642916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.643358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.644177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.645305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.660728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.674659 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1716/3404] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:25 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:25.680074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.689144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c934-52e3-40f7-b552-ca7849de13c8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.695192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55aaae-4b3f-4e7a-ae19-88b931d7f215 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.702319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.703309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.703853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.704282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.705394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.707663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.724009 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1717/3405] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:25 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:25.725541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.738849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273da5-9694-484a-b798-4ff15f48586d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:25.745640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.746733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.747128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.747784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] PATH_INFO: `/v3/projects/71ea56897b9f4bbba4887bdf3f6948fe/users/1425015068994a7c93a716cce5408ddb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.766738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ea56897b9f4bbba4887bdf3f6948fe, user_id=1425015068994a7c93a716cce5408ddb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.769852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805e04d-f933-4a56-950a-7a1964f2d4da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.789757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1718/3406] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:25 2021] PUT /identity/v3/projects/71ea56897b9f4bbba4887bdf3f6948fe/users/1425015068994a7c93a716cce5408ddb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:25.791485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.791896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.792380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.810225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:25.813088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.813384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.816170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.837348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:25.838598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:25.840362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762d9e-0ea4-4903-b720-e8a3ef5efabd service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:25.841842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.853740 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1689/3407] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:25.855232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:25.855523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:25.855802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:25.911797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] MFA Rules not processed for user `1425015068994a7c93a716cce5408ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:25.912459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:25.931700 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1719/3408] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:25.947946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:25.949665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:26.040972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1690/3409] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:25 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:26.045115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:26.132759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d104d-9cc9-41b8-aaf2-421c5c3811cc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.149900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.182287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.182287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.182287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.204741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.207562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:26.228478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62a4c-7cba-4587-96e8-5b126e382eff None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.249456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.250473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.251076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.251551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.252472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.253737 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1720/3410] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:02:26.254953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:26.345624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1691/3411] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:26 2021] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:26.350002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:26.365597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6613-e1d6-4535-9b73-a22bb94a1d91 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.550199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.550904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.551180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.551457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.553757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.557325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:26.609451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:26.615299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1721/3412] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:26 2021] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:26.622432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a3e9-6619-496a-a19a-4ef0b17614f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.631420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.632206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.632777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.633316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.634333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.636249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:26.656491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:26.657385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1692/3413] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:26 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:26.672623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c43c8-9764-4441-90da-931a2426d572 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.679656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.681260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.681716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.682161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] PATH_INFO: `/v3/projects/e831456d8de44493b3dda3d8b5cb546a/users/3f3d94ff9fa14243b022721d1ea8ec35/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.703852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e831456d8de44493b3dda3d8b5cb546a, user_id=3f3d94ff9fa14243b022721d1ea8ec35, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.707353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:26.734859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1722/3414] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:26 2021] PUT /identity/v3/projects/e831456d8de44493b3dda3d8b5cb546a/users/3f3d94ff9fa14243b022721d1ea8ec35/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:26.739603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:26.756867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bfa39-f02d-4924-b2f7-26535981ca72 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:26.968696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:26.969340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:26.969625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:26.969898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:26.970652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:26.976643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc2ef-aa2d-4c9e-845f-bbde2f1a32fe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:27.006931 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1693/3415] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:26 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:27.010975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:27.030972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec6562-834e-426e-8b56-611d08e60adf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:27.037989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:27.039484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.040007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.041272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] PATH_INFO: `/v3/projects/e831456d8de44493b3dda3d8b5cb546a/users/3f3d94ff9fa14243b022721d1ea8ec35/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.043870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e831456d8de44493b3dda3d8b5cb546a, user_id=3f3d94ff9fa14243b022721d1ea8ec35, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:27.047165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7c70-2e2f-4b69-87be-c2482e74e2e7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:27.071257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1723/3416] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:27 2021] PUT /identity/v3/projects/e831456d8de44493b3dda3d8b5cb546a/users/3f3d94ff9fa14243b022721d1ea8ec35/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:27.074507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.074971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.075055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.108253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] MFA Rules not processed for user `3f3d94ff9fa14243b022721d1ea8ec35`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:27.110030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.256351 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1694/3417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:27 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:27.267810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db39c7-0219-43a6-a862-755c50b7f0e2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.268130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db39c7-0219-43a6-a862-755c50b7f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.268355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db39c7-0219-43a6-a862-755c50b7f0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.346172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-17db39c7-0219-43a6-a862-755c50b7f0e2 None None] MFA Rules not processed for user `1425015068994a7c93a716cce5408ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:27.348114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-17db39c7-0219-43a6-a862-755c50b7f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.460871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:27.463178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.503473 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1724/3418] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:27.564027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9db42-4e73-4d67-8e24-68a50065b58e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:27.570535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:27.572094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.572584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.573222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] PATH_INFO: `/v3/projects/277c38a86cf147b4975c1a6e3cd149ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.574958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277c38a86cf147b4975c1a6e3cd149ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:27.579802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:27.671498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277c38a86cf147b4975c1a6e3cd149ba', 'request_id': 'req-05ed31a5-150f-4d40-8798-e8a7e7556be7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:27.688505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277c38a86cf147b4975c1a6e3cd149ba', 'request_id': 'req-05ed31a5-150f-4d40-8798-e8a7e7556be7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:27.705194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277c38a86cf147b4975c1a6e3cd149ba', 'request_id': 'req-05ed31a5-150f-4d40-8798-e8a7e7556be7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:27.727141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.729338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.729860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.734744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] The token cache is being invalidate because project 277c38a86cf147b4975c1a6e3cd149ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:27.735037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:27.736831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05ed31a5-150f-4d40-8798-e8a7e7556be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:27.744056 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1695/3419] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:27 2021] DELETE /identity/v3/projects/277c38a86cf147b4975c1a6e3cd149ba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:27.750721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f7ea-088c-4c3b-b67d-b2df0a9e3015 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.751173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f7ea-088c-4c3b-b67d-b2df0a9e3015 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.751601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f7ea-088c-4c3b-b67d-b2df0a9e3015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.772394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:27.774140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.778930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a5d5f7ea-088c-4c3b-b67d-b2df0a9e3015 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:27.783155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5d5f7ea-088c-4c3b-b67d-b2df0a9e3015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.881528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1696/3420] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:27.886146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.886434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.886702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.906290 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1725/3421] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:27.927990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:27.928859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:27.929465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.930056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:27.939157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1697/3422] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:27.943437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:27.953497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510d8c-0c0b-4bea-8425-af927f182ca3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:27.967560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:27.969660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:27.970287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:27.971164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:27.973119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:27.973958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:27.976880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.006483 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1698/3423] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:28.009878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.032496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e90e9-3bc9-4d1b-bc9e-7e22c66b5723 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.038098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc824a28-6e81-45e8-8d85-65ac9f4d1f14 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.042669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.043697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.043697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.045350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.048389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.051023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.052391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.052699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.052971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.053758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.065630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.069538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.086202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1726/3424] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:02:28.097152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1699/3425] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:28 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:28.101764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.125621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dea73-f78c-4b4e-9fd7-dcef1dae9ce2 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.223139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.223884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.224264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.224444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.225736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.227822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.274396 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1727/3426] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:28 2021] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:28.276137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.293047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28dcbb-7cda-43b7-a365-b4b9517413bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.308982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.310279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.311504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.311954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.313246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.315173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.347375 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1700/3427] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:28 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:28.351305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.380240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4419adf-b6e2-448c-8b6a-bb49716aec67 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.386446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.387607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.388119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.388754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.390574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.393571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693bdb2-047b-412e-ba21-f83097ff6f20 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.410525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1728/3428] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:28 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:28.411869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.423382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e4b3-9253-4271-b1fe-048d6a954763 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.429679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.431031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.431549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.432034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] PATH_INFO: `/v3/projects/0124e7aa8618410fa96cddd231b8f3a0/users/9bcf429e640541b4843028148c058bc6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.449343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0124e7aa8618410fa96cddd231b8f3a0, user_id=9bcf429e640541b4843028148c058bc6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.453168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.478959 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1701/3429] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:28 2021] PUT /identity/v3/projects/0124e7aa8618410fa96cddd231b8f3a0/users/9bcf429e640541b4843028148c058bc6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:28.491232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.492092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.492602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.526162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] MFA Rules not processed for user `9bcf429e640541b4843028148c058bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:28.527298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:28.630794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.633936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:28.701831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1729/3430] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:28 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:28.705134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.708782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:28.777523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e914-2e2c-4987-9e39-43128aa85545 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.778557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150750-0f30-4695-909a-351adbe2e245 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.782340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.783440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.783440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.783744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.785788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:28.789711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.790381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.790662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.790934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.796291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:28.799511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.801648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.813873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1730/3431] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:28.814712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.893100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad1e3-195e-4a73-8abd-87afadcd0783 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:28.899821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:28.900501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:28.900812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:28.901088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:28.901956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.904408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.942716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1731/3432] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:28 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:28.944368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:28.953779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:28.955816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:28.966019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1702/3433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:28 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:29.033995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f085c-f962-4c4d-89a5-002a9b304ceb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.042627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.044027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.044531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.045336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.046237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.048305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.083740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:29.088983 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1732/3434] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:28 2021] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:29.111333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444bb9f-4fc4-4690-a2a8-ffa9179cb9ee service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.120001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.120974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.121642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.122081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.123172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.124830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387f771-09d3-4239-b180-e1082bd7ae78 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.140865 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1703/3435] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:29 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:29.141935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:29.153875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea56e69-2ed8-4cab-8d6d-3c2059de1b01 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.160429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.161775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.161898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.162086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] PATH_INFO: `/v3/projects/56feb1c83edf43968ea45ec5dd137c3e/users/dfe1f317b22f4d4db47e9913e1cb72c2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.182456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56feb1c83edf43968ea45ec5dd137c3e, user_id=dfe1f317b22f4d4db47e9913e1cb72c2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.185677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f1050-53fe-4935-8995-65705a77ada4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.220465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.220775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.221252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.222780 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1733/3436] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:29 2021] PUT /identity/v3/projects/56feb1c83edf43968ea45ec5dd137c3e/users/dfe1f317b22f4d4db47e9913e1cb72c2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:29.255352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] MFA Rules not processed for user `dfe1f317b22f4d4db47e9913e1cb72c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:29.256951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:29.471208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.471392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.471668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.515896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] MFA Rules not processed for user `1425015068994a7c93a716cce5408ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:29.517386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:29.554732 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1704/3437] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:29 2021] POST /identity/v3/auth/tokens => generated 3259 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:29.557797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:29.559923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:29.649244 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1734/3438] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:29.649244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:29.681677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871709-30e6-4358-b9ef-b0ddc7f48ca4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.687460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.688108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.688599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.688900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.691072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:29.703561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.705648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd91e-738f-46f3-8c1c-d9b518b08996 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.720420 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1705/3439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:29.722788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.723321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.723820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.750436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb914bd9-22c4-4792-8b11-475339fd38dd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.751188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:29.752633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:29.758559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.759295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.759567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.759842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.771910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.773905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.785445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1735/3440] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:29.866206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1706/3441] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:29.882760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:29.900085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d898-63d4-4d45-8414-b28fbd01335f service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:29.921498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:29.922176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:29.922456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:29.922730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:29.940440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:29.963926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94245-b4f8-4bef-8955-098627f4db85 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:29.975597 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1736/3442] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:30.983520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:31.116731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b64c4-a78f-4b4e-a456-a11ed6c6ad29 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:31.129427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:31.131146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:31.131591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:31.132431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] PATH_INFO: `/v3/users/9bcf429e640541b4843028148c058bc6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:31.135389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcf429e640541b4843028148c058bc6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:31.138338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:31.218939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcf429e640541b4843028148c058bc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:31.230150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcf429e640541b4843028148c058bc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:31.231354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcf429e640541b4843028148c058bc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:31.248372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcf429e640541b4843028148c058bc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:31.259898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcf429e640541b4843028148c058bc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:31.271069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1707/3443] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:30 2021] DELETE /identity/v3/users/9bcf429e640541b4843028148c058bc6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:31.275734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:31.276668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:31.277126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:31.296514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:31.298088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:31.384903 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1737/3444] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:31.446525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:31.448275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:31.525147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f55fc-4d4c-40cc-a84c-8f784396ed0a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:31.530640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:31.531424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:31.532060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:31.532757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:31.546382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:31.547853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:31.559498 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1708/3445] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:32.169719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:32.182631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68965f-13fd-4df4-b327-92074c4d68d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:32.191879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:32.193201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:32.193577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:32.194085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:32.200081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:32.210126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:32.224033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2954f5-a09e-4625-8288-1bd352e0308a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:32.232116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:32.232877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:32.233139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:32.233408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:32.238619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:32.375771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:32.376854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:32.377870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:32.385015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:32.399456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1709/3446] 10.222.0.13 () {60 vars in 1396 bytes} [Wed Nov 10 04:02:32 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:32.417510 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1738/3447] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:32 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:32.426501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:32.428183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:32.457257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbcfe-b9f9-4aea-ae0d-6f18a0bd2da6 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:32.469681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:32.470995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:32.471473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:32.472466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] PATH_INFO: `/v3/projects/0124e7aa8618410fa96cddd231b8f3a0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:32.489376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0124e7aa8618410fa96cddd231b8f3a0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:32.499872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:32.593553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0124e7aa8618410fa96cddd231b8f3a0', 'request_id': 'req-62e3d84f-0a5b-4a89-9d2b-31926a817594'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.603097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0124e7aa8618410fa96cddd231b8f3a0', 'request_id': 'req-62e3d84f-0a5b-4a89-9d2b-31926a817594'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.618028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0124e7aa8618410fa96cddd231b8f3a0', 'request_id': 'req-62e3d84f-0a5b-4a89-9d2b-31926a817594'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.636281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] The token cache is being invalidate because project 0124e7aa8618410fa96cddd231b8f3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:32.636520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.637958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.640794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1710/3448] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:32 2021] DELETE /identity/v3/projects/0124e7aa8618410fa96cddd231b8f3a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:32.644564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:32.661541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eb16d-7577-46d0-a40f-a32cead7ecd8 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:32.764747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:32.764986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:32.765338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:32.765624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] PATH_INFO: `/v3/users/dfe1f317b22f4d4db47e9913e1cb72c2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:32.773050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe1f317b22f4d4db47e9913e1cb72c2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:32.774997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:32.872926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe1f317b22f4d4db47e9913e1cb72c2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.883144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe1f317b22f4d4db47e9913e1cb72c2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.884095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe1f317b22f4d4db47e9913e1cb72c2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.884883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe1f317b22f4d4db47e9913e1cb72c2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.898088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-350e0579-4ca4-4af9-9e20-ae896d28199f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe1f317b22f4d4db47e9913e1cb72c2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:32.927931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1739/3449] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:32 2021] DELETE /identity/v3/users/dfe1f317b22f4d4db47e9913e1cb72c2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:33.934049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:33.935591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:33.958723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d84f-0a5b-4a89-9d2b-31926a817594 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.056486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.057564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.057751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.058131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] PATH_INFO: `/v3/projects/56feb1c83edf43968ea45ec5dd137c3e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.059531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56feb1c83edf43968ea45ec5dd137c3e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.062318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.127522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56feb1c83edf43968ea45ec5dd137c3e', 'request_id': 'req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:34.135218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56feb1c83edf43968ea45ec5dd137c3e', 'request_id': 'req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:34.145959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56feb1c83edf43968ea45ec5dd137c3e', 'request_id': 'req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:34.170231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] The token cache is being invalidate because project 56feb1c83edf43968ea45ec5dd137c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:34.170615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:34.171839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c8a5645-6bbd-41f1-a608-83b1b219c7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:34.180329 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1711/3450] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:33 2021] DELETE /identity/v3/projects/56feb1c83edf43968ea45ec5dd137c3e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:34.182189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.182652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.182652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.208902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:34.210459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:34.408057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1740/3451] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:34.420540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.421071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.421356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.458619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:34.462926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:34.486170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1712/3452] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:34.490250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.502330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a4320-19ef-410e-a730-8059ac448dbf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.516014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.517736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.518409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.519653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.521339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:34.522969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.527215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.560750 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1741/3453] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:34.564540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.575812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4f10-2d71-486b-abd9-f0dfc8c679e1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.580790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.582216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.582494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.582768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.583494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.585791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.603168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.605721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:34.647263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1713/3454] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:34 2021] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:34.656552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.734612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0441c-b7cb-4779-a2b7-8ce566e5b155 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.784266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff398e3-1a93-4b93-a581-56f28624ecea admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.790300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.791317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.791556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.792098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.793042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.796542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.843241 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1714/3455] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:34 2021] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:34.845357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.857561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637f1f-f5bb-48f3-b734-70c590e6e834 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.858600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.859090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.859377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.859673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.866370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.867183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.867568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.867849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.868916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.869479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:34.872635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.888000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.889460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.901714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1715/3456] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:34 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:34.902916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.904258 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1742/3457] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:34.924450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac369a3-aaa9-49e6-b81b-f87e10fa5559 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.935150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.937748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.938574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.939455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:34.941906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:34.945117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ece5e-f936-44e4-b892-39258304bd66 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:34.965757 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1716/3458] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:34 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:34.966999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:34.981166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d23ac-4c8f-44d4-9f50-0196be7b25be service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:34.991047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:34.992357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:34.992903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:34.993389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] PATH_INFO: `/v3/projects/7655217687404358b22f9cce643f889b/users/3d562b95e9754d9ab609f55149264a1f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:35.218897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7655217687404358b22f9cce643f889b, user_id=3d562b95e9754d9ab609f55149264a1f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:35.223451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:35.259814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:35.260819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:35.261528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:35.264864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1743/3459] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:34 2021] PUT /identity/v3/projects/7655217687404358b22f9cce643f889b/users/3d562b95e9754d9ab609f55149264a1f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:35.287930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:35.290498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:35.399179 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1717/3460] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:35.457820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:35.463121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:35.597775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1e54-c546-416e-a55a-f962b2b235b9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:35.607360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:35.608030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:35.608311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:35.608573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:35.629773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:35.631443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:35.644994 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1744/3461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:36.146271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:36.148122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:36.164266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19517b1-572f-4706-91d8-73b9517dd07f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:36.191115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:36.191992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:36.197333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:36.197832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] PATH_INFO: `/v3/users/ebb77877fd9f4a398e15837f80b60bf3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:36.200844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb77877fd9f4a398e15837f80b60bf3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:36.202758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:36.330041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb77877fd9f4a398e15837f80b60bf3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:36.339773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb77877fd9f4a398e15837f80b60bf3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:36.341227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb77877fd9f4a398e15837f80b60bf3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:36.361446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb77877fd9f4a398e15837f80b60bf3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:36.378941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb77877fd9f4a398e15837f80b60bf3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:36.402659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1718/3462] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:36 2021] DELETE /identity/v3/users/ebb77877fd9f4a398e15837f80b60bf3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:36.420627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:36.422022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:36.541259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb5780-4486-4320-b7b2-53ea03d4bf47 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:36.699981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:36.700740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:36.701019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:36.710405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:36.712544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:36.741977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:36.745588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:36.771843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1745/3463] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:37.204252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:37.206125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:37.332202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ab6c8-18ef-4c67-9cc3-caa63b20b92a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:37.338022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:37.339208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:37.339640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:37.340086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] PATH_INFO: `/v3/projects/b8d7111030614ab994cb28cfe82f66df` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:37.341835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d7111030614ab994cb28cfe82f66df)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:37.344096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:37.435002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d7111030614ab994cb28cfe82f66df', 'request_id': 'req-3e46f960-c14f-41f1-bfea-eea50401a35f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.448950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d7111030614ab994cb28cfe82f66df', 'request_id': 'req-3e46f960-c14f-41f1-bfea-eea50401a35f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.468545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d7111030614ab994cb28cfe82f66df', 'request_id': 'req-3e46f960-c14f-41f1-bfea-eea50401a35f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.523799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] The token cache is being invalidate because project b8d7111030614ab994cb28cfe82f66df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:37.525942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.528026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e46f960-c14f-41f1-bfea-eea50401a35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.532210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1719/3464] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:37 2021] DELETE /identity/v3/projects/b8d7111030614ab994cb28cfe82f66df => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:37.536537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:37.555029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2915-1c51-4d86-81b9-49551ec6f0b3 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:37.662590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:37.664054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:37.664568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:37.665052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] PATH_INFO: `/v3/users/48c93cb93c354ac390a3d31c2f8df61f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:37.666675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c93cb93c354ac390a3d31c2f8df61f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:37.669669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:37.736960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c93cb93c354ac390a3d31c2f8df61f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.747145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c93cb93c354ac390a3d31c2f8df61f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.748161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c93cb93c354ac390a3d31c2f8df61f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.748967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c93cb93c354ac390a3d31c2f8df61f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.772588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c93cb93c354ac390a3d31c2f8df61f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:37.813895 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1746/3465] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:37 2021] DELETE /identity/v3/users/48c93cb93c354ac390a3d31c2f8df61f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:38.096501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.097363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.097637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.144448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] MFA Rules not processed for user `3d562b95e9754d9ab609f55149264a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:38.145731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.238385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1720/3466] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:38.243194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.245888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.393431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.395913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.442876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff921cbd-fe41-47d7-8ebb-1003731ea752 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.461125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.463400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.463400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.463400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.463400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.465309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.532708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1747/3467] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:38.533720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.540030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aa62d-5247-4a86-9979-105d18195d11 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.640337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.641759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.642271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.642766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] PATH_INFO: `/v3/projects/048bb58bfab9450d97da70ab258ed111` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.645059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=048bb58bfab9450d97da70ab258ed111)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.647728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.665842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29d400-03ea-4eb7-b07a-28c533e6c953 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.678585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.679269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.679543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.679809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.680525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.682446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.714108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048bb58bfab9450d97da70ab258ed111', 'request_id': 'req-8c2267f1-339f-4d02-b2c9-e22ca944d46d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:38.721403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048bb58bfab9450d97da70ab258ed111', 'request_id': 'req-8c2267f1-339f-4d02-b2c9-e22ca944d46d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:38.728893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048bb58bfab9450d97da70ab258ed111', 'request_id': 'req-8c2267f1-339f-4d02-b2c9-e22ca944d46d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:38.735633 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1748/3468] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:38.740148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.748845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] The token cache is being invalidate because project 048bb58bfab9450d97da70ab258ed111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:38.749528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:38.751041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8c2267f1-339f-4d02-b2c9-e22ca944d46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:38.754356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1721/3469] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:38 2021] DELETE /identity/v3/projects/048bb58bfab9450d97da70ab258ed111 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:38.756892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3619b-4426-4412-b7af-64993c68dd63 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.761170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcd59-8563-452d-8e2d-9d02cd516861 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.761857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcd59-8563-452d-8e2d-9d02cd516861 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.762347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcd59-8563-452d-8e2d-9d02cd516861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.790968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-90dbcd59-8563-452d-8e2d-9d02cd516861 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:38.793040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-90dbcd59-8563-452d-8e2d-9d02cd516861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.833884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.834703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.835524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.835524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.836522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.838463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.851001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1749/3470] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:38 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:38.854748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.857551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.884433 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1722/3471] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:38.893617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2a2ae-f25c-42dc-8f33-4dd395a99f5d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.894720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.895150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.895564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.909670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.910576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.910854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.911135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] PATH_INFO: `/v3/projects/2976e91e76fb49708cea967d14664da1/users/be8dd8a65ab4483db5af785793b49f0e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.915500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:38.917673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:38.928124 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1723/3472] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:38.932429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.946224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2976e91e76fb49708cea967d14664da1, user_id=be8dd8a65ab4483db5af785793b49f0e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.948904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1f58e-7281-46a5-a9ac-c05bff5334c9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:38.949297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.955876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:38.956837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:38.957105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:38.957569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:38.958804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:38.959196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:38.961071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:38.972137 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1750/3473] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:38 2021] PUT /identity/v3/projects/2976e91e76fb49708cea967d14664da1/users/be8dd8a65ab4483db5af785793b49f0e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:38.976160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.980657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1724/3474] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:38.981992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:38.995632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bb479-7132-42c2-bfcb-9959472af833 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.090744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.091188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda71b23-d26c-47fc-b064-791b140e3edf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.092864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.093099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.093404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.094273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.096398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.098639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.099455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.099833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.100237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.101157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.103448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.121537 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1751/3475] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:38 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:39.122778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.136654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485bbef-2462-4e62-82a4-5f5cae3184f2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.142855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1725/3476] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:38 2021] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:39.144703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.240472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.241862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.242554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.242980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] PATH_INFO: `/v3/projects/2976e91e76fb49708cea967d14664da1/users/be8dd8a65ab4483db5af785793b49f0e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.245368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2976e91e76fb49708cea967d14664da1, user_id=be8dd8a65ab4483db5af785793b49f0e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.250006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.254973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146ec34-c724-4391-84e6-fcc35c6e74d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.262920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.263874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.264083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.264361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.265995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.268029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1752/3477] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:39 2021] PUT /identity/v3/projects/2976e91e76fb49708cea967d14664da1/users/be8dd8a65ab4483db5af785793b49f0e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:39.268165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.296669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1726/3478] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:39 2021] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:39.299594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.403545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db308235-336f-4095-9e43-8e0bd14872a5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.411620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.412715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.413015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.413319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.414066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.416664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.433262 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1753/3479] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:39 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:39.437568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.448077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fa4f5-e3af-4fc8-8c2a-7f38c4d4daa1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.454617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.455299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.455574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.457892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.458898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.460885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d5c5b-c540-4cdb-97d6-08ace1e29c20 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.477911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1727/3480] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:39 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:39.480441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.491864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc57b-aa94-4ee4-93e5-8b3492e0b8bb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.496695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.498194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.498535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.499017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] PATH_INFO: `/v3/projects/24846d6a7631416ab7f223d3e21fa74c/users/6a9c27a569994ef3a164d80d95618620/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.537451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24846d6a7631416ab7f223d3e21fa74c, user_id=6a9c27a569994ef3a164d80d95618620, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.541075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.564370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1754/3481] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:39 2021] PUT /identity/v3/projects/24846d6a7631416ab7f223d3e21fa74c/users/6a9c27a569994ef3a164d80d95618620/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:39.575806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.576303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.576733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.617973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] MFA Rules not processed for user `6a9c27a569994ef3a164d80d95618620`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:39.620542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:39.741896 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1728/3482] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:39.746641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.855502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517632a-a39c-4183-93a1-7d47bf0dbb32 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:39.864189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:39.865046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:39.865909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:39.865909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:39.866789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:39.869049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:39.911596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1755/3483] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:39 2021] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:39.916257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:39.929922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6120ec-583d-4e6b-b8e2-0080a29bd408 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.022036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.022826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.023111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.023482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.026009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.028683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.093587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1729/3484] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:39 2021] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:40.094849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.113387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0b3f-a36b-4c2d-93bd-7923bc266e1c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.126076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.126785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.127059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.127344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.128663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.130649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.156779 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1756/3485] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:40 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:40.158012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.173642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf831e-d6b3-452f-9405-767f95cdc310 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.198284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.201794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.203084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.203688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] PATH_INFO: `/v3/projects/0d55a5bad719447bbf097a3a786aa208/users/1e64c23c16d54f07bd872e4a44d29edb/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.237030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d55a5bad719447bbf097a3a786aa208, user_id=1e64c23c16d54f07bd872e4a44d29edb, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.244519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.280385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.280602 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1730/3486] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:40 2021] PUT /identity/v3/projects/0d55a5bad719447bbf097a3a786aa208/users/1e64c23c16d54f07bd872e4a44d29edb/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:40.297441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59df77-02f5-4c59-b51a-62db2cae2950 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.369440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.371777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:40.502104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.502715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.503591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.503936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.504586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.506175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.516167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf68d9-6626-4009-8e8d-c9f94be41c0b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.526609 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1757/3487] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:40 2021] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:40.531233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.533118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.534739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.535173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.535915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] PATH_INFO: `/v3/users/25402f2151994aaa812407c629812b2c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.538570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25402f2151994aaa812407c629812b2c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.540653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.561019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fccec1-d3b3-49ff-afd1-9b28933c646c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:40.570077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:40.570980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.571274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.571509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] PATH_INFO: `/v3/projects/0d55a5bad719447bbf097a3a786aa208/users/1e64c23c16d54f07bd872e4a44d29edb/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.576594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d55a5bad719447bbf097a3a786aa208, user_id=1e64c23c16d54f07bd872e4a44d29edb, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:40.579444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aa14e-c184-4c2e-8562-6819cf6454ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:40.605834 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1758/3488] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:40 2021] PUT /identity/v3/projects/0d55a5bad719447bbf097a3a786aa208/users/1e64c23c16d54f07bd872e4a44d29edb/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:40.618967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.619581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.620010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.636825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25402f2151994aaa812407c629812b2c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:40.647570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25402f2151994aaa812407c629812b2c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:40.649028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25402f2151994aaa812407c629812b2c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:40.649944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] MFA Rules not processed for user `1e64c23c16d54f07bd872e4a44d29edb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:40.651418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:40.691623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25402f2151994aaa812407c629812b2c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:40.705835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cd98b63-8fab-4b38-963a-f1f7c9a5e22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25402f2151994aaa812407c629812b2c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:40.719050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1731/3489] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:40 2021] DELETE /identity/v3/users/25402f2151994aaa812407c629812b2c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:40.727307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:40.729363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:40.729840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:40.753464 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1759/3490] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:40 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:40.768474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:40.770052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:40.859856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.861411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:40.902127 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1732/3491] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:40.923944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:40.927508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:41.006418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576f68-f7e2-4b11-adbf-02489e57caad None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:41.090560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779168-56bd-4f9c-beab-63185c8a44d7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:41.106060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:41.106846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:41.107083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:41.107351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:41.129294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:41.130870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:41.164646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1733/3492] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:41.194956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:41.195858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:41.196297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:41.197490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:41.199902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:41.218356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:41.220344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:41.256845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1760/3493] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:41.280973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:41.282876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:41.320357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f24b0-8929-444b-ad13-9eb55d36a25a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:41.336950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:41.337752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:41.338027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:41.338493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:41.479041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:41.480670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab5c7e-fca3-4c2d-b27d-3de908ed43de service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:41.512631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1734/3494] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:41 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:41.749084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:41.751309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:41.779866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c6e-5c2c-4d0d-b711-e556e2947a49 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:41.797944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:41.806977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:41.807410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:41.807788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] PATH_INFO: `/v3/projects/a17b8439aab5416baf5623b3adedbb8c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:41.812975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17b8439aab5416baf5623b3adedbb8c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:41.820321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:41.920880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:41.921427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:41.921921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:41.924359 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1735/3495] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:41.931717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:41.949841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17b8439aab5416baf5623b3adedbb8c', 'request_id': 'req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:41.961288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17b8439aab5416baf5623b3adedbb8c', 'request_id': 'req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:41.977729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17b8439aab5416baf5623b3adedbb8c', 'request_id': 'req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.007415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] The token cache is being invalidate because project a17b8439aab5416baf5623b3adedbb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:42.009042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.010975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.015832 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1761/3496] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:41 2021] DELETE /identity/v3/projects/a17b8439aab5416baf5623b3adedbb8c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:42.020044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:42.022152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.036396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:42.131023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f65739-743e-4949-86b6-1076e9ea9a1e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:42.136969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e64c23c16d54f07bd872e4a44d29edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d55a5bad719447bbf097a3a786aa208', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:42.138042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.138386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.138870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] PATH_INFO: `/v3/projects/24846d6a7631416ab7f223d3e21fa74c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.140522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: Authorizing `identity:get_project(project_id=24846d6a7631416ab7f223d3e21fa74c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:42.142380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:42.145783 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1736/3497] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:41 2021] GET /identity/v3/projects/24846d6a7631416ab7f223d3e21fa74c => generated 377 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:42.156784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54518-8b8d-432c-83d0-d9a4d5f1b05a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:42.162336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:42.163504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.163884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.164352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] PATH_INFO: `/v3/users/fc5365fa60df4c64b8137280228d7b99` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.165806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5365fa60df4c64b8137280228d7b99)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:42.167842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:42.241100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5365fa60df4c64b8137280228d7b99'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.250875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5365fa60df4c64b8137280228d7b99'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.252016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5365fa60df4c64b8137280228d7b99'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.254113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5365fa60df4c64b8137280228d7b99'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.270544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5365fa60df4c64b8137280228d7b99'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.273136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:42.275839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.293872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1762/3498] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:42 2021] DELETE /identity/v3/users/fc5365fa60df4c64b8137280228d7b99 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:42.311006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2987a-7ec9-49fb-81f6-cc190ae76384 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:42.404953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:42.405769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.406278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.406702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.409189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.501040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:42.503305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a6ff9-5e09-4951-9c1a-5956da5ba8a6 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:42.517407 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1737/3499] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:42 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:42.556718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:42.558443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.573997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9b9b-d09c-4ba3-9c27-30965a577ac0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.574277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9b9b-d09c-4ba3-9c27-30965a577ac0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.574845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9b9b-d09c-4ba3-9c27-30965a577ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.604057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-339d9b9b-d09c-4ba3-9c27-30965a577ac0 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:42.605675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-339d9b9b-d09c-4ba3-9c27-30965a577ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.689084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f808ac-d0bf-47dc-b064-653a3177e3eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:42.696401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:42.697928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.698213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.698621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] PATH_INFO: `/v3/projects/c825532346c84fa890836f19a09533c0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.700545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c825532346c84fa890836f19a09533c0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:42.702417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:42.718405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1738/3500] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:42.720654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae7-5e08-497e-bf27-9098f2e5c6c7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.721234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae7-5e08-497e-bf27-9098f2e5c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.721386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae7-5e08-497e-bf27-9098f2e5c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.785643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0b46fae7-5e08-497e-bf27-9098f2e5c6c7 None None] MFA Rules not processed for user `be8dd8a65ab4483db5af785793b49f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:42.788560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b46fae7-5e08-497e-bf27-9098f2e5c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.837216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c825532346c84fa890836f19a09533c0', 'request_id': 'req-3648477c-0708-4c4a-afa8-35a42e23c673'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.845134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c825532346c84fa890836f19a09533c0', 'request_id': 'req-3648477c-0708-4c4a-afa8-35a42e23c673'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.854921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c825532346c84fa890836f19a09533c0', 'request_id': 'req-3648477c-0708-4c4a-afa8-35a42e23c673'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.872517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] The token cache is being invalidate because project c825532346c84fa890836f19a09533c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:42.872860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.873963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:42.880201 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1763/3501] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:42 2021] DELETE /identity/v3/projects/c825532346c84fa890836f19a09533c0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:42.880201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:42.880201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.924016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1739/3502] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:42 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:42.924016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a66d7-3070-4023-a6e8-ec1f0a0ec33f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.924016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a66d7-3070-4023-a6e8-ec1f0a0ec33f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.924016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a66d7-3070-4023-a6e8-ec1f0a0ec33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:42.944952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-235a66d7-3070-4023-a6e8-ec1f0a0ec33f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:42.947170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-235a66d7-3070-4023-a6e8-ec1f0a0ec33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:42.980705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648477c-0708-4c4a-afa8-35a42e23c673 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:42.996673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:42.997579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:42.997928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:42.998278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.000412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.028190 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1740/3503] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:43.031979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.032505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.033164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.061572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] MFA Rules not processed for user `3d562b95e9754d9ab609f55149264a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:43.063026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.067683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.069712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3262-f821-488c-8675-cdf1c947e697 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.084006 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1764/3504] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:43.086199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.086199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.086533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.111710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:43.113723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.127501 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1765/3505] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:43.132499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.148376 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1741/3506] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:43.150848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552230c-0c43-4a02-a292-9f23c9c7eb0f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.162892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.165208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.166238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.168088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.169113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:43.170829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.173872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a4518-0743-4924-a800-f2789970639c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.202366 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1766/3507] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:43.207569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.228158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d806802-ac89-4559-b7b9-14d779bcbd68 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.234492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.235476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.235740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.236284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.237474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.240118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.276160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.276812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.277257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.280933 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1767/3508] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:02:43.286965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:43.289755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.307468 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1742/3509] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:43.310602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.392749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474e3d-ea22-4889-a8da-92b14088d03c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.402007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.402910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.403254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.403595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.403728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.404951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.405617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.408090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.442009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1743/3510] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:43.447155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.463969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf037ee-aec4-47c7-b589-e744ac6933b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.470747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.471473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.472265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.472536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.473569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.475207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.484189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78411b-5221-47e5-80e8-bb3711b16e28 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.488171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1744/3511] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:43.493107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.505933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b8af-179b-480b-9642-4bd963bc508c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.512153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.513628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.514406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.514899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.515854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.518937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.536688 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1745/3512] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:43 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:43.542309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.557420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc44e0-c2b7-4281-9b1f-7fe7c29bfdee admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.567718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.569104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.569611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.570065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] PATH_INFO: `/v3/projects/77ac14079ae140f4bfde976dcdd04686/users/4333bc0463b24e389cf77f1bd1933e73/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.596251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e64c23c16d54f07bd872e4a44d29edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d55a5bad719447bbf097a3a786aa208', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.597178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.597458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.598239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] PATH_INFO: `/v3/projects/24846d6a7631416ab7f223d3e21fa74c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.599652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: Authorizing `identity:get_project(project_id=24846d6a7631416ab7f223d3e21fa74c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.601108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ac14079ae140f4bfde976dcdd04686, user_id=4333bc0463b24e389cf77f1bd1933e73, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.603478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442003b0-a522-4112-8fc7-b183b12a22d3 tempest-FlavorsAccessTestJSON-1822324743 tempest-FlavorsAccessTestJSON-1822324743-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.605994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.610583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1768/3513] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:43 2021] GET /identity/v3/projects/24846d6a7631416ab7f223d3e21fa74c => generated 377 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:43.630864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1746/3514] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:43 2021] PUT /identity/v3/projects/77ac14079ae140f4bfde976dcdd04686/users/4333bc0463b24e389cf77f1bd1933e73/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:43.641507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.641507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.641889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.702787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] MFA Rules not processed for user `4333bc0463b24e389cf77f1bd1933e73`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:43.704414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:43.800479 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1769/3515] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:43.800696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.916988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eaa3f-d935-4f23-948d-c8ce66d67ea9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:43.925196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:43.926253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:43.926667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:43.927149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:43.928299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:43.931120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:43.968822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1747/3516] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:43.969873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:43.982189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba76c-3516-4749-90a0-e291913dc4ef None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.004021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.070392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.070930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.071276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.071643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.072884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.074858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ac03c-f591-4121-a4f7-ff38f03617e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.088563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e99e9-0fc7-424f-8230-724ebec617c0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.095378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.096038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.096339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.096675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.098770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:44.101646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1770/3517] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:43 2021] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:44.103101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.103384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.103653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.123534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:44.124751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:44.165073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.166814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.179201 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1748/3518] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:44 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:44.181692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.188388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1771/3519] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:44.194070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb084f5-3377-430d-9758-b4b52547937a service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.199889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.200466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.200775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.201054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.201783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.203363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.210955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.219895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1749/3520] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:44 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:44.224262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.240476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428340e-a1d6-40ba-aef8-9ed4b42dce77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.247485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.248766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.249099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.249496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] PATH_INFO: `/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8/users/2f00b2a9eafb49ac9f0dbcad6feb1352/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.272235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c4c7887674c7f894a72fa75f0adb8, user_id=2f00b2a9eafb49ac9f0dbcad6feb1352, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.276069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.290370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38097822-3f80-43e0-8e7f-6738e6d3d262 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.300656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1750/3521] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:44 2021] PUT /identity/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8/users/2f00b2a9eafb49ac9f0dbcad6feb1352/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:44.302636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.369995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.370998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.371501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.371990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.378701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf79f-41f1-4ad5-a94f-05321adfd84a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.385576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.386481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.386801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.387115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.388010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.389648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.401606 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1751/3522] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:44 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:44.405773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.417931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c08c-b94e-4a28-8f63-b2cd601a42b4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.423546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.424593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.425474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.425811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] PATH_INFO: `/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8/users/2f00b2a9eafb49ac9f0dbcad6feb1352/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.428281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c4c7887674c7f894a72fa75f0adb8, user_id=2f00b2a9eafb49ac9f0dbcad6feb1352, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.430993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9689d-1a30-48c3-990e-4560ca874a66 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.444065 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1752/3523] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:44 2021] PUT /identity/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8/users/2f00b2a9eafb49ac9f0dbcad6feb1352/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:44.444295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.446295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.453996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401aae-05ca-4a4d-8700-ddc3a9f3e6fa None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.454334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401aae-05ca-4a4d-8700-ddc3a9f3e6fa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.454684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401aae-05ca-4a4d-8700-ddc3a9f3e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.457670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1772/3524] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:02:44.464015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:44.466085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:44.492088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a0401aae-05ca-4a4d-8700-ddc3a9f3e6fa None None] MFA Rules not processed for user `2f00b2a9eafb49ac9f0dbcad6feb1352`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:44.493734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a0401aae-05ca-4a4d-8700-ddc3a9f3e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:44.537445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642d2-72e2-4f42-b16b-55001acafa53 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:44.594874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1753/3525] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:44 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:44.602384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:44.603161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:44.603636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:44.603983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:44.606561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:44.620329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:44.622079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:44.632591 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1773/3526] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:45.008439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.008962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.009249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:45.042317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:45.044534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:45.129323 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1754/3527] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:02:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:45.147514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:45.252539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2abaeb-8687-4ebe-9a5e-299932c755ee service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:45.259617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:45.260280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.260432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.261131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:45.272924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:45.274528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:45.287124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1774/3528] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:02:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:02:45.419782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:45.422128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:45.423518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:45.529494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9a5b-0cf0-4835-a200-39453174ecf8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:45.532241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f30d5-124b-404d-8cdf-828ba4e9315b service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:45.536991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:45.538157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.538899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.539380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] PATH_INFO: `/v3/users/28874f14f2c64a7a9e3770cc7e5d3371` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:45.540822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:45.541513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28874f14f2c64a7a9e3770cc7e5d3371)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:45.541751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.542034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.542304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:45.545024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:45.553542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:45.555454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d0af-741f-4129-b924-2dc2d802afd8 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:45.571633 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1775/3529] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:45 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:45.661864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28874f14f2c64a7a9e3770cc7e5d3371'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:45.670085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28874f14f2c64a7a9e3770cc7e5d3371'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:45.671154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28874f14f2c64a7a9e3770cc7e5d3371'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:45.692058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28874f14f2c64a7a9e3770cc7e5d3371'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:45.706715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28874f14f2c64a7a9e3770cc7e5d3371'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:45.719996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1755/3530] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:45 2021] DELETE /identity/v3/users/28874f14f2c64a7a9e3770cc7e5d3371 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:45.722038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.722402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.722682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:45.751608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:45.752884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:45.848002 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1776/3531] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:45.863576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:45.865295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:45.989281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc45bf-e420-436b-b66c-cc3b95ee8c5a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:45.994486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:45.995262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:45.995546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:45.995821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.007171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.008740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823ef87-2589-4f9e-aae9-555326419132 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:46.021546 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1756/3532] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:46.385900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:46.387339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.400541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15089011-629a-4bd9-b6cd-293608ab8ee0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:46.433613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:46.434500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.434780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.435050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] PATH_INFO: `/v3/projects/e9986f60f3d449caa2bd8b4dc8fef2ba` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.437689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9986f60f3d449caa2bd8b4dc8fef2ba)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.439964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:46.495484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9986f60f3d449caa2bd8b4dc8fef2ba', 'request_id': 'req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.502051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9986f60f3d449caa2bd8b4dc8fef2ba', 'request_id': 'req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.512438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9986f60f3d449caa2bd8b4dc8fef2ba', 'request_id': 'req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.532337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] The token cache is being invalidate because project e9986f60f3d449caa2bd8b4dc8fef2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:46.532583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.533491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.536102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1777/3533] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:46 2021] DELETE /identity/v3/projects/e9986f60f3d449caa2bd8b4dc8fef2ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:46.543200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86aba-4220-4e88-a1a3-05d323706be3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.544310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86aba-4220-4e88-a1a3-05d323706be3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.544589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86aba-4220-4e88-a1a3-05d323706be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.569295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-34f86aba-4220-4e88-a1a3-05d323706be3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:46.570805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-34f86aba-4220-4e88-a1a3-05d323706be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.609030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:46.610918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.654638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1757/3534] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:46.722180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.722717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.723182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.733118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c05a6a-ab89-44cb-9479-e1a4116e81fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:46.744380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:46.746731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.747133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.747805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] PATH_INFO: `/v3/users/4333bc0463b24e389cf77f1bd1933e73` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.750548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4333bc0463b24e389cf77f1bd1933e73)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.752829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:46.759767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:46.762143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.822039 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1758/3535] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:46.823600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:46.834999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4333bc0463b24e389cf77f1bd1933e73'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.841691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdbd27-db26-4187-905c-8dffbc43d849 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:46.843552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4333bc0463b24e389cf77f1bd1933e73'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.844358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4333bc0463b24e389cf77f1bd1933e73'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.845112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4333bc0463b24e389cf77f1bd1933e73'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.850092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:46.850772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.851065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.851329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.852080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:46.852382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.854241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:46.860135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4333bc0463b24e389cf77f1bd1933e73'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:46.871029 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1759/3536] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:46.875392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:46.877234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.890953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1778/3537] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:46 2021] DELETE /identity/v3/users/4333bc0463b24e389cf77f1bd1933e73 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:46.892417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114854-25ec-495f-b940-3123af5d6658 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:46.893445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:46.895133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:46.976480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b77ea-ae1a-46e2-9eaa-b975092bddf6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:46.982615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:46.983195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:46.983355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.984067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.984067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.984253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:46.984333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:46.984782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] PATH_INFO: `/v3/users/6a9c27a569994ef3a164d80d95618620` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:46.984951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.986067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9c27a569994ef3a164d80d95618620)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:46.986954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94438fa9-358b-4b59-a46d-21f4abdc649a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:46.988347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.022617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1779/3538] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:46 2021] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:47.028109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6794de-6276-492d-85c7-87e2f75f5b04 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.028683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6794de-6276-492d-85c7-87e2f75f5b04 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.029116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6794de-6276-492d-85c7-87e2f75f5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.062000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c6794de-6276-492d-85c7-87e2f75f5b04 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:47.063355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c6794de-6276-492d-85c7-87e2f75f5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.064169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9c27a569994ef3a164d80d95618620'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:47.077926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9c27a569994ef3a164d80d95618620'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:47.078678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9c27a569994ef3a164d80d95618620'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:47.095601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9c27a569994ef3a164d80d95618620'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:47.109606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9c27a569994ef3a164d80d95618620'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:47.118591 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1760/3539] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:46 2021] DELETE /identity/v3/users/6a9c27a569994ef3a164d80d95618620 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:47.120045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.122040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.192530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1780/3540] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:47.194763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.195257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.195708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.211857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3ac2-0da7-46bc-b3fa-00b0f684300e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.222629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:47.223631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.227184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.228150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.228733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.229385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.230517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.232928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.233479 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1781/3541] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:47.234439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.235981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.262753 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1761/3542] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:47 2021] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:47.264118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.267831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.332717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df702dfc-c637-4ec2-8389-8c662b72920f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.338016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.338772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.339055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.339358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.351678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.352526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1237d7-0a15-4693-9262-534818f0abb1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.353326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.357792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.358788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.359382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.359770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.365578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1782/3543] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:47.366639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.372152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.375182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.382758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6eeff-7574-480f-afb4-941de48066ab service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.391090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.391983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.392449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.392989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.395020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.397249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.398411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1762/3544] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:47.409400 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1783/3545] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:47 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:47.414212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.431490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fdf3-ae28-450d-b6b2-3020508299e8 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.441502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.442202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.442620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.442838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.447199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.449360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068201c4-c583-4ca2-b516-e84deb9fdad6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.463540 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1763/3546] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:47 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:47.469992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.481549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66733-9b4a-4392-a333-55543f2825dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.488558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.489897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.490498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.490845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] PATH_INFO: `/v3/projects/945d0f391e364fe6a10ff981b10e4a89/users/5ce44da17b9e472cbe7198389c3eeedb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.510256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945d0f391e364fe6a10ff981b10e4a89, user_id=5ce44da17b9e472cbe7198389c3eeedb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.513663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.533017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1784/3547] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:47 2021] PUT /identity/v3/projects/945d0f391e364fe6a10ff981b10e4a89/users/5ce44da17b9e472cbe7198389c3eeedb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:47.538485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.539221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.544871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.566097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:47.567432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.658769 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1764/3548] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:47.677660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:47.679963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:47.775948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8660-11e2-4a40-b46d-36c38d763cb1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:47.780657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:47.782127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:47.782420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:47.782679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:47.794198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:47.795638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:47.808030 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1785/3549] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:48.712232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:48.713789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:48.735521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbd955-8589-481b-9a20-3904a7ec1441 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:48.746399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:48.747522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:48.748143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:48.748287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] PATH_INFO: `/v3/projects/77ac14079ae140f4bfde976dcdd04686` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:48.749533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ac14079ae140f4bfde976dcdd04686)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:48.751419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:48.809468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:48.810906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:48.836116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ac14079ae140f4bfde976dcdd04686', 'request_id': 'req-eeaf0b86-dd0c-455d-a1de-597cef9941ef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.836363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf73b-dc62-468a-9533-865e6f5e8949 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:48.843252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ac14079ae140f4bfde976dcdd04686', 'request_id': 'req-eeaf0b86-dd0c-455d-a1de-597cef9941ef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.850514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ac14079ae140f4bfde976dcdd04686', 'request_id': 'req-eeaf0b86-dd0c-455d-a1de-597cef9941ef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.865582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] The token cache is being invalidate because project 77ac14079ae140f4bfde976dcdd04686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:48.866256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.867257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.870251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1765/3550] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:48 2021] DELETE /identity/v3/projects/77ac14079ae140f4bfde976dcdd04686 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:48.873646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:48.875482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:48.906452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:48.907327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:48.907709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:48.907876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] PATH_INFO: `/v3/projects/24846d6a7631416ab7f223d3e21fa74c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:48.909366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24846d6a7631416ab7f223d3e21fa74c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:48.911883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:48.977685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24846d6a7631416ab7f223d3e21fa74c', 'request_id': 'req-f30d4b6c-bb52-4373-a74e-1606793b6e17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:48.988521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24846d6a7631416ab7f223d3e21fa74c', 'request_id': 'req-f30d4b6c-bb52-4373-a74e-1606793b6e17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.001570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf0b86-dd0c-455d-a1de-597cef9941ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:49.009576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24846d6a7631416ab7f223d3e21fa74c', 'request_id': 'req-f30d4b6c-bb52-4373-a74e-1606793b6e17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.034535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] The token cache is being invalidate because project 24846d6a7631416ab7f223d3e21fa74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:49.043227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.045191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.047264 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1786/3551] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:48 2021] DELETE /identity/v3/projects/24846d6a7631416ab7f223d3e21fa74c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:49.048805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:49.053242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:49.109411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:49.110361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:49.111387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:49.111808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] PATH_INFO: `/v3/users/2f00b2a9eafb49ac9f0dbcad6feb1352` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:49.113882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f00b2a9eafb49ac9f0dbcad6feb1352)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:49.116954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:49.239257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d4b6c-bb52-4373-a74e-1606793b6e17 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:49.244642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:49.245527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:49.245943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:49.246178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] PATH_INFO: `/v3/users/28439236f513404989b79da765cd70d9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:49.248940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28439236f513404989b79da765cd70d9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:49.252067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:49.268650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f00b2a9eafb49ac9f0dbcad6feb1352'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.295219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f00b2a9eafb49ac9f0dbcad6feb1352'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.296129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f00b2a9eafb49ac9f0dbcad6feb1352'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.334440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f00b2a9eafb49ac9f0dbcad6feb1352'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.345611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28439236f513404989b79da765cd70d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.349751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f00b2a9eafb49ac9f0dbcad6feb1352'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.369298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28439236f513404989b79da765cd70d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.369476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1766/3552] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:48 2021] DELETE /identity/v3/users/2f00b2a9eafb49ac9f0dbcad6feb1352 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:49.369476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:49.370986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28439236f513404989b79da765cd70d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.371802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28439236f513404989b79da765cd70d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.373601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:49.382054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b30eba67-bcca-4c86-90c6-d273cf64de97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28439236f513404989b79da765cd70d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.408542 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1787/3553] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:49 2021] DELETE /identity/v3/users/28439236f513404989b79da765cd70d9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:49.410788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebb63-c54c-44b2-a8e8-52c93a7948ee None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:49.411631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebb63-c54c-44b2-a8e8-52c93a7948ee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:49.412208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebb63-c54c-44b2-a8e8-52c93a7948ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:49.437167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-308ebb63-c54c-44b2-a8e8-52c93a7948ee None None] MFA Rules not processed for user `1425015068994a7c93a716cce5408ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:49.438885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-308ebb63-c54c-44b2-a8e8-52c93a7948ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:49.510219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f4ba4-5b4c-490d-9817-cc1e94f0d9dd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:49.548338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1788/3554] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:49.669652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:49.670923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:49.671284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:49.671659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] PATH_INFO: `/v3/users/1e64c23c16d54f07bd872e4a44d29edb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:49.673244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e64c23c16d54f07bd872e4a44d29edb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:49.676055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:49.760554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e64c23c16d54f07bd872e4a44d29edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.772051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e64c23c16d54f07bd872e4a44d29edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.772815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e64c23c16d54f07bd872e4a44d29edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.799964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e64c23c16d54f07bd872e4a44d29edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.813711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e64c23c16d54f07bd872e4a44d29edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:49.824379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1767/3555] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:49 2021] DELETE /identity/v3/users/1e64c23c16d54f07bd872e4a44d29edb => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:50.219365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:50.219928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:50.219928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:50.276215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] MFA Rules not processed for user `5ce44da17b9e472cbe7198389c3eeedb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:50.277494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:50.406977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1789/3556] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:50 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:50.423882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:50.425777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:50.426859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:50.427268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:50.595891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513211d-da82-4d6c-b972-4911642b79e3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:50.599366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896df2ed-f819-4a26-9c22-62a61aed8a75 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:50.612726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:50.613878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:50.614007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:50.614557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:50.614745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:50.615012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] PATH_INFO: `/v3/projects/4f733c65bb8b451582fb9a9f98c0c5ee` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:50.615177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:50.615279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:50.619604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f733c65bb8b451582fb9a9f98c0c5ee)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:50.622116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:50.641977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:50.647363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913153-29d2-42ae-b84b-fc2a221bfbaa service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:50.679930 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1768/3557] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:50 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:50.728405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f733c65bb8b451582fb9a9f98c0c5ee', 'request_id': 'req-35c136aa-8d78-44d2-8f78-2ef422002827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:50.735620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f733c65bb8b451582fb9a9f98c0c5ee', 'request_id': 'req-35c136aa-8d78-44d2-8f78-2ef422002827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:50.758195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f733c65bb8b451582fb9a9f98c0c5ee', 'request_id': 'req-35c136aa-8d78-44d2-8f78-2ef422002827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:50.786695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] The token cache is being invalidate because project 4f733c65bb8b451582fb9a9f98c0c5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:50.790067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:50.792070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-35c136aa-8d78-44d2-8f78-2ef422002827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:50.801953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1790/3558] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:50 2021] DELETE /identity/v3/projects/4f733c65bb8b451582fb9a9f98c0c5ee => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:50.802863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:50.803854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:50.804289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:50.857801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:50.859372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:50.953311 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1769/3559] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:50.954885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:50.955173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:50.955450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:50.981569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:50.981709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:50.991379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1791/3560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:50.997775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.010743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bd331-2058-4520-92ae-df3460342b8d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.020338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.021125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.021465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.021804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.023057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:51.023406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.025369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.040340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.042488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.072656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1770/3561] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:51.078488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fe0e3-73ab-4a2f-b227-8378f1bb5f6b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.079959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.091248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.092903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.093188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.095108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] PATH_INFO: `/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.097938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6c4c7887674c7f894a72fa75f0adb8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.103151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.118679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3588859-ca63-4e10-bc24-f1f5309c6e2a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.129665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.132068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.133925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.133925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.135724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.144495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.208839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6c4c7887674c7f894a72fa75f0adb8', 'request_id': 'req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.209653 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1771/3562] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:51.215262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.235406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6c4c7887674c7f894a72fa75f0adb8', 'request_id': 'req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.261992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6c4c7887674c7f894a72fa75f0adb8', 'request_id': 'req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.288688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] The token cache is being invalidate because project 3e6c4c7887674c7f894a72fa75f0adb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:51.289000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.294311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fa379c-90aa-4b4d-ad42-026e8a73a9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.297399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1792/3563] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:51 2021] DELETE /identity/v3/projects/3e6c4c7887674c7f894a72fa75f0adb8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:51.303447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb868f-0b19-4489-9e5a-0a8750c21511 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.304021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb868f-0b19-4489-9e5a-0a8750c21511 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.304474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb868f-0b19-4489-9e5a-0a8750c21511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.344568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4ceb868f-0b19-4489-9e5a-0a8750c21511 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:51.345137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4ceb868f-0b19-4489-9e5a-0a8750c21511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.353853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3623-94f7-4560-8f13-3e0f1cca684b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.369073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.369764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.370039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.370314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.376777 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1793/3564] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:51.377002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.377002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.382719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.384526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.384894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.425706 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1772/3565] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:51.429943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.433422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.459122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b62e-62c1-4197-9545-8b1993569d63 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.459440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:51.463161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.472285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.473053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.473336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.474469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.475479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.481646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.499300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1794/3566] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:51.500395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.505983 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1773/3567] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:51 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:51.506884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.510457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.525083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4726270-3400-4e8b-9c66-c2f2192ea2e3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.534093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.534869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.535154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.535431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.536515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:51.537125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.539452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.548560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15999742-a86f-4f4d-bac0-1d34755ca157 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.556634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.557553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.557553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.557815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] PATH_INFO: `/v3/projects/0d55a5bad719447bbf097a3a786aa208` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.561435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d55a5bad719447bbf097a3a786aa208)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.563352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.584399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1795/3568] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:51.584399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.607421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122353e-5bf3-4d7b-af7d-254436c2a150 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.621112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.621853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.622126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.622405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.623227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.632030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.658952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d55a5bad719447bbf097a3a786aa208', 'request_id': 'req-25d26cf9-f98b-497b-a770-c9832565d7aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.662340 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1796/3569] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:51 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:51.663713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.666620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d55a5bad719447bbf097a3a786aa208', 'request_id': 'req-25d26cf9-f98b-497b-a770-c9832565d7aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.675302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d55a5bad719447bbf097a3a786aa208', 'request_id': 'req-25d26cf9-f98b-497b-a770-c9832565d7aa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.696373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] The token cache is being invalidate because project 0d55a5bad719447bbf097a3a786aa208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:51.697373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88cfc-a41e-442c-9a01-27b19f22735f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.697924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.698997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:51.701062 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1774/3570] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:51 2021] DELETE /identity/v3/projects/0d55a5bad719447bbf097a3a786aa208 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:51.702718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:51.705339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.789661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.791749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.792048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.792771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.793543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:51.796248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd8e0-f9d3-4e71-b59b-4927d0705c42 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:51.835864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1797/3571] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:51.837623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.837908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.838371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:51.853156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d26cf9-f98b-497b-a770-c9832565d7aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:51.866794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:51.868360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:51.980883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:51.981846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:51.982190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:51.982475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] PATH_INFO: `/v3/projects/d0c8c27cce8d4b0daa212308c12e6e44/users/3ff52277efac417bb23af1449d49b891/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.012790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1798/3572] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:52.016154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c8c27cce8d4b0daa212308c12e6e44, user_id=3ff52277efac417bb23af1449d49b891, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.018493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c656c-9008-400a-b0be-000b19757dc6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.035181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.035181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.055812 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1775/3573] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:51 2021] PUT /identity/v3/projects/d0c8c27cce8d4b0daa212308c12e6e44/users/3ff52277efac417bb23af1449d49b891/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:52.057306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bececc9-5cf8-4a2a-bebc-327612db5338 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.057592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bececc9-5cf8-4a2a-bebc-327612db5338 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.057868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bececc9-5cf8-4a2a-bebc-327612db5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.058880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df3c-8ea2-45a2-a928-7893d953ee7c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.094678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0bececc9-5cf8-4a2a-bebc-327612db5338 None None] MFA Rules not processed for user `5ce44da17b9e472cbe7198389c3eeedb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:52.096568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0bececc9-5cf8-4a2a-bebc-327612db5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.192220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.192928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.193204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.193476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.194181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.196162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.197887 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1776/3574] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:52.199517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdb68e-f754-43f2-87e2-36773db29dd7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.199988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdb68e-f754-43f2-87e2-36773db29dd7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.200481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdb68e-f754-43f2-87e2-36773db29dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.223135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-aafdb68e-f754-43f2-87e2-36773db29dd7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:52.224668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aafdb68e-f754-43f2-87e2-36773db29dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.251058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1777/3575] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:52.257417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.257417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.257417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.260253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1799/3576] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:52.262112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.284918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884ce6-acb0-4548-8340-094f07e4bee9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.294528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.295496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.295877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.295983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.297060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:52.297389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.307317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.318303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] MFA Rules not processed for user `3ff52277efac417bb23af1449d49b891`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:52.319532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.323459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1800/3577] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:52.324501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.340030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9cdd1-fe87-4001-ae92-44fcf52098b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.345273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.345941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.346824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.347225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.347983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.350343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.364029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1801/3578] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:52.365309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.385973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82965b84-4882-4390-850f-aa823e14cd13 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.391816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.392495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.392798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.393609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.394456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.396335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.407858 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1778/3579] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:52.409452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.422872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be92c-070a-4bdf-8800-21c3e249706f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.430193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.431126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.431523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.435271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.435457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1802/3580] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:52.435588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.435690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.435785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.436765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.448625 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1779/3581] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:52.452857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.463879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b2080-b14b-4447-b119-e616aca3f8a2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.514016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41784-1aa5-4568-950c-0e1e6f3dc9b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.520806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.521829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.522505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.523048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.526508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.527187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.527467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.527741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.528446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.530408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.556415 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1780/3582] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:52.556415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.565224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a3a5-b728-491b-9048-5ffbb02d18b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.570348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.571256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.571538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.572084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6/users/eed69df282d1442d8aceff91aed19dcd/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.587824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a66b93f8ae54386b0f5531e60591be6, user_id=eed69df282d1442d8aceff91aed19dcd, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.590505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd9bd4-b6a5-49e2-b91b-83c0918402b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.590676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.592199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.604982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1803/3583] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:52.605867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.617285 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1781/3584] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:52 2021] PUT /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6/users/eed69df282d1442d8aceff91aed19dcd/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:52.624743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44906bc3-c458-4305-88b4-50ccb36f59c9 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.629113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.629528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.629808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.670473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] MFA Rules not processed for user `eed69df282d1442d8aceff91aed19dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:52.671783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.708261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.709859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.710013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.710800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.713185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.715344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.729197 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1804/3585] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:52.730318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.742951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc487bf-6958-4d1b-87eb-0a2bc817150d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.748200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.749212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.749596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.749972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] PATH_INFO: `/v3/users/3ff52277efac417bb23af1449d49b891` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.751472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff52277efac417bb23af1449d49b891)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.754018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.754902 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1782/3586] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:52.756712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.771007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9537d4-d135-4653-a5d2-1c3c5a1caca5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.786790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.787817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.788105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.788404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.789175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.790788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.815587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1783/3587] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:52.817083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.840081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229237a8-3876-424f-ab73-b48a327ac0a0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:52.845682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:52.847122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:52.847558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:52.848163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:52.849227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:52.851665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:52.855402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff52277efac417bb23af1449d49b891'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:52.876982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff52277efac417bb23af1449d49b891'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:52.879098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff52277efac417bb23af1449d49b891'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:52.880570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff52277efac417bb23af1449d49b891'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:52.893990 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1784/3588] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:52.895536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.897851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff52277efac417bb23af1449d49b891'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:52.921954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:52.923535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1805/3589] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:52 2021] DELETE /identity/v3/users/3ff52277efac417bb23af1449d49b891 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:52.925030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:52.927156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.020643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c065-c5f4-4e32-821e-2acf7eef43ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.024632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc27d3-6d0a-40ff-99bf-51224c62d091 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.025524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.026614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.026877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.027238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] PATH_INFO: `/v3/projects/78510894020b4f7d9f09f7eb443af30a/users/ef1b196e2255482d9b07e9cbabb9fc64/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.039003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.040341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.040756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.041133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.042027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.044812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8726b-c14f-40c5-a2c5-dd6b40195b93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.050856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78510894020b4f7d9f09f7eb443af30a, user_id=ef1b196e2255482d9b07e9cbabb9fc64, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.054231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.072769 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1806/3590] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:52 2021] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:53.072769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.073272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.073593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.084228 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1785/3591] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:52 2021] PUT /identity/v3/projects/78510894020b4f7d9f09f7eb443af30a/users/ef1b196e2255482d9b07e9cbabb9fc64/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:53.084228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.115248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:53.116550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.183495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a137a20-82b8-41c4-a397-ed9c1886bce4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.189686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.190639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.190923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.191195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.192043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.194422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a134fee-41e9-43ee-8f26-39b4788615b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.207486 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1786/3592] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:53.208055 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1807/3593] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:53.215519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.215676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.215863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.216140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.217565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.254762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] MFA Rules not processed for user `ef1b196e2255482d9b07e9cbabb9fc64`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:53.256317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.304808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a566bd-c957-4b97-be89-f78f4d5e77d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.311968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.313666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.313666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.313666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.315608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.327097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.328516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.339084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1808/3594] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:53.341612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.354277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0b68-af2f-464c-b78a-3621dc47f667 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.359932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.361149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.361583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.361904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] PATH_INFO: `/v3/projects/9d96df30e949476cabb07ae5da6427fd/users/d65d26e07b6b4360ae1e3453727f8a21/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.362609 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1787/3595] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:53.363698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.365363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.379397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d96df30e949476cabb07ae5da6427fd, user_id=d65d26e07b6b4360ae1e3453727f8a21, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.381656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddae6-2ffb-407c-bef1-9683b727c339 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.383416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.385660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.386639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.387024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.388040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.400232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1809/3596] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:53 2021] PUT /identity/v3/projects/9d96df30e949476cabb07ae5da6427fd/users/d65d26e07b6b4360ae1e3453727f8a21/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:53.401338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.403304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.405167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.416789 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1788/3597] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:53.417673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.438507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc751e5-55ed-4ca4-8aac-49b557868b25 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.485780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deeb8-06bb-44cd-9e3b-e9a2547e5204 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.492550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.493851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.494460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.494958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.496549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.499656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.530412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.531692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.532072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.532913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.533521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.536226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.556476 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1810/3598] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:53 2021] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:53.558021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1789/3599] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:53.562021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.563264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.575494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f414f-3f60-41f2-8ede-5e93564e67dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.666428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.667907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.668522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.669002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] PATH_INFO: `/v3/projects/9d96df30e949476cabb07ae5da6427fd/users/d65d26e07b6b4360ae1e3453727f8a21/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.671464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d96df30e949476cabb07ae5da6427fd, user_id=d65d26e07b6b4360ae1e3453727f8a21, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.675941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e504172-99db-4bf1-b565-c8a894108fcb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.679627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fda2a-d1c8-4723-b22d-5a97e534367d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.687620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.688583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.689159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.690964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.693603 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1790/3600] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:53 2021] PUT /identity/v3/projects/9d96df30e949476cabb07ae5da6427fd/users/d65d26e07b6b4360ae1e3453727f8a21/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:53.703677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.703677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.705574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.705984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.706995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.746732 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1811/3601] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:53 2021] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:53.748911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.750603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] MFA Rules not processed for user `d65d26e07b6b4360ae1e3453727f8a21`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:53.753999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.761625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7b40c-29f1-4ba3-b105-51394f81e8f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.851626 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1791/3602] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:53 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:53.851626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.853227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:53.889869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.890548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.891009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.891128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.891841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.893539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.907693 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1812/3603] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:53.907693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.916808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab350a-934f-45b2-8001-12aa72f0dba3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.923462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.923896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6ce6-3ce0-416d-8ad0-6fe54e19f25f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.924930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.924930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.925865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.925985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:53.926749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.927843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.931109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.931957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.932236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.932508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] PATH_INFO: `/v3/projects/d0c8c27cce8d4b0daa212308c12e6e44` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.933773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c8c27cce8d4b0daa212308c12e6e44)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.935653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.945220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1813/3604] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:53.945220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:53.957456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa373cc7-bdfb-4b38-b1df-60cd865d29ef tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:53.963380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:53.964530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:53.964849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:53.965093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] PATH_INFO: `/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0/users/51489ef9ca13420f9c652c8607d5217b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:53.987261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a83713d0cf04e169fa3c63e45ab53b0, user_id=51489ef9ca13420f9c652c8607d5217b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:53.992147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:53.996638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c8c27cce8d4b0daa212308c12e6e44', 'request_id': 'req-e54a415e-86e6-4d04-b904-7ccd1da86534'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:54.004054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c8c27cce8d4b0daa212308c12e6e44', 'request_id': 'req-e54a415e-86e6-4d04-b904-7ccd1da86534'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:54.012492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c8c27cce8d4b0daa212308c12e6e44', 'request_id': 'req-e54a415e-86e6-4d04-b904-7ccd1da86534'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:54.016332 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1814/3605] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:53 2021] PUT /identity/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0/users/51489ef9ca13420f9c652c8607d5217b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:54.016332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.030670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] The token cache is being invalidate because project d0c8c27cce8d4b0daa212308c12e6e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:54.031360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:54.031676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:54.038158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1792/3606] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:53 2021] DELETE /identity/v3/projects/d0c8c27cce8d4b0daa212308c12e6e44 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:54.038158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.040130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.112303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8413-3d35-410b-b866-90e5b858988c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.121063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.121800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.122088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.122744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.130305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:54.132954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e255-971e-4cbf-a390-261d37901087 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:54.211425 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1815/3607] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:54 2021] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:54.212652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.212959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.213238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.246539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a415e-86e6-4d04-b904-7ccd1da86534 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.250732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:54.254173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.420208 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1816/3608] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:54.422283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.442392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.483792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.484508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.484814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.485150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.487559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:54.497762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ce9b4-962b-480f-b95a-848e0ff480b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:54.541992 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1793/3609] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:54 2021] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:54.543386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.558610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.559254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.605203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:54.607232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.645877 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1794/3610] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:54.645877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.646207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ab8a-64bb-496c-9e78-82630fc71090 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.657152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.659190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.659190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.659594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.660417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:54.661000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:54.662957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:54.679723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287b258-d6d5-4f92-99cb-5efbe6e29044 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.698355 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1817/3611] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:54.698355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.704666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.706129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.707366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.707802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] PATH_INFO: `/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0/users/51489ef9ca13420f9c652c8607d5217b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.710335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a83713d0cf04e169fa3c63e45ab53b0, user_id=51489ef9ca13420f9c652c8607d5217b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:54.714119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:54.723067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5816cd-81cc-41db-bb23-80e5b938c804 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.735965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.737282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.738670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.739032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.740330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:54.740881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:54.745948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bcff-d2d3-4785-8d61-c2995d913aaf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:54.752957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1795/3612] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:54 2021] PUT /identity/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0/users/51489ef9ca13420f9c652c8607d5217b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:54.759968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:54.770527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.801025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1818/3613] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:54.802571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf656e-53ad-40a1-8f5c-25e391db4c01 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.802854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf656e-53ad-40a1-8f5c-25e391db4c01 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.803127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf656e-53ad-40a1-8f5c-25e391db4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:54.918452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eddf656e-53ad-40a1-8f5c-25e391db4c01 None None] MFA Rules not processed for user `51489ef9ca13420f9c652c8607d5217b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:54.919687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eddf656e-53ad-40a1-8f5c-25e391db4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:54.942015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2178f7-2bad-4a76-acc3-5b9579a9d776 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:54.950145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:54.950983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:54.951328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:54.951668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.024267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.026438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.038418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1796/3614] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:54 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:55.039937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.073338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1819/3615] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:54 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:55.075341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.075624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.075895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.077904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1820/3616] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:55.083569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:55.106400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.129540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f1f2-075f-4b36-beca-a52699005d34 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.134887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.136550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.136922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.137203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/6de5f367840f449ab26c896ca0c88e89` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.138802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=6de5f367840f449ab26c896ca0c88e89)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.141602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.144586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1821/3617] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/projects/6de5f367840f449ab26c896ca0c88e89 => generated 369 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:55.146443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.148710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:55.175951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452995-4ac1-4cd6-826b-06e95a78e8eb tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.191004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.191800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.192180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.192364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.208234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.210509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89bb65-71b6-431c-83b6-bbd83fbdcc55 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.223037 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1822/3618] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:55.224394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.224713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.224990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.227164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1823/3619] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:55.231006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f07f-7d20-4d37-9221-3c9c77da3a84 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.233550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:55.240896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.241822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.242162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.242483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.243257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.247635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.254228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.266472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeede9-0699-419c-b590-c88244bc7ea9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.278716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.281306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.282057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.282057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/6de5f367840f449ab26c896ca0c88e89` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.292795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=6de5f367840f449ab26c896ca0c88e89)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.294501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.317055 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1824/3620] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/projects/6de5f367840f449ab26c896ca0c88e89 => generated 369 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:55.320247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.334759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1797/3621] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:55 2021] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:55.335850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.385790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55a99-ca48-4fc4-be65-3c22f3f47f50 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.505731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e40b1-26b9-4fe3-8657-0de75017b427 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.522996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.523690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.523966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.524299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.525157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.527255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.541415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.542695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.543510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.543510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.561963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:55.574217 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1798/3622] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:55 2021] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:02:55.579903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.592863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538a81-2892-45dd-af55-897e39bd4177 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.600809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.601543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.601785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.606119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.606119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.607058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.632814 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1799/3623] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:55.636187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.658551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5e15-7ec6-4861-af5a-14f6d34a313b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.680827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.681504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.681778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.682048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.682779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.684702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.693463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.696255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.710079 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1800/3624] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:55.712940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.721499 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1825/3625] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:55.729107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6d93-b587-472d-a00b-2e2e09412734 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.735893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.737131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.737489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.739008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] PATH_INFO: `/v3/projects/a15de5c4a094498d9dd5da826df51b9a/users/5bd148dc620a41cf9e5e817216c7c67d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.762792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15de5c4a094498d9dd5da826df51b9a, user_id=5bd148dc620a41cf9e5e817216c7c67d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.766163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21d92-31f1-43a4-a9e9-69f24f489f3e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:55.777174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:55.779049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:55.803644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1801/3626] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:55 2021] PUT /identity/v3/projects/a15de5c4a094498d9dd5da826df51b9a/users/5bd148dc620a41cf9e5e817216c7c67d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:55.804269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e54ef-eca9-4960-9ac7-069dc79bcf37 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.804477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e54ef-eca9-4960-9ac7-069dc79bcf37 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.808453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9ef4-df34-4d0d-ae52-21f16fb0c6a1 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:55.809374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e54ef-eca9-4960-9ac7-069dc79bcf37 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.818785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1802/3627] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:55 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:55.823338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.823616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.823932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.870058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:55.871297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:55.968809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1803/3628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:55.969744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:55.984284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:55.985204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:55.985482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:55.985755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] PATH_INFO: `/v3/users/c97777c543744f398530e24ae6ba3409` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:55.988098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97777c543744f398530e24ae6ba3409)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:55.992558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.094072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97777c543744f398530e24ae6ba3409'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.109653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97777c543744f398530e24ae6ba3409'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.112340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97777c543744f398530e24ae6ba3409'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.113309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97777c543744f398530e24ae6ba3409'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.136413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97777c543744f398530e24ae6ba3409'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.164359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.170957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1826/3629] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:55 2021] DELETE /identity/v3/users/c97777c543744f398530e24ae6ba3409 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:56.175308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.176734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.253882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e56b4c-a106-4a41-afa5-af26bdfe680f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:56.259371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afef48-f25b-4d8c-97af-682b832209bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:56.270195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:56.270882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.271161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.271436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.277489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.368193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:56.370392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.372992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.373380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/6de5f367840f449ab26c896ca0c88e89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.377832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=6de5f367840f449ab26c896ca0c88e89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:56.381951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.387734 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1804/3630] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:55 2021] GET /identity/v3/projects/6de5f367840f449ab26c896ca0c88e89 => generated 369 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:56.417882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.420908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.427830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:56.432767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94617c3a-830b-4234-ba8e-4a312755990b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.451554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b89db-baa2-4ba2-a77b-acd900bcf2ae tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:56.455087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1827/3631] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:56.468470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:56.469583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.469962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.470337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/6de5f367840f449ab26c896ca0c88e89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.473306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6de5f367840f449ab26c896ca0c88e89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:56.478876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.578348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de5f367840f449ab26c896ca0c88e89', 'request_id': 'req-85b052b7-f967-4a13-a092-96b39b9c354e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.584298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de5f367840f449ab26c896ca0c88e89', 'request_id': 'req-85b052b7-f967-4a13-a092-96b39b9c354e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.592427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de5f367840f449ab26c896ca0c88e89', 'request_id': 'req-85b052b7-f967-4a13-a092-96b39b9c354e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.622823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] The token cache is being invalidate because project 6de5f367840f449ab26c896ca0c88e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:56.623554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.624849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.628331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1805/3632] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:56 2021] DELETE /identity/v3/projects/6de5f367840f449ab26c896ca0c88e89 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:02:56.648129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.648719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.648859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.650861 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1828/3633] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:56.652022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.656283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:56.658019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.661411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.754215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b052b7-f967-4a13-a092-96b39b9c354e tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:56.760158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:56.761265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.761746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.762265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] PATH_INFO: `/v3/users/ef1b196e2255482d9b07e9cbabb9fc64` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.763718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1b196e2255482d9b07e9cbabb9fc64)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:56.765922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.774741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.777462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.842405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1b196e2255482d9b07e9cbabb9fc64'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.855776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1b196e2255482d9b07e9cbabb9fc64'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.856917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1b196e2255482d9b07e9cbabb9fc64'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.871279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1b196e2255482d9b07e9cbabb9fc64'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.873075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e8-bfcb-4e0e-851d-556c92210670 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:56.880548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:56.881133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc5f6134-041c-4bcc-a8cc-bf0d3a13501b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1b196e2255482d9b07e9cbabb9fc64'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:56.892408 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1806/3634] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:56 2021] DELETE /identity/v3/users/ef1b196e2255482d9b07e9cbabb9fc64 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:56.894533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.901693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.901693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.902013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:56.902013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:56.902013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:56.902528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a66b93f8ae54386b0f5531e60591be6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:56.905246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:56.923651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1829/3635] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:56 2021] GET /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6 => generated 375 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:56.932320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:56.937432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.961491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:56.963183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:56.979832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac847-7811-41d5-b90a-ff2c91325784 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.104047 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1807/3636] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:57.127895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.128624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.129575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.129915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.131167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.133107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.136834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:57.138852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.148147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.182869 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1830/3637] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:57.184847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.191102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.239247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d270a-3978-4750-8f12-6c0b83d93f87 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.249857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.251143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.251518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.251797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] PATH_INFO: `/v3/projects/b2b97e1083184979a13c16d12ec87aac` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.254737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b97e1083184979a13c16d12ec87aac)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.257766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.262870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2c5ae-2b3b-40e0-84ee-16903cfbca5e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.267033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.268565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.269586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.269586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.281180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.284711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.296465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1808/3638] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:02:57.297698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.311353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da392d9d-ddb6-4729-8369-cbff00b47c90 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.337909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b97e1083184979a13c16d12ec87aac', 'request_id': 'req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:57.347430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b97e1083184979a13c16d12ec87aac', 'request_id': 'req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:57.359010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b97e1083184979a13c16d12ec87aac', 'request_id': 'req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:57.382395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] The token cache is being invalidate because project b2b97e1083184979a13c16d12ec87aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:57.382934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:57.384085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e2ff9fe6-c6fa-4741-9ce6-b8fb6f30e313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:57.385927 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1831/3639] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:57 2021] DELETE /identity/v3/projects/b2b97e1083184979a13c16d12ec87aac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:57.392861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bf5c-74eb-4e92-880d-0095f64b4544 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.394138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bf5c-74eb-4e92-880d-0095f64b4544 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.394653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bf5c-74eb-4e92-880d-0095f64b4544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.408191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.412346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.412346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.412346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.414470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.416230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4e47bf5c-74eb-4e92-880d-0095f64b4544 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:57.418241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e47bf5c-74eb-4e92-880d-0095f64b4544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.419767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.483599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1809/3640] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:57 2021] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:57.487575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.517823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.546418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1832/3641] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:57.554822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.555128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.555882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.590672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:57.591879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.662326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508c2d-aac2-42aa-9e49-65dd212822c9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.669256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.670493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.671052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.671937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.673395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:57.673865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.677030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516194a-9ef5-4733-b012-8e7b35dcaee9 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.688273 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1833/3642] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:57.689672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.699242 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1810/3643] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:57.702217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e500cc-404f-477a-8c17-99f93410df39 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.709499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.710367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.710695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.710894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.712509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:57.712867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.714607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.721624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.722331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.723033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.726918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1811/3644] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:02:57.732267 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1834/3645] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:02:57.732416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:57.733377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.737409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:57.747083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732e8-2fca-44ce-a61a-849065b1bb93 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.754011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.754703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.755163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.755446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.756337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.758748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:57.826323 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1835/3646] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:02:57 2021] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:57.832891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.895243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:57.916726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947cfa-162d-4147-a1a1-342770532a4e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.965689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84899-fbab-4d10-af81-15a0d618cf4d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:57.975408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:57.978218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:57.978425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:57.978995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:57.979788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:57.981935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.009105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.010655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.010926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.011213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/485b70f065e04ad6974c9f078334c7fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.013251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b70f065e04ad6974c9f078334c7fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.016775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.019184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1812/3647] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:57 2021] GET /identity/v3/projects/485b70f065e04ad6974c9f078334c7fc => generated 371 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:58.030124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1836/3648] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:57 2021] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:58.034503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.053203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438492-0e79-4cc8-a61e-5c92f6d7d6d2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.059621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.061149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.061651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.062202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.063251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.065394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.084768 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1813/3649] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:58 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:02:58.084953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.095064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291450ca-dc31-476d-8909-2dab0862c2d0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.100415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.101281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.101601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.101822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.102562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.104370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef90c-dc5c-43ab-bab1-20029b194c8c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.118140 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1837/3650] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:02:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:02:58.122904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.140465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489356d-4021-4325-a6e1-b469c869ed81 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.153072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.155304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.156634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.156987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] PATH_INFO: `/v3/projects/ef217b4cab3548e79a8d5ea2b300d5e2/users/09b38c47b50349aa941ebb113445259a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.177701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef217b4cab3548e79a8d5ea2b300d5e2, user_id=09b38c47b50349aa941ebb113445259a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.181291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.214358 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1814/3651] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:02:58 2021] PUT /identity/v3/projects/ef217b4cab3548e79a8d5ea2b300d5e2/users/09b38c47b50349aa941ebb113445259a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:58.218692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653129a-ff5f-4814-8873-d15c1a5bdabb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.219078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653129a-ff5f-4814-8873-d15c1a5bdabb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.219353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653129a-ff5f-4814-8873-d15c1a5bdabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.251429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a653129a-ff5f-4814-8873-d15c1a5bdabb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:58.256126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a653129a-ff5f-4814-8873-d15c1a5bdabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:58.365002 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1838/3652] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:02:58.418723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.422420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:58.578166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c03903-1bdb-4500-9e97-d2d4c272ea27 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.584289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.585085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.586556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.587275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.608569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.608569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.614898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1815/3653] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:02:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:02:58.630880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4ca3-d749-40ee-b853-d7e8621f8635 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.631513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4ca3-d749-40ee-b853-d7e8621f8635 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.632026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4ca3-d749-40ee-b853-d7e8621f8635 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.635169 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1839/3654] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:58.640262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:58.737535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.824932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ab1-1504-40d1-bb69-7b489b02f4c1 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.833619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.833619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.833619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.833930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/485b70f065e04ad6974c9f078334c7fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.833930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b70f065e04ad6974c9f078334c7fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.835073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.837620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1816/3655] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:58 2021] GET /identity/v3/projects/485b70f065e04ad6974c9f078334c7fc => generated 371 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:58.918064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4ca3-d749-40ee-b853-d7e8621f8635 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.934543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4ca3-d749-40ee-b853-d7e8621f8635 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:58.940275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:58.941969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:58.942540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:58.943052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:58.944031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:58.944387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:58.946441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:58.963261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.965750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:58.982315 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1840/3656] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:58.985184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:58.988987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2617-9b96-4a40-bfd5-6ddbe012b291 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:59.008418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:59.009336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.009750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.010033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] PATH_INFO: `/v3/projects/78510894020b4f7d9f09f7eb443af30a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.012458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=78510894020b4f7d9f09f7eb443af30a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:59.013683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a25a-6898-43a5-9fe6-67933892cee2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:59.014414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:59.024072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:59.025903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.026493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.027837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.029504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:59.033603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:59.074429 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1841/3657] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:02:58 2021] POST /identity/v3/users => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:02:59.076511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:59.098493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d54fd5-113a-4ba0-80af-deeee6acc1cd tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:59.121364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78510894020b4f7d9f09f7eb443af30a', 'request_id': 'req-e41d1be8-5f88-4423-9095-14128fe678ff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.129156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78510894020b4f7d9f09f7eb443af30a', 'request_id': 'req-e41d1be8-5f88-4423-9095-14128fe678ff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.132225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:59.134667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.134997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.135323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.138338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78510894020b4f7d9f09f7eb443af30a', 'request_id': 'req-e41d1be8-5f88-4423-9095-14128fe678ff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.139624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:02:59.139983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:59.147306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:59.158051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] The token cache is being invalidate because project 78510894020b4f7d9f09f7eb443af30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:02:59.158404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.159877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e41d1be8-5f88-4423-9095-14128fe678ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.165223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1817/3658] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:02:58 2021] DELETE /identity/v3/projects/78510894020b4f7d9f09f7eb443af30a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:59.165223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595a6f-f26d-4d89-8b28-925687d7e8f9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.165635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595a6f-f26d-4d89-8b28-925687d7e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.165920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595a6f-f26d-4d89-8b28-925687d7e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.202081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d7595a6f-f26d-4d89-8b28-925687d7e8f9 None None] MFA Rules not processed for user `5bd148dc620a41cf9e5e817216c7c67d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:59.207580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d7595a6f-f26d-4d89-8b28-925687d7e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.210082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1842/3659] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:02:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:02:59.211215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:59.219925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.235640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada134-3e5d-46e6-8c61-4baa9076bd6f tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:59.332308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:59.333633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.334112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.334613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] PATH_INFO: `/v3/users/51489ef9ca13420f9c652c8607d5217b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.341277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=51489ef9ca13420f9c652c8607d5217b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:59.343653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:59.361537 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1818/3660] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:59.364026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3bb7-26f5-4fc0-b02b-d6433d648e87 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.364309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3bb7-26f5-4fc0-b02b-d6433d648e87 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.364712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3bb7-26f5-4fc0-b02b-d6433d648e87 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.380937 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1819/3661] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:02:59 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:02:59.383037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.383037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.385056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.419705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] MFA Rules not processed for user `5bd148dc620a41cf9e5e817216c7c67d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:59.422257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.431520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51489ef9ca13420f9c652c8607d5217b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.438265 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1820/3662] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:59.441935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:02:59.444357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51489ef9ca13420f9c652c8607d5217b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.445457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.448471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51489ef9ca13420f9c652c8607d5217b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.451160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51489ef9ca13420f9c652c8607d5217b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.467677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a717585d-e337-44b6-9dff-af924f9db0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51489ef9ca13420f9c652c8607d5217b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:02:59.522058 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1843/3663] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:02:59 2021] DELETE /identity/v3/users/51489ef9ca13420f9c652c8607d5217b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:02:59.529356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.529764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.531693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.573075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] MFA Rules not processed for user `5bd148dc620a41cf9e5e817216c7c67d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:02:59.576637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.585229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:02:59.589284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:02:59.713372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1844/3664] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:02:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:02:59.730030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591eaa-9e35-4a88-91c0-1d8db472a5e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:02:59.859321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:02:59.860808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:02:59.861193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:02:59.862103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/485b70f065e04ad6974c9f078334c7fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:02:59.866618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b70f065e04ad6974c9f078334c7fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:02:59.870113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:02:59.872519 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1821/3665] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:02:59 2021] GET /identity/v3/projects/485b70f065e04ad6974c9f078334c7fc => generated 371 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:00.021281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:00.025902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.151386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46648-7379-4e3a-a50a-f96b98ab5648 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:00.159936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:00.162317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.162874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.163368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.166321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.190669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:00.193179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5ed4c-07dd-4929-ac9f-73b7ce25e75f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:00.210926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:00.214481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.214639 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1845/3666] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:00 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:00.356697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb75e1-bdcd-47ba-b496-95171244aa3d tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:00.362994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:00.363947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.364228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.364494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] PATH_INFO: `/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.366163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a83713d0cf04e169fa3c63e45ab53b0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:00.368281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:00.429739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a83713d0cf04e169fa3c63e45ab53b0', 'request_id': 'req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:00.436640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a83713d0cf04e169fa3c63e45ab53b0', 'request_id': 'req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:00.453253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a83713d0cf04e169fa3c63e45ab53b0', 'request_id': 'req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:00.472133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] The token cache is being invalidate because project 1a83713d0cf04e169fa3c63e45ab53b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:00.472508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:00.473247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-05d01688-d8f9-40fa-9ca3-0f68fb9fa56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:00.475130 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1822/3667] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:00 2021] DELETE /identity/v3/projects/1a83713d0cf04e169fa3c63e45ab53b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:00.481104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.482126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.482786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.512550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:00.518823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.646577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1846/3668] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:00.647922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef2d-0031-4a70-887e-273b96df9a5e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.648236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef2d-0031-4a70-887e-273b96df9a5e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.648484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef2d-0031-4a70-887e-273b96df9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.697828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e784ef2d-0031-4a70-887e-273b96df9a5e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:00.701847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e784ef2d-0031-4a70-887e-273b96df9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.738695 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1823/3669] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:00.739528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:00.791009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401613-68a6-4c04-ad4f-3bc983d699fa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:00.821391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:00.823518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.827424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.828376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.829573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:00.831160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:00.833341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:00.857248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378793cb-4229-4e13-bf15-34fcb9128576 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.858728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378793cb-4229-4e13-bf15-34fcb9128576 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.859521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378793cb-4229-4e13-bf15-34fcb9128576 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.861881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1824/3670] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:03:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:03:00.866540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1847/3671] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:03:00.870560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378793cb-4229-4e13-bf15-34fcb9128576 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:00.886939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:03:00.894895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:00.904749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378793cb-4229-4e13-bf15-34fcb9128576 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:00.919778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:00.921880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:00.922517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:00.924557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:00.927212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:00.930555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.007339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1825/3672] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:00 2021] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:01.008554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.116940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.119568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:01.158662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbdb77-3c2a-4597-9957-337e8eafcafd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.175315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.177046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.178113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.178580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.180036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.187359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.233598 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1826/3673] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:01 2021] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:01.240105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.266631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e65f-752b-4438-98de-8d16849bd491 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.273741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a112ec-811f-47d7-a32c-2deefc4b6f18 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.277493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.280155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.280508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.281323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.283505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.285272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.323763 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1827/3674] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:01 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:01.325353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.350997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799b370-b865-46ed-8e61-d77d1f11d7d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.360183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.361028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.361303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.366054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.368824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.370445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.400251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1828/3675] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:01 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:01.402474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.404589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.405437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.406266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.406877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/485b70f065e04ad6974c9f078334c7fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.409846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b70f065e04ad6974c9f078334c7fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.413501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.426399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1848/3676] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:03:00 2021] GET /identity/v3/projects/485b70f065e04ad6974c9f078334c7fc => generated 371 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:01.427854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963d49-2c40-4d0f-bb99-3d4f5d423768 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.446280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.447464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.447736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.448005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] PATH_INFO: `/v3/projects/585a6f2499c34f26858644df7766f02a/users/c2d5529925414004b01df2f66f5ae53e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.458929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.481322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585a6f2499c34f26858644df7766f02a, user_id=c2d5529925414004b01df2f66f5ae53e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.488447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9442-91f1-4e98-856b-1507fc93c7a2 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.489820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b35731-49bf-4a9f-872f-3646efd68002 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.508846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.510015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.515319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.518156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/users/894fa4b704304194805fb355615f577c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.526391 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1829/3677] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:01 2021] PUT /identity/v3/projects/585a6f2499c34f26858644df7766f02a/users/c2d5529925414004b01df2f66f5ae53e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:01.538287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.541876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.542048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.569856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:delete_user(user_id=894fa4b704304194805fb355615f577c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.574004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.619096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] MFA Rules not processed for user `c2d5529925414004b01df2f66f5ae53e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:01.621573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:01.679755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894fa4b704304194805fb355615f577c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.697120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894fa4b704304194805fb355615f577c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.700312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894fa4b704304194805fb355615f577c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.701077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894fa4b704304194805fb355615f577c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.715914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894fa4b704304194805fb355615f577c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.752835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1849/3678] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:01 2021] DELETE /identity/v3/users/894fa4b704304194805fb355615f577c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:01.753903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.755616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:01.792350 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1830/3679] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:01 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:01.795789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:01.812816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:01.846580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e24-db44-4b0a-b3bd-a94a7b970562 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.864020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:01.864935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:01.865490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:01.865776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/485b70f065e04ad6974c9f078334c7fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:01.868534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=485b70f065e04ad6974c9f078334c7fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:01.875018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:01.951280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485b70f065e04ad6974c9f078334c7fc', 'request_id': 'req-57360510-a995-4a17-88bb-ba6acb1d1f3a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.958945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485b70f065e04ad6974c9f078334c7fc', 'request_id': 'req-57360510-a995-4a17-88bb-ba6acb1d1f3a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.967261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485b70f065e04ad6974c9f078334c7fc', 'request_id': 'req-57360510-a995-4a17-88bb-ba6acb1d1f3a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.979434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a571c0a-35d9-4c74-ac02-61e8d61da816 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:01.997064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] The token cache is being invalidate because project 485b70f065e04ad6974c9f078334c7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:01.997337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:01.999011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:02.003781 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1850/3680] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:01 2021] DELETE /identity/v3/projects/485b70f065e04ad6974c9f078334c7fc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:02.083773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.085184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.085534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.085817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.086625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.091617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a6005-1cd9-4d8e-bdb7-cddd25df8675 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.138853 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1831/3681] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:01 2021] POST /identity/v3/projects => generated 389 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:02.145485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:02.146970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:02.159915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.161298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.161579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.193840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57360510-a995-4a17-88bb-ba6acb1d1f3a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:02.217975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] MFA Rules not processed for user `5bd148dc620a41cf9e5e817216c7c67d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:02.219191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:02.332699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.333482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.333818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.334290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.335270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.339783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.362897 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1832/3682] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:02 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:02.376167 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1851/3683] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:02 2021] POST /identity/v3/users => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:02.380513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:02.392241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36e265-6407-4c78-96b3-1710eaadd26f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:02.399352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.400189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.400526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.400832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.401580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.403290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.418823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1833/3684] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:02.419510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:02.433178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591d218-b381-4586-b1c1-f5c69571d4cb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:02.444825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.446543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.447592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.448076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] PATH_INFO: `/v3/projects/9005462182c64455830235fbda3dbde3/users/34faab32060e476dbc4d6fa9a9411156/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.488006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9005462182c64455830235fbda3dbde3, user_id=34faab32060e476dbc4d6fa9a9411156, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.494963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.533801 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1852/3685] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:02 2021] PUT /identity/v3/projects/9005462182c64455830235fbda3dbde3/users/34faab32060e476dbc4d6fa9a9411156/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:02.534146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:02.548477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cca839-2053-4031-b15d-074c5902c53a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:02.700928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.701623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.702396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.702714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.703490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.707224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb793c89-e206-463c-b0b4-cc6128005ea1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.732822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1834/3686] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:02.734048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:02.759950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaabbe-d25d-4427-be11-9daaf9e85049 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:02.765173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:02.767213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.767830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.768272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] PATH_INFO: `/v3/projects/9005462182c64455830235fbda3dbde3/users/34faab32060e476dbc4d6fa9a9411156/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.770780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9005462182c64455830235fbda3dbde3, user_id=34faab32060e476dbc4d6fa9a9411156, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:02.774353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e4ab-30b5-447f-8c92-6d1b22a7bcaf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:02.789045 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1853/3687] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:02 2021] PUT /identity/v3/projects/9005462182c64455830235fbda3dbde3/users/34faab32060e476dbc4d6fa9a9411156/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:02.800647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.801262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.801702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.884992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] MFA Rules not processed for user `34faab32060e476dbc4d6fa9a9411156`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:02.889934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:02.917411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:02.917693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:02.917966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:02.919729 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1854/3688] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:03:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:03:02.943793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:03:02.946471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:03.190980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1835/3689] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:02 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:03.205405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:03.207481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:03.325121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c63d8-3674-433f-8367-8e85746ecf6d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:03.331723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:03.332644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:03.332964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:03.333295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:03.335612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a66b93f8ae54386b0f5531e60591be6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:03.337738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4b0df-8c81-4de3-bc43-77349c2b395c tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:03.343168 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1855/3690] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:03:02 2021] GET /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6 => generated 375 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:03:03.724936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:03.745329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:03.745616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:03.746121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:03.748257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1856/3691] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:03:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:03:03.757697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:03:03.780051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:03.797407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca978a0-df1b-48ec-ab13-beb9207a78a3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:03.815772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:03.816964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:03.817400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:03.818976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:03.820829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a66b93f8ae54386b0f5531e60591be6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:03.823385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75afdd-688c-4f3a-b71c-ac78d1dff618 tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:03.835428 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1857/3692] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:03:03 2021] GET /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6 => generated 375 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:03:03.847640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4393d-5773-409c-a808-0a72e0535d2a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:03.855550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:03.858265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:03.858549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:03.858826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] PATH_INFO: `/v3/users/c2d5529925414004b01df2f66f5ae53e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:03.860211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d5529925414004b01df2f66f5ae53e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:03.862936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:03.921317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d5529925414004b01df2f66f5ae53e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:03.931296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d5529925414004b01df2f66f5ae53e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:03.932904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d5529925414004b01df2f66f5ae53e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:03.953908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d5529925414004b01df2f66f5ae53e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:03.965608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d5529925414004b01df2f66f5ae53e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:03.973941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1836/3693] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:03 2021] DELETE /identity/v3/users/c2d5529925414004b01df2f66f5ae53e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:03.978703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef23c-1cc2-47e3-be7c-c9e5b3eb0c9e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:03.979060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef23c-1cc2-47e3-be7c-c9e5b3eb0c9e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:03.979565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef23c-1cc2-47e3-be7c-c9e5b3eb0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:04.023606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a2eef23c-1cc2-47e3-be7c-c9e5b3eb0c9e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:04.027853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a2eef23c-1cc2-47e3-be7c-c9e5b3eb0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:04.126151 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1858/3694] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:04.292766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:04.296832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:04.372955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cfab-bc50-4d12-8dc9-4a45326a214f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:04.380029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:04.381795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:04.382594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:04.383083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:04.399422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:04.401735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:04.420902 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1837/3695] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:05.419185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:05.420636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:05.421088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:05.423260 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1859/3696] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:03:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:03:05.429383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:03:05.431143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:05.505464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:05.514671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:05.558581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d070a-16b4-4562-a61e-ded016b1dc3a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:05.572086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:05.577532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:05.579639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:05.585089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] PATH_INFO: `/v3/projects/585a6f2499c34f26858644df7766f02a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:05.587431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585a6f2499c34f26858644df7766f02a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:05.595134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:05.700957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:05.704426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:05.732847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585a6f2499c34f26858644df7766f02a', 'request_id': 'req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:05.740032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585a6f2499c34f26858644df7766f02a', 'request_id': 'req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:05.750283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585a6f2499c34f26858644df7766f02a', 'request_id': 'req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:05.775697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] The token cache is being invalidate because project 585a6f2499c34f26858644df7766f02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:05.776399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:05.777675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd66bdaf-5688-4ef2-a1f4-cd04c7166c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:05.783108 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1860/3697] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:05 2021] DELETE /identity/v3/projects/585a6f2499c34f26858644df7766f02a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:05.785681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:05.786113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:05.786760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:05.812279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] MFA Rules not processed for user `5bd148dc620a41cf9e5e817216c7c67d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:05.814219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:05.935955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d8491-805b-423f-a2ff-6944cf309630 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:05.958052 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1861/3698] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:05.958052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:05.959186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:06.043017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd65d26e07b6b4360ae1e3453727f8a21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d96df30e949476cabb07ae5da6427fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:06.043879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:06.044153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:06.044869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:06.050166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a66b93f8ae54386b0f5531e60591be6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:06.052235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:06.054438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1838/3699] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:03:05 2021] GET /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6 => generated 375 bytes in 626 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:06.139741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d774-656a-4787-b1e5-9319695b924e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:06.150467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:06.151411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:06.151711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:06.151973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] PATH_INFO: `/v3/users/34faab32060e476dbc4d6fa9a9411156` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:06.153336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34faab32060e476dbc4d6fa9a9411156)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:06.161146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:06.279230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34faab32060e476dbc4d6fa9a9411156'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:06.326563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34faab32060e476dbc4d6fa9a9411156'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:06.328657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34faab32060e476dbc4d6fa9a9411156'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:06.332175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34faab32060e476dbc4d6fa9a9411156'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:06.360451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81f6c0f3-1939-464b-b188-906241b8df40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34faab32060e476dbc4d6fa9a9411156'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:06.439058 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1862/3700] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:05 2021] DELETE /identity/v3/users/34faab32060e476dbc4d6fa9a9411156 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:06.831905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:06.841060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:06.897661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5a52-0608-4e23-a575-6368a8e67b1a tempest-QuotasAdminTestJSON-1556724537 tempest-QuotasAdminTestJSON-1556724537-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:07.026208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:07.027093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:07.027370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:07.027641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] PATH_INFO: `/v3/users/eed69df282d1442d8aceff91aed19dcd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:07.037608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed69df282d1442d8aceff91aed19dcd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:07.039549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:07.128496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed69df282d1442d8aceff91aed19dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:07.141753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed69df282d1442d8aceff91aed19dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:07.143383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed69df282d1442d8aceff91aed19dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:07.170889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed69df282d1442d8aceff91aed19dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:07.192567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed69df282d1442d8aceff91aed19dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:07.205177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1839/3701] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:06 2021] DELETE /identity/v3/users/eed69df282d1442d8aceff91aed19dcd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:07.209518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:07.209954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:07.210523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:07.245065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:07.249589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:07.441514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1863/3702] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:07.478965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:07.482173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:07.671566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e50a-e4f8-4e55-ae33-00b9856f55a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:07.681606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:07.682268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:07.682543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:07.682812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:07.701742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:07.703172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:07.719007 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1840/3703] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:08.676031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:08.678358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:08.742181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:08.745842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:08.797992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460077-b6b4-462e-b915-7610b4b7d9f4 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:08.811452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:08.813196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:08.814106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:08.815038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] PATH_INFO: `/v3/projects/9005462182c64455830235fbda3dbde3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:08.817344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9005462182c64455830235fbda3dbde3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:08.822542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:08.940951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a796c-75f9-4deb-b875-9e51411eeace None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:08.960790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:08.965310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:08.968846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:08.972409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:08.976081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:08.987894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9005462182c64455830235fbda3dbde3', 'request_id': 'req-2402a81b-9153-4dae-9ba6-2e29f81cd309'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:09.005852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9005462182c64455830235fbda3dbde3', 'request_id': 'req-2402a81b-9153-4dae-9ba6-2e29f81cd309'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:09.025503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9005462182c64455830235fbda3dbde3', 'request_id': 'req-2402a81b-9153-4dae-9ba6-2e29f81cd309'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:09.054735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] The token cache is being invalidate because project 9005462182c64455830235fbda3dbde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:09.055238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:09.056120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2402a81b-9153-4dae-9ba6-2e29f81cd309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:09.058471 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1841/3704] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:08 2021] DELETE /identity/v3/projects/9005462182c64455830235fbda3dbde3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:09.065882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.066405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.066982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.111835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:09.113726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:09.122344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.124218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03984ab0-ca78-430c-968c-1fbc6862cf40 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.142038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1864/3705] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:08 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:09.316233 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1842/3706] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:09.324177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.324462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.324887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.346355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:09.347588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:09.360658 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1865/3707] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:09.366195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.380007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd74a72-84f5-4fc0-b0af-e5223c35e00b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.391296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.392196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.393229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.398045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.399217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:09.400011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.402012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.415587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1843/3708] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:03:09.419834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.433947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c579f-f62a-4aaf-b945-126ec795346e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.442957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.443957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.444182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.444477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.449443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.452144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.493835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1866/3709] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:09 2021] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:09.498013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.510587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa99e25-7b47-42d3-929f-76f70cba1ec2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.646462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.649475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.649777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.650193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.650976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.653068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.700778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.722006 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1844/3710] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:09 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:09.732507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a40-8fbb-4253-aded-be0638d972b0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.746567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.747623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.748067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.748544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.749767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.753539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.770304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.785477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1867/3711] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:09 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:09.787640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df762b0-d1b8-4d1e-827e-0e6d6ce90340 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.809379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.810343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.810812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.811544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.812487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.828761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33fdb4-4488-4f1c-9257-95451decd1f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.861721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:09.875036 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1845/3712] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:09 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:09.880901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ddb4-81f9-42ff-9cdb-2f90922a6afc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:09.888292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:09.889719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.890707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.891154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] PATH_INFO: `/v3/projects/8bfd72b9218d4732a7ae6724e0a5bc0f/users/fe947d8492cf4c308874ededf54c10e4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.915453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfd72b9218d4732a7ae6724e0a5bc0f, user_id=fe947d8492cf4c308874ededf54c10e4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:09.919820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:09.974241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:09.974524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:09.974803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:09.976935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1868/3713] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:09 2021] PUT /identity/v3/projects/8bfd72b9218d4732a7ae6724e0a5bc0f/users/fe947d8492cf4c308874ededf54c10e4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:10.053342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] MFA Rules not processed for user `fe947d8492cf4c308874ededf54c10e4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:10.057495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:10.227826 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1846/3714] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:10.232169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.337369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a009f9-4baf-4632-95d1-8f69a4349925 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.352936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:10.354304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:10.354595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:10.354940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:10.355657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:10.358637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:10.424075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1869/3715] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:10 2021] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:10.427995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.460524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2315-243c-4473-997b-b2f69de0484c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.574996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:10.575912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:10.576248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:10.576658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:10.577749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:10.579782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:10.607407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.610140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:10.633300 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1847/3716] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:10 2021] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:10.637286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.637593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d235-6b15-4954-8b4e-705be2dd5013 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.648442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:10.650026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:10.650431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:10.650811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] PATH_INFO: `/v3/projects/0a66b93f8ae54386b0f5531e60591be6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:10.652199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a66b93f8ae54386b0f5531e60591be6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:10.654376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:10.669119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69548a-f2b0-4fd3-89e1-0d66df77d10c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.675331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:10.676915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:10.677600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:10.678027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:10.679471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:10.681910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:10.720314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1848/3717] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:10 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:10.726437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.734297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a66b93f8ae54386b0f5531e60591be6', 'request_id': 'req-c4ae9558-4730-4ed1-8874-ad83722832d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:10.743280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43867e15-6c1b-4c20-b9fc-36b2bd641dac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.743873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a66b93f8ae54386b0f5531e60591be6', 'request_id': 'req-c4ae9558-4730-4ed1-8874-ad83722832d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:10.756157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a66b93f8ae54386b0f5531e60591be6', 'request_id': 'req-c4ae9558-4730-4ed1-8874-ad83722832d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:10.782775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] The token cache is being invalidate because project 0a66b93f8ae54386b0f5531e60591be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:10.783218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:10.785260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:10.788238 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1870/3718] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:10 2021] DELETE /identity/v3/projects/0a66b93f8ae54386b0f5531e60591be6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:10.792396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.794029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:10.868552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:10.870112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:10.870636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:10.871138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] PATH_INFO: `/v3/projects/5268562d61b045b6bfa616d752cd1400/users/c0b12e544a894ac6b7b2fb2da803d682/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:10.887901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5268562d61b045b6bfa616d752cd1400, user_id=c0b12e544a894ac6b7b2fb2da803d682, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:10.891030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:10.911438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1849/3719] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:10 2021] PUT /identity/v3/projects/5268562d61b045b6bfa616d752cd1400/users/c0b12e544a894ac6b7b2fb2da803d682/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:10.915765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:10.917800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:10.926497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9558-4730-4ed1-8874-ad83722832d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:10.995131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e3-330f-40e9-a11a-5fbbd155dac3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:11.003039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.004059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.004437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.004881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.005869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.007783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.010576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.012311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.012701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.013045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] PATH_INFO: `/v3/users/d65d26e07b6b4360ae1e3453727f8a21` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.014376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65d26e07b6b4360ae1e3453727f8a21)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.018629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.023229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1850/3720] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:10 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:03:11.024199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:11.036193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22bc5f-49cb-496c-8a34-aa1937c88075 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:11.041753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.042844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.043285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.044195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] PATH_INFO: `/v3/projects/5268562d61b045b6bfa616d752cd1400/users/c0b12e544a894ac6b7b2fb2da803d682/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.047458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5268562d61b045b6bfa616d752cd1400, user_id=c0b12e544a894ac6b7b2fb2da803d682, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.051912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a700-4395-498c-8afb-f7efd2cf544f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.096070 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1851/3721] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:11 2021] PUT /identity/v3/projects/5268562d61b045b6bfa616d752cd1400/users/c0b12e544a894ac6b7b2fb2da803d682/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:11.097374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde8fe-4f8c-41a9-96c4-109925433e68 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.097851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde8fe-4f8c-41a9-96c4-109925433e68 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.098221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde8fe-4f8c-41a9-96c4-109925433e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.134027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65d26e07b6b4360ae1e3453727f8a21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:11.154739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65d26e07b6b4360ae1e3453727f8a21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:11.155855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65d26e07b6b4360ae1e3453727f8a21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:11.156477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65d26e07b6b4360ae1e3453727f8a21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:11.164027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-aefde8fe-4f8c-41a9-96c4-109925433e68 None None] MFA Rules not processed for user `c0b12e544a894ac6b7b2fb2da803d682`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:11.166305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aefde8fe-4f8c-41a9-96c4-109925433e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:11.172586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65d26e07b6b4360ae1e3453727f8a21'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:11.211200 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1871/3722] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:10 2021] DELETE /identity/v3/users/d65d26e07b6b4360ae1e3453727f8a21 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:11.212204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:11.214406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:11.305597 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1852/3723] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:11.308092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.309096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.309906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.351919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ee0a-a2bc-40b9-9531-93a142ba5728 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:11.366455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] MFA Rules not processed for user `09b38c47b50349aa941ebb113445259a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:11.367958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:11.370361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.371147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.385031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.386474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.388957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:11.507497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.513850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.556987 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1872/3724] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:11 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:11.557921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:11.560846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:11.563596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1853/3725] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:11.603973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98be8c-9e9c-4d9d-bb32-33d71ae18330 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:11.624356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.625567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.626099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.626678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.749593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.755315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.777929 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1873/3726] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:11 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:11.895942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:11.919318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee14ff-8179-4b15-9282-ac9c9c018efb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:11.937476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:11.940326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:11.941738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:11.942243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:11.958221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:11.959818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c8b30-dfcc-4c79-8f6e-a126cebc70d9 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:11.993810 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1854/3727] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:11 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:12.525344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:12.526569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:12.652977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80165-46fe-45a0-b1c5-34923a950276 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:12.666889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:12.667867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:12.668209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:12.668586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] PATH_INFO: `/v3/projects/9d96df30e949476cabb07ae5da6427fd` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:12.670878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d96df30e949476cabb07ae5da6427fd)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:12.673064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:12.780558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d96df30e949476cabb07ae5da6427fd', 'request_id': 'req-77e19911-68bc-4a74-8ba4-939c2cd20f06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:12.793916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d96df30e949476cabb07ae5da6427fd', 'request_id': 'req-77e19911-68bc-4a74-8ba4-939c2cd20f06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:12.811879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d96df30e949476cabb07ae5da6427fd', 'request_id': 'req-77e19911-68bc-4a74-8ba4-939c2cd20f06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:12.852794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] The token cache is being invalidate because project 9d96df30e949476cabb07ae5da6427fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:12.853089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:12.854772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:12.862231 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1874/3728] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:12 2021] DELETE /identity/v3/projects/9d96df30e949476cabb07ae5da6427fd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:12.869529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61afe2-9b48-4e1e-bedc-1501db9449e0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:12.870060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61afe2-9b48-4e1e-bedc-1501db9449e0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:12.870532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61afe2-9b48-4e1e-bedc-1501db9449e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:12.926615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:12.928055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:12.933849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1f61afe2-9b48-4e1e-bedc-1501db9449e0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:12.941138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f61afe2-9b48-4e1e-bedc-1501db9449e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:13.091809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19911-68bc-4a74-8ba4-939c2cd20f06 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.101074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1855/3729] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:13.107733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.107733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.107733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.107733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] PATH_INFO: `/v3/users/fe947d8492cf4c308874ededf54c10e4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.108142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe947d8492cf4c308874ededf54c10e4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.109511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.109809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.110072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.112426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.145722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:13.148333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:13.168369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1856/3730] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:13.172217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.187424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11e3c2-3f08-4ea1-8624-dff273aa03cc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.198906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.201743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.205720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.206886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.207856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:13.208524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.213055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe947d8492cf4c308874ededf54c10e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:13.214728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.236361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe947d8492cf4c308874ededf54c10e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:13.237257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe947d8492cf4c308874ededf54c10e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:13.237866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe947d8492cf4c308874ededf54c10e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:13.245248 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1857/3731] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:03:13.250581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.254717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:13.260075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-141bf329-9513-456a-9ce2-dd7475b9613d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe947d8492cf4c308874ededf54c10e4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:13.294402 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1875/3732] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:12 2021] DELETE /identity/v3/users/fe947d8492cf4c308874ededf54c10e4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:13.301350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.301695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.304032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.305421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115efec-b6c7-4fa3-ba9f-95ce80d96ea4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.343932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:13.346451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:13.449319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.450113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.450862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.450862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.451677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.453682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.516732 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1858/3733] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:13 2021] POST /identity/v3/projects => generated 393 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:13.520252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.555703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1876/3734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:13.580813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.584452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:13.708578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706cf1-c967-4aaa-941a-bb1b2612121b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.725134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.725134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.725704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.725704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.726125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.736549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.737144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111183-ce48-4bd3-9bdc-c1970504b3f4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.783665 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1859/3735] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:13 2021] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:13.786419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.814888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403c77-840a-4490-b67b-3793e8d71d74 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.826310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.827009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.827289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.827563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.828308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.829994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.859746 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1860/3736] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:13 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:13.864450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.899241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6641f5-69f9-4f7f-ab14-7aa15a6981ea admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:13.909353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.910735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.911631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.912279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.926125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:13.926865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:13.927063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:13.927795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:13.928741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.930527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e88d29-c4aa-4dd4-86b5-720fc0de72c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.933971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:13.943043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:13.969037 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1877/3737] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:13.971249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:13.972381 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1861/3738] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:13 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:13.994978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437669b5-8a00-48e3-8617-6a1186c78efe service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.020024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.020969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.021288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.021517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] PATH_INFO: `/v3/projects/44e60ca27e834896a209c46485c178e7/users/c8c7b8da9fad49dd841de183d89408f4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.053602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e60ca27e834896a209c46485c178e7, user_id=c8c7b8da9fad49dd841de183d89408f4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.056230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.083164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1878/3739] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:13 2021] PUT /identity/v3/projects/44e60ca27e834896a209c46485c178e7/users/c8c7b8da9fad49dd841de183d89408f4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:14.094082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416580f7-c950-468f-afd1-9189ba506797 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.094369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416580f7-c950-468f-afd1-9189ba506797 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.094643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416580f7-c950-468f-afd1-9189ba506797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.160653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-416580f7-c950-468f-afd1-9189ba506797 None None] MFA Rules not processed for user `c8c7b8da9fad49dd841de183d89408f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:14.162452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-416580f7-c950-468f-afd1-9189ba506797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:14.299914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1862/3740] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:14 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:14.304120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.429866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733039d-83d3-48d0-858b-301e7f3d11da admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.443049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.444275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.444565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.444871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.446353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.448644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.509548 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1879/3741] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:14 2021] POST /identity/v3/projects => generated 395 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:14.511072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416580f7-c950-468f-afd1-9189ba506797 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.524538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416580f7-c950-468f-afd1-9189ba506797 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.601325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.603674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.604174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.604552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.605736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.607993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.652916 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1863/3742] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:14 2021] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:14.659242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.675614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ed5-c9c1-4ff9-a6a5-36b7ca856b4b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.684439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.685637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.686168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.686628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.687965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.691885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.711895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.755805 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1880/3743] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:14.759409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263e60-10ef-4a8d-b695-18e78847358e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.765355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.768912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.769456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.769882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] PATH_INFO: `/v3/projects/440118d612b34003bed95bffaa02fc3a/users/bbb752c65ee0435b8a042cbacafe4787/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.806365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=440118d612b34003bed95bffaa02fc3a, user_id=bbb752c65ee0435b8a042cbacafe4787, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.811028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.840911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1864/3744] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:14 2021] PUT /identity/v3/projects/440118d612b34003bed95bffaa02fc3a/users/bbb752c65ee0435b8a042cbacafe4787/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:14.845843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.862004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75b6d-9ef9-47e1-a920-d3de4d710bed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.934178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.935581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.936055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:14.936539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:14.937556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:14.943765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58175e6-e605-4085-9459-23f5e56eb552 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:14.960189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1881/3745] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:14.964030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:14.978406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ecda5-2453-4670-ba48-d2dea980cf6e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:14.994520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:14.995837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:14.996325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:15.002940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] PATH_INFO: `/v3/projects/440118d612b34003bed95bffaa02fc3a/users/bbb752c65ee0435b8a042cbacafe4787/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:15.006078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440118d612b34003bed95bffaa02fc3a, user_id=bbb752c65ee0435b8a042cbacafe4787, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:15.009308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1e7ed-dfbd-4f5a-96b4-4fd795a3ec12 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:15.023394 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1865/3746] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:14 2021] PUT /identity/v3/projects/440118d612b34003bed95bffaa02fc3a/users/bbb752c65ee0435b8a042cbacafe4787/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:15.035348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:15.036504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:15.037009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:15.078692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] MFA Rules not processed for user `bbb752c65ee0435b8a042cbacafe4787`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:15.080797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:15.207700 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1882/3747] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:15.209035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:15.209325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:15.209600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:15.243210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] MFA Rules not processed for user `c8c7b8da9fad49dd841de183d89408f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:15.244925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:15.259338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:15.260818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:15.411277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1866/3748] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:15.413348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632f15-8c8c-4c73-8b59-7fadfe5f0996 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:15.421999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:15.423061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:15.423972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:15.424535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] PATH_INFO: `/v3/projects/8bfd72b9218d4732a7ae6724e0a5bc0f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:15.433712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfd72b9218d4732a7ae6724e0a5bc0f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:15.433712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:15.522144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfd72b9218d4732a7ae6724e0a5bc0f', 'request_id': 'req-fddc312e-2583-448a-b37b-532c056bea29'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.527786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfd72b9218d4732a7ae6724e0a5bc0f', 'request_id': 'req-fddc312e-2583-448a-b37b-532c056bea29'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.536536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfd72b9218d4732a7ae6724e0a5bc0f', 'request_id': 'req-fddc312e-2583-448a-b37b-532c056bea29'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.562344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] The token cache is being invalidate because project 8bfd72b9218d4732a7ae6724e0a5bc0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:15.562344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.562666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.565596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1883/3749] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:15 2021] DELETE /identity/v3/projects/8bfd72b9218d4732a7ae6724e0a5bc0f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:15.569535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:15.596129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e73b0c-e9a6-4a38-ae8a-ad88a07e8bb1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:15.725925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:15.728812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:15.731507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:15.731858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] PATH_INFO: `/v3/users/c0b12e544a894ac6b7b2fb2da803d682` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:15.733381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b12e544a894ac6b7b2fb2da803d682)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:15.743230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:15.849038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b12e544a894ac6b7b2fb2da803d682'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.857379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b12e544a894ac6b7b2fb2da803d682'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.858802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b12e544a894ac6b7b2fb2da803d682'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.876702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b12e544a894ac6b7b2fb2da803d682'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.892480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b12e544a894ac6b7b2fb2da803d682'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:15.907405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1867/3750] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:15 2021] DELETE /identity/v3/users/c0b12e544a894ac6b7b2fb2da803d682 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:16.154638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:16.156096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:16.263514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc312e-2583-448a-b37b-532c056bea29 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:16.375323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:16.376269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:16.376524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:16.376957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:16.379675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:16.486413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:16.488664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477c0aa-8f8f-4105-a9c2-df2b311cbbd8 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:16.519065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1884/3751] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:16 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:17.162182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:17.163625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:17.294308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdc43-99b2-4bda-94b9-f4c0f5e3d244 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:17.312397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:17.313803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:17.314296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:17.314743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] PATH_INFO: `/v3/projects/5268562d61b045b6bfa616d752cd1400` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:17.316803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5268562d61b045b6bfa616d752cd1400)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:17.318470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:17.405549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5268562d61b045b6bfa616d752cd1400', 'request_id': 'req-4548f939-465e-4af1-9f01-288719092c45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:17.421067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5268562d61b045b6bfa616d752cd1400', 'request_id': 'req-4548f939-465e-4af1-9f01-288719092c45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:17.428597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5268562d61b045b6bfa616d752cd1400', 'request_id': 'req-4548f939-465e-4af1-9f01-288719092c45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:17.462194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] The token cache is being invalidate because project 5268562d61b045b6bfa616d752cd1400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:17.462735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:17.463608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4548f939-465e-4af1-9f01-288719092c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:17.465690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1868/3752] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:17 2021] DELETE /identity/v3/projects/5268562d61b045b6bfa616d752cd1400 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:17.471931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:17.472824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:17.473281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:17.505617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:17.506779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:17.653589 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1885/3753] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:17.657044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:17.657329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:17.658123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:17.698934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:17.700158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:17.718369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1869/3754] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:17.723273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:17.734102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfe508-5767-4e29-88a1-13c8d5feae4c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:17.746045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:17.746736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:17.747017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:17.747280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:17.748032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:17.748331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:17.750179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:17.793283 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1886/3755] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:17.797793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:17.812707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dd6f9-7dd1-40e7-8fa0-385cda977436 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:17.840356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:17.841277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:17.841717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:17.842137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:17.843317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:17.846268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:17.935400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1870/3756] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:17 2021] POST /identity/v3/projects => generated 397 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:17.936631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:17.963100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75628a-5df9-417e-bb27-0f9ba47514af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.049910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.051292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.051783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.052162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.053168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.055808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.099091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1887/3757] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:17 2021] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:18.103386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.118955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce0f9f-d544-4633-b185-5f933b663016 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.129300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.130408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.130888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.131407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.132348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.134327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.147459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1871/3758] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:18.151487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.164153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32fdb-d7fe-44a3-8605-209601936309 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.169584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.170456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.170918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.171252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.171994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.174302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfef0c-55ab-42ba-90c8-6b61fe419d9c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.187730 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1888/3759] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:18 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:18.192373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.207303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d32d-3b65-4255-bbda-4bbe0c34956a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.213319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929576b-650f-4223-9179-f73520816749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.214202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929576b-650f-4223-9179-f73520816749 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.214490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929576b-650f-4223-9179-f73520816749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.214750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929576b-650f-4223-9179-f73520816749 admin admin] PATH_INFO: `/v3/projects/e5039c3883514a808b74a968b6f568f5/users/1d832fa21e3d455997231c38b1294161/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.264598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929576b-650f-4223-9179-f73520816749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5039c3883514a808b74a968b6f568f5, user_id=1d832fa21e3d455997231c38b1294161, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.268397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929576b-650f-4223-9179-f73520816749 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.292946 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1872/3760] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:18 2021] PUT /identity/v3/projects/e5039c3883514a808b74a968b6f568f5/users/1d832fa21e3d455997231c38b1294161/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:18.307108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.307703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.308194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.360301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] MFA Rules not processed for user `1d832fa21e3d455997231c38b1294161`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:18.363066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:18.453547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1889/3761] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:18.462502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929576b-650f-4223-9179-f73520816749 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.560198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929576b-650f-4223-9179-f73520816749 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.565987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.566718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.567059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.567399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.568213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.570627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.601556 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1873/3762] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:18 2021] POST /identity/v3/projects => generated 399 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:18.606456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.622263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03bc58-5c59-4da9-b11f-f3f80c54d451 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.724259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.725477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.725762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.726037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.727870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.730054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.781573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.783857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1890/3763] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:18 2021] POST /identity/v3/users => generated 306 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:18.801580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b5d7-6818-49e7-be26-c22f106a2854 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.810994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.811787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.812288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.812724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.813569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.815641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.835180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1874/3764] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:18 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:18.838222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.855513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088322-7811-47a3-be09-59161ddfc958 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:18.871364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:18.872508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:18.873720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:18.874025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] PATH_INFO: `/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a/users/a50efb5e430c4143895e6564a56f7435/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:18.900180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c866b50d26b4f838d3d27aaf03c3f3a, user_id=a50efb5e430c4143895e6564a56f7435, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:18.905404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:18.948258 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1891/3765] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:18 2021] PUT /identity/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a/users/a50efb5e430c4143895e6564a56f7435/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:18.948502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:18.966093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d4bd-81f7-42a2-822c-e22c9bb73183 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:19.109565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:19.110250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:19.110555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:19.111405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:19.112147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:19.113831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e90a1-d18e-4b86-8a1e-d14e90dea22d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:19.133434 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1875/3766] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:18 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:19.137394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:19.148308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10265a2-6ab7-4dd2-b324-bf1bdf3f3f8e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:19.153293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:19.154751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:19.155158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:19.155540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] PATH_INFO: `/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a/users/a50efb5e430c4143895e6564a56f7435/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:19.158353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c866b50d26b4f838d3d27aaf03c3f3a, user_id=a50efb5e430c4143895e6564a56f7435, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:19.161203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:19.178335 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1892/3767] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:19 2021] PUT /identity/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a/users/a50efb5e430c4143895e6564a56f7435/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:19.188077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be604-9026-48af-af35-4b0279725cec None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:19.188421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be604-9026-48af-af35-4b0279725cec None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:19.188699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be604-9026-48af-af35-4b0279725cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:19.219380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c55be604-9026-48af-af35-4b0279725cec None None] MFA Rules not processed for user `a50efb5e430c4143895e6564a56f7435`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:19.221219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c55be604-9026-48af-af35-4b0279725cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:19.304977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1876/3768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:19 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:19.648542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:19.650757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:19.743935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcee9-2903-401b-8ec8-8b61cbe88968 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:19.751063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:19.751989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:19.752431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:19.753214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:19.838888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:19.842422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:19.854628 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1893/3769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:19 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:21.224732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55be604-9026-48af-af35-4b0279725cec None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:21.226844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c55be604-9026-48af-af35-4b0279725cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:21.248380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55be604-9026-48af-af35-4b0279725cec None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:21.256488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:21.257603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:21.258753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:21.259255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:21.272082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:21.274133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e3cda-5af2-412d-aa1e-9c25bef8315a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:21.300380 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1877/3770] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:21 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:22.898257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:22.998551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a3ec-69da-4e96-8cf0-f0264d7b5b82 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:23.010887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:23.012251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:23.012842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:23.014359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] PATH_INFO: `/v3/users/1d832fa21e3d455997231c38b1294161` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:23.030552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d832fa21e3d455997231c38b1294161)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:23.036178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:23.160401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d832fa21e3d455997231c38b1294161'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.170550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d832fa21e3d455997231c38b1294161'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.171954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d832fa21e3d455997231c38b1294161'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.172811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d832fa21e3d455997231c38b1294161'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.187858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d832fa21e3d455997231c38b1294161'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.215257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1894/3771] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:22 2021] DELETE /identity/v3/users/1d832fa21e3d455997231c38b1294161 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:23.222565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:23.223044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:23.223239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:23.245803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:23.247832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:23.355590 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1878/3772] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:23.380099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:23.382001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:23.491622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c35d1-629a-4c3b-8edf-a228b4d3a771 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:23.495692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:23.496651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:23.496773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:23.497185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:23.510614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:23.512315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:23.527341 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1895/3773] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:23.707845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:23.709633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:23.732467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81a56-df0a-4d33-9cb0-bb5ee26d1795 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:23.744471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:23.745820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:23.746380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:23.746746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] PATH_INFO: `/v3/users/09b38c47b50349aa941ebb113445259a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:23.748760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b38c47b50349aa941ebb113445259a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:23.752226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:23.846228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b38c47b50349aa941ebb113445259a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.853607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b38c47b50349aa941ebb113445259a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.854326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b38c47b50349aa941ebb113445259a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.868847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b38c47b50349aa941ebb113445259a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.880128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b38c47b50349aa941ebb113445259a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:23.891046 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1879/3774] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:23 2021] DELETE /identity/v3/users/09b38c47b50349aa941ebb113445259a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:24.298952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:24.301231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:24.330916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eff19-1b49-49b3-82fc-e51217001770 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:24.379648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:24.381122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:24.424997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:24.425834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.426109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.426696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] PATH_INFO: `/v3/projects/e5039c3883514a808b74a968b6f568f5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.429483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5039c3883514a808b74a968b6f568f5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:24.432226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:24.491027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5039c3883514a808b74a968b6f568f5', 'request_id': 'req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.502460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368bb80-8307-4b24-910f-4012d6241032 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:24.513820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5039c3883514a808b74a968b6f568f5', 'request_id': 'req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.525376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5039c3883514a808b74a968b6f568f5', 'request_id': 'req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.558872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] The token cache is being invalidate because project e5039c3883514a808b74a968b6f568f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:24.559288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.560213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.562506 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1896/3775] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:24 2021] DELETE /identity/v3/projects/e5039c3883514a808b74a968b6f568f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:24.566846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:24.568405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:24.609334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:24.610212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.611249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.611539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] PATH_INFO: `/v3/projects/ef217b4cab3548e79a8d5ea2b300d5e2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.616233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef217b4cab3548e79a8d5ea2b300d5e2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:24.621135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:24.680681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef217b4cab3548e79a8d5ea2b300d5e2', 'request_id': 'req-cf16c3ec-1a3e-431a-a341-b06b664184c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.687972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef217b4cab3548e79a8d5ea2b300d5e2', 'request_id': 'req-cf16c3ec-1a3e-431a-a341-b06b664184c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.698801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef217b4cab3548e79a8d5ea2b300d5e2', 'request_id': 'req-cf16c3ec-1a3e-431a-a341-b06b664184c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.716173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] The token cache is being invalidate because project ef217b4cab3548e79a8d5ea2b300d5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:24.716810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.717707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cf16c3ec-1a3e-431a-a341-b06b664184c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.719997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1880/3776] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:24 2021] DELETE /identity/v3/projects/ef217b4cab3548e79a8d5ea2b300d5e2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:24.726251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a60c-da93-4fe7-bd06-cd157a72a39b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.726796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a60c-da93-4fe7-bd06-cd157a72a39b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.727060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a60c-da93-4fe7-bd06-cd157a72a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.732264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81dd8-91cb-4d85-bb35-2360ce971cc3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:24.763637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1305a60c-da93-4fe7-bd06-cd157a72a39b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:24.765377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1305a60c-da93-4fe7-bd06-cd157a72a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:24.802838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:24.803718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.804166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.804376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] PATH_INFO: `/v3/users/a50efb5e430c4143895e6564a56f7435` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.806249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50efb5e430c4143895e6564a56f7435)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:24.811525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:24.842840 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1881/3777] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:24.851891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.852480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.852847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.872880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:24.874374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:24.874674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50efb5e430c4143895e6564a56f7435'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.883645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50efb5e430c4143895e6564a56f7435'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.884413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50efb5e430c4143895e6564a56f7435'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.885149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50efb5e430c4143895e6564a56f7435'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.898055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50efb5e430c4143895e6564a56f7435'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:24.901009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1882/3778] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:24.905906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:24.920835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbe0a-9be3-4b4b-b5b8-029f715fee30 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:24.927625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:24.928456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:24.928786 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1897/3779] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:24 2021] DELETE /identity/v3/users/a50efb5e430c4143895e6564a56f7435 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:24.931580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:24.931868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:24.932672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:24.933142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:24.934909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:24.953016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1883/3780] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:24.955571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.017892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220276b6-6f74-4932-b40f-603cf1041b87 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.023163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.023815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.024093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.024489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.025255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.027123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.056631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1898/3781] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:24 2021] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:25.057718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.068766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a46c-8949-4dff-b346-f86e33e6d3f4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.125579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.126244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.126527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.126819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.127512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.129466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.153451 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1884/3782] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:25 2021] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:25.156391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.167386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795b8d-dd79-49c9-8306-fd6a4160503a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.172314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.173617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.173903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.174426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.174911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.176582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.187562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1899/3783] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:25.191522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.202848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a36-cfcf-4d52-a15a-2cdd1d9fa258 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.208257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.208975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.209251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.209545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.210271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.211891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cbf78-f132-4fc7-ad1c-6f39f7e681be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.225620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1885/3784] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:25.226951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.237620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2f6f-eb4c-4181-b940-ec39dfc1c7b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.242626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.243819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.244125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.244481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] PATH_INFO: `/v3/projects/5b4fde48f24f4816be46ccf5bd4474ae/users/6a5d3b0c43df4f64beea65d474a49dbf/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.262244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4fde48f24f4816be46ccf5bd4474ae, user_id=6a5d3b0c43df4f64beea65d474a49dbf, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.264939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.297180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1900/3785] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:25 2021] PUT /identity/v3/projects/5b4fde48f24f4816be46ccf5bd4474ae/users/6a5d3b0c43df4f64beea65d474a49dbf/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:25.302881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.303093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.303582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.332405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:25.334094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:25.453071 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1886/3786] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:25.471357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.473264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:25.607976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a98ad-e0f9-4098-ae52-e5d9c573050c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.613753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.615359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.615641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.615971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.629810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.631911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381146-1cb4-4c22-b760-c7b677027419 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.637664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:25.639573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:25.648904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1901/3787] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:25.659041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcd829-ec74-4fb1-9c58-5cafe7c11e8c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:25.665925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:25.667005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.673629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.677091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] PATH_INFO: `/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.678773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c866b50d26b4f838d3d27aaf03c3f3a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:25.681051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:25.744316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c866b50d26b4f838d3d27aaf03c3f3a', 'request_id': 'req-1c57be1d-2791-4fc5-9058-e380094a30af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:25.750737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c866b50d26b4f838d3d27aaf03c3f3a', 'request_id': 'req-1c57be1d-2791-4fc5-9058-e380094a30af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:25.760216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c866b50d26b4f838d3d27aaf03c3f3a', 'request_id': 'req-1c57be1d-2791-4fc5-9058-e380094a30af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:25.777482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] The token cache is being invalidate because project 2c866b50d26b4f838d3d27aaf03c3f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:25.777820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:25.778816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1c57be1d-2791-4fc5-9058-e380094a30af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:25.780681 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1887/3788] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:25 2021] DELETE /identity/v3/projects/2c866b50d26b4f838d3d27aaf03c3f3a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:25.786822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.787347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.787868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.816697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:25.818918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:25.938459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1902/3789] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:25.945892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:25.946360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:25.947243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:25.983545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:25.985042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:26.011538 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1888/3790] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:26.012756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.028128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f638942-3a26-4c14-831b-59e6e5dd5b47 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.032890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.033552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.033929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.034214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.034952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:26.035255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.036854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.052649 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1903/3791] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:26.056634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.072246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a9172-e6a5-4e24-9675-a309314a1426 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.079539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.080332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.080732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.081013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.082525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.084699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.118238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1889/3792] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:26 2021] POST /identity/v3/projects => generated 407 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:26.123087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.138765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea09c75-b0c4-4b24-a27a-02e6ad389870 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.230601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.231623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.232171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.232667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.233695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.237708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.278828 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1904/3793] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:26 2021] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:26.279125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.293740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522594bc-010d-400a-baac-488ca6a287c1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.309793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.310416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.310697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.310968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.311974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.313795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.350101 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1890/3794] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:26 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:26.353813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.365761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15414e87-1b17-429f-91b8-d69c862ba721 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.372570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.374001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.374001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.374001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.374996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.376904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38d10-2069-4088-a10e-24bd49c3a1b7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.392355 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1905/3795] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:26 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:26.393564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.405343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de0a6-a00b-4a69-b1b9-b7bdd6db6c7f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.412740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.413882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.414431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.414872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] PATH_INFO: `/v3/projects/a9a1404adcbe496cbea122282a1cac71/users/a208ce896b0d4dac8e1adf447fe8adc9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.437880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1404adcbe496cbea122282a1cac71, user_id=a208ce896b0d4dac8e1adf447fe8adc9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.442555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.477727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1891/3796] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:26 2021] PUT /identity/v3/projects/a9a1404adcbe496cbea122282a1cac71/users/a208ce896b0d4dac8e1adf447fe8adc9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:26.478966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.479729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.480184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.509729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] MFA Rules not processed for user `a208ce896b0d4dac8e1adf447fe8adc9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:26.511559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:26.618089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1906/3797] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:26 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:26.623434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.700942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:26.702536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:26.759677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c10b9-db6a-4f10-b450-e6e3ad80f5f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.774160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.775210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.775210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.775534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.776251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.782088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c836d-2f00-4957-a3cd-b7d96cfe67cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:26.826558 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1892/3798] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:26 2021] POST /identity/v3/projects => generated 409 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:26.827226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5db12e-118e-4185-9bca-82a17e10fb72 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:26.832789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.833184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.833534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.890127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] MFA Rules not processed for user `6a5d3b0c43df4f64beea65d474a49dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:26.895888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:26.952155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:26.953205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:26.953543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:26.954848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] PATH_INFO: `/v3/users/3d562b95e9754d9ab609f55149264a1f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:26.956291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d562b95e9754d9ab609f55149264a1f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:26.958585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.031854 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1893/3799] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:27.034011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.043910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d562b95e9754d9ab609f55149264a1f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.052834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d562b95e9754d9ab609f55149264a1f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.055280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d562b95e9754d9ab609f55149264a1f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.057417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d562b95e9754d9ab609f55149264a1f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.059765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c7903-2c66-470b-9c9c-185ad11ff01a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.070113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.070780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.071160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.071478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.073183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.075629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d562b95e9754d9ab609f55149264a1f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.078072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.109798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1907/3800] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:26 2021] DELETE /identity/v3/users/3d562b95e9754d9ab609f55149264a1f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:27.113421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.115444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.119818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1894/3801] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:27 2021] POST /identity/v3/users => generated 311 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:27.123726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.126914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.158159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfce8-a377-4d3a-a9af-a9bc28b6a340 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.246671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.247381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.247662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.248024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.248722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.251843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.256456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42da22-20d5-4c70-b33d-b582e1a9ea0b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.263179 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1895/3802] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:27.266418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.267899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.268519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.269192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.269763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.273163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.279633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013935d1-844d-4f0e-9841-9f420c8e478e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.288706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.289624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.289899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.290181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] PATH_INFO: `/v3/projects/8c27cfab455c4904a4983025ac850926/users/8162044c27ad41d38bb61a7211e6842a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.323367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c27cfab455c4904a4983025ac850926, user_id=8162044c27ad41d38bb61a7211e6842a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.327408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.349041 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1896/3803] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:27 2021] PUT /identity/v3/projects/8c27cfab455c4904a4983025ac850926/users/8162044c27ad41d38bb61a7211e6842a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:27.352984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.376784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.379828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.415867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1908/3804] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:27.451168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbd28d-6484-45b1-b884-c435f365565a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.458352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.459927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.473062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.473746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.474042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.474316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.475121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.478095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.484442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6d5c7-7e3e-4934-98e7-03c65fb4ec49 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.495124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.495989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.496309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.499355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] PATH_INFO: `/v3/projects/7655217687404358b22f9cce643f889b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.502234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7655217687404358b22f9cce643f889b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.504456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1897/3805] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:27.505359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.505833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.526079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ae17-f3b9-48e5-b28e-4ad2dd116d6e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.532905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.533749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.534171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.534509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] PATH_INFO: `/v3/projects/8c27cfab455c4904a4983025ac850926/users/8162044c27ad41d38bb61a7211e6842a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.539207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c27cfab455c4904a4983025ac850926, user_id=8162044c27ad41d38bb61a7211e6842a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.539850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc61042-257e-47db-a9d9-6c1e8b0bdc7e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.553958 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1898/3806] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:27 2021] PUT /identity/v3/projects/8c27cfab455c4904a4983025ac850926/users/8162044c27ad41d38bb61a7211e6842a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:27.569346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce144-3868-4802-9306-b335d5022521 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.569778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce144-3868-4802-9306-b335d5022521 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.570342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce144-3868-4802-9306-b335d5022521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.600755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7655217687404358b22f9cce643f889b', 'request_id': 'req-17221aa0-5819-49da-8cf8-98cb5cad8aa1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.607496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7655217687404358b22f9cce643f889b', 'request_id': 'req-17221aa0-5819-49da-8cf8-98cb5cad8aa1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.615707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7655217687404358b22f9cce643f889b', 'request_id': 'req-17221aa0-5819-49da-8cf8-98cb5cad8aa1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.624146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2acce144-3868-4802-9306-b335d5022521 None None] MFA Rules not processed for user `8162044c27ad41d38bb61a7211e6842a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:27.625731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2acce144-3868-4802-9306-b335d5022521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.634165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] The token cache is being invalidate because project 7655217687404358b22f9cce643f889b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:27.634700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.635464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.637530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1909/3807] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:27 2021] DELETE /identity/v3/projects/7655217687404358b22f9cce643f889b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:27.641808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:27.643368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:27.734062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221aa0-5819-49da-8cf8-98cb5cad8aa1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:27.741932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:27.743131 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1899/3808] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:27 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:27.743320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:27.743535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:27.743706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] PATH_INFO: `/v3/users/be8dd8a65ab4483db5af785793b49f0e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:27.745197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8dd8a65ab4483db5af785793b49f0e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:27.747643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:27.805488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8dd8a65ab4483db5af785793b49f0e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.815204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8dd8a65ab4483db5af785793b49f0e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.816695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8dd8a65ab4483db5af785793b49f0e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.816964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8dd8a65ab4483db5af785793b49f0e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.829238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8dd8a65ab4483db5af785793b49f0e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:27.864295 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1910/3809] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:27 2021] DELETE /identity/v3/users/be8dd8a65ab4483db5af785793b49f0e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:28.012451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acce144-3868-4802-9306-b335d5022521 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:28.014218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2acce144-3868-4802-9306-b335d5022521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.091590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acce144-3868-4802-9306-b335d5022521 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:28.142892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:28.144687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.171792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:28.173595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:28.174170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:28.174451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:28.183752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.233221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81625b9-3907-4e6f-bc7c-ad2faf098117 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:28.238015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:28.238868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:28.239149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:28.239421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] PATH_INFO: `/v3/projects/2976e91e76fb49708cea967d14664da1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:28.240667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2976e91e76fb49708cea967d14664da1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:28.242578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:28.256239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:28.257932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1857f-dd7e-48bd-89ea-1b24ae4244ce service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:28.269632 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1900/3810] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:28 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:28.298132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:28.298472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:28.298725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:28.311807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2976e91e76fb49708cea967d14664da1', 'request_id': 'req-3c1c86c3-d003-4507-8744-e55725210d4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:28.318626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2976e91e76fb49708cea967d14664da1', 'request_id': 'req-3c1c86c3-d003-4507-8744-e55725210d4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:28.326129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2976e91e76fb49708cea967d14664da1', 'request_id': 'req-3c1c86c3-d003-4507-8744-e55725210d4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:28.331879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] MFA Rules not processed for user `5ce44da17b9e472cbe7198389c3eeedb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:28.333132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.347272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] The token cache is being invalidate because project 2976e91e76fb49708cea967d14664da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:28.347565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:28.348307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:28.350682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1911/3811] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:28 2021] DELETE /identity/v3/projects/2976e91e76fb49708cea967d14664da1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:28.417202 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1901/3812] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:28 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:28.710949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:28.712600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.786289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c86c3-d003-4507-8744-e55725210d4e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:28.791853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:28.792509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:28.792798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:28.793067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:28.794847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:28.855617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:28.857230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209a8c-4eef-46bb-83dc-24a8987e637e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:28.867336 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1912/3813] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:28 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:29.437942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:29.439536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:29.523258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548aa2-5d8f-4c3b-ac33-b55692444049 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:29.537878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:29.540054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:29.540335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:29.540903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] PATH_INFO: `/v3/users/a208ce896b0d4dac8e1adf447fe8adc9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:29.542524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a208ce896b0d4dac8e1adf447fe8adc9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:29.546385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:29.614933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a208ce896b0d4dac8e1adf447fe8adc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:29.623251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a208ce896b0d4dac8e1adf447fe8adc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:29.624031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a208ce896b0d4dac8e1adf447fe8adc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:29.651743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a208ce896b0d4dac8e1adf447fe8adc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:29.676711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a208ce896b0d4dac8e1adf447fe8adc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:29.694657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1902/3814] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:29 2021] DELETE /identity/v3/users/a208ce896b0d4dac8e1adf447fe8adc9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:29.696376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:29.696939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:29.697224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:29.729605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:29.731427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:29.828698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1913/3815] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:29.838494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:29.843448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:29.922404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380dad-3ad4-44ad-870b-4e19e93e5b57 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:29.927420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:29.928172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:29.928547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:29.929227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:29.944251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:29.946078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:29.958190 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1903/3816] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:30.119332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:30.121120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:30.135272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df7bb7-48c6-49cf-8310-0738522ced35 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:30.163407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:30.164300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:30.164583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:30.164907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] PATH_INFO: `/v3/users/6a5d3b0c43df4f64beea65d474a49dbf` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:30.166846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5d3b0c43df4f64beea65d474a49dbf)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:30.168783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:30.226751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5d3b0c43df4f64beea65d474a49dbf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.234030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5d3b0c43df4f64beea65d474a49dbf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.235017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5d3b0c43df4f64beea65d474a49dbf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.235874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5d3b0c43df4f64beea65d474a49dbf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.246168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5d3b0c43df4f64beea65d474a49dbf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.267899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1914/3817] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:30 2021] DELETE /identity/v3/users/6a5d3b0c43df4f64beea65d474a49dbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:30.390502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:30.391992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:30.423496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284da1-1025-41f2-bf5b-5123748572e9 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:30.515368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:30.517614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:30.518057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:30.518542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] PATH_INFO: `/v3/projects/a9a1404adcbe496cbea122282a1cac71` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:30.520079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1404adcbe496cbea122282a1cac71)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:30.522363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:30.584586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1404adcbe496cbea122282a1cac71', 'request_id': 'req-1b0049f3-4042-4e99-8916-4fda46b9963b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.590817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1404adcbe496cbea122282a1cac71', 'request_id': 'req-1b0049f3-4042-4e99-8916-4fda46b9963b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.600842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1404adcbe496cbea122282a1cac71', 'request_id': 'req-1b0049f3-4042-4e99-8916-4fda46b9963b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.627077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] The token cache is being invalidate because project a9a1404adcbe496cbea122282a1cac71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:30.627388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.628346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.632666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1904/3818] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:30 2021] DELETE /identity/v3/projects/a9a1404adcbe496cbea122282a1cac71 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:30.634249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:30.635721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:30.663967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83df39-0313-4917-8501-789e991abb0a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:30.774804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:30.777378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:30.777889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:30.778533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] PATH_INFO: `/v3/users/8162044c27ad41d38bb61a7211e6842a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:30.780152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8162044c27ad41d38bb61a7211e6842a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:30.783629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:30.884518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8162044c27ad41d38bb61a7211e6842a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.894394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8162044c27ad41d38bb61a7211e6842a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.895373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8162044c27ad41d38bb61a7211e6842a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.896043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8162044c27ad41d38bb61a7211e6842a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.905251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f496d40d-6f9e-4f98-8eb2-3049e1debd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8162044c27ad41d38bb61a7211e6842a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:30.929097 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1915/3819] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:30 2021] DELETE /identity/v3/users/8162044c27ad41d38bb61a7211e6842a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:30.989950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:30.991715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.007210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0049f3-4042-4e99-8916-4fda46b9963b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.069306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.070265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.070555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.070865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] PATH_INFO: `/v3/projects/5b4fde48f24f4816be46ccf5bd4474ae` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.072340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4fde48f24f4816be46ccf5bd4474ae)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.074272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.122677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4fde48f24f4816be46ccf5bd4474ae', 'request_id': 'req-86502c07-e508-476a-8982-13dec52851e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:31.127954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4fde48f24f4816be46ccf5bd4474ae', 'request_id': 'req-86502c07-e508-476a-8982-13dec52851e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:31.135093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4fde48f24f4816be46ccf5bd4474ae', 'request_id': 'req-86502c07-e508-476a-8982-13dec52851e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:31.149615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] The token cache is being invalidate because project 5b4fde48f24f4816be46ccf5bd4474ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:31.151734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:31.152597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-86502c07-e508-476a-8982-13dec52851e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:31.154631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1905/3820] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:30 2021] DELETE /identity/v3/projects/5b4fde48f24f4816be46ccf5bd4474ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:31.160864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.161377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.161616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.185720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:31.186933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.246172 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1916/3821] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:31.254272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.254668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.255014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.274397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:31.275726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.285257 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1906/3822] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:31.290086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.300381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b865-7590-492d-9446-e7586a6e8635 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.305127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.305823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.306103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.306376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.307123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:31.307455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.309269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.322357 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1917/3823] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:31.326723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.344059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be27d2-7ba5-456c-bde7-9d14bf59c540 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.351122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.351880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.352268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.352701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.353453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.355936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.388470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1907/3824] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:31 2021] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:31.390131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.401832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946178-529d-4993-9589-31d07f05b00a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.464686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.465374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.465657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.465935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.466664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.468642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.495605 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1918/3825] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:31 2021] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:31.496918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.507857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a849-b707-4b8c-b132-25e5a6c637b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.514449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.515225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.515474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.516052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.517085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.518679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.532093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1908/3826] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:31.537085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.547927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd03cc-8485-4ed1-9ec2-cb81a1e7a832 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.552662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.553332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.553609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.553878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.555362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.556527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293afdf-1a00-4bb6-a48f-90ab75353f6f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.567475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1919/3827] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:31.571651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.582689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025e9ac-56ab-4905-b803-cd4a385378fc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.587503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.588371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.588675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.588949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] PATH_INFO: `/v3/projects/3444d571fcd742ef8ce43822b52d49be/users/43457152ab024c74b5bf1b83a69aa4be/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.604014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3444d571fcd742ef8ce43822b52d49be, user_id=43457152ab024c74b5bf1b83a69aa4be, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.606783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.623273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1909/3828] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:31 2021] PUT /identity/v3/projects/3444d571fcd742ef8ce43822b52d49be/users/43457152ab024c74b5bf1b83a69aa4be/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:31.628829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.629118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.629394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.647782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:31.649137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.737344 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1920/3829] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:31.750597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.752961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.858169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552c3f4-c85e-4d24-84af-e9740a95606a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.865731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.866644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.867563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.868071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.879496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.881067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbf43-6069-456a-917d-179985536e5a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:31.883046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:31.885211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:31.892863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1910/3830] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:31.915873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba9496-c24d-4bda-9f3e-a5f93238a629 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:31.922425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:31.924096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:31.924435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:31.924750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] PATH_INFO: `/v3/projects/8c27cfab455c4904a4983025ac850926` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:31.926145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c27cfab455c4904a4983025ac850926)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:31.928394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.003050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c27cfab455c4904a4983025ac850926', 'request_id': 'req-c1195641-edda-4ac9-a391-e78589b6555c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:32.016181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c27cfab455c4904a4983025ac850926', 'request_id': 'req-c1195641-edda-4ac9-a391-e78589b6555c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:32.036314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c27cfab455c4904a4983025ac850926', 'request_id': 'req-c1195641-edda-4ac9-a391-e78589b6555c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:32.073940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] The token cache is being invalidate because project 8c27cfab455c4904a4983025ac850926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:32.075254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:32.076083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1195641-edda-4ac9-a391-e78589b6555c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:32.082813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1921/3831] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:31 2021] DELETE /identity/v3/projects/8c27cfab455c4904a4983025ac850926 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:32.084563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.084917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.085160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.134986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:32.136216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:32.257839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1911/3832] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:32.262841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.262841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.262841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.289277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:32.290774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:32.309425 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1922/3833] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:32.313945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.325984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f170c1-86a6-450d-bca7-39d218b7e2e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.331686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.332510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.332913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.333373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.334264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:32.334692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.340081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.366082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1912/3834] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:32.370410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.384025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd5fb-0e46-4c39-8e70-f656cf8b260e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.389166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.390132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.390973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.391543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.393595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.396488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.441445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1923/3835] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:32 2021] POST /identity/v3/projects => generated 395 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:32.446035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.463596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2ec67-f489-42c4-abf1-a63ae7ed1c95 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.542213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.542874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.543187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.543394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.544422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.546348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.573223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1913/3836] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:32 2021] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:32.577349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.587707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd574f2e-e454-49e1-b418-bb7bc9ee141b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.592404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.593091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.593364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.593633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.594361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.596455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.613206 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1924/3837] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:03:32.616321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.629602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb272efa-a379-4580-9371-8e74719ec73b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.635156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.635981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.636373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.636783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.637656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.639667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e97e3b-94e3-4287-b38f-ae6574eaf2c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.654107 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1914/3838] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:32.658766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.669338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf14f5-6d73-4642-9138-9f419549a4ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.675007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.675875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.676147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.676448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] PATH_INFO: `/v3/projects/c676f4ec86b44df399be6886b57d34f9/users/4b20a09147544f20941d8afd17c21e16/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.690885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c676f4ec86b44df399be6886b57d34f9, user_id=4b20a09147544f20941d8afd17c21e16, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.693668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.708510 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1925/3839] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:32 2021] PUT /identity/v3/projects/c676f4ec86b44df399be6886b57d34f9/users/4b20a09147544f20941d8afd17c21e16/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:32.713759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed442-3ad1-4af9-88d9-693457bb2902 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.714131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed442-3ad1-4af9-88d9-693457bb2902 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.714486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed442-3ad1-4af9-88d9-693457bb2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.733086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-361ed442-3ad1-4af9-88d9-693457bb2902 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:32.734371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-361ed442-3ad1-4af9-88d9-693457bb2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:32.793753 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1915/3840] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:32.806000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:32.808140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:32.872019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedf93-8ade-4c21-9e76-a7552e1b2acf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:32.876394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:32.877143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:32.877421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:32.877693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:32.887645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:32.889128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:32.900152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1926/3841] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:33.983259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:33.984103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:33.984675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.013237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] MFA Rules not processed for user `4b20a09147544f20941d8afd17c21e16`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:34.015010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:34.119399 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1916/3842] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:33 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:34.123516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.136229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5e136-0a3a-4a7a-9ce2-991bb3886a4f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.166760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.167736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.168327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.176738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.177786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.184401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.251241 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1927/3843] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:34 2021] POST /identity/v3/projects => generated 397 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:34.256307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.272328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a7cc-3791-4dab-a79a-3eee0be42414 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.401447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.402210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.402504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.402838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.403884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.405966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.459429 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1917/3844] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:34 2021] POST /identity/v3/users => generated 305 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:34.463494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.475266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312176-ec34-4110-825a-04b25f58a274 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.480118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.481043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.481325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.481601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.482342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.483923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.505146 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1928/3845] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:34.506497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.523080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9cc52-5fd3-46c8-8384-afc23a6834b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.528350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.529320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.529647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.529864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] PATH_INFO: `/v3/projects/83ecaf331fc44b74abe363e4efb43ec0/users/2c0d6f65ad364e9eb14297470df9f4d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.549610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ecaf331fc44b74abe363e4efb43ec0, user_id=2c0d6f65ad364e9eb14297470df9f4d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.552311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.572946 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1918/3846] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:34 2021] PUT /identity/v3/projects/83ecaf331fc44b74abe363e4efb43ec0/users/2c0d6f65ad364e9eb14297470df9f4d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:34.577130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.589322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437f4a-809d-4e94-82a0-471608522f9f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.649399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.650090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.650368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.650642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.651369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.653141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef77ee5-0e87-41d1-a96f-98de37bdb254 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.665139 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1929/3847] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:34.669410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:34.680830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac792-4a52-41ea-8aee-ee16929cd4b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:34.685837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:34.686835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:34.687237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:34.688055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] PATH_INFO: `/v3/projects/83ecaf331fc44b74abe363e4efb43ec0/users/2c0d6f65ad364e9eb14297470df9f4d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:34.690240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ecaf331fc44b74abe363e4efb43ec0, user_id=2c0d6f65ad364e9eb14297470df9f4d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:34.692949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f487e-7209-492d-b7e0-e4641e52fcc5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:34.707768 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1919/3848] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:34 2021] PUT /identity/v3/projects/83ecaf331fc44b74abe363e4efb43ec0/users/2c0d6f65ad364e9eb14297470df9f4d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:03:35.677907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:35.678451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:35.678451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:35.710184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] MFA Rules not processed for user `2c0d6f65ad364e9eb14297470df9f4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:35.711798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:35.806787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1930/3849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:35 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:35.820094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:35.820686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:35.820876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:35.857504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] MFA Rules not processed for user `4b20a09147544f20941d8afd17c21e16`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:35.858725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:35.922387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1920/3850] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:35 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:35.934544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:35.936432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:36.043328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bd2fc-aab7-4ff8-a4df-1287dc3b1bf7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:36.054707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:36.055702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:36.056346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:36.056854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:36.067110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:36.069520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749d496-9154-4083-b284-6dbd8db7572f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:36.082392 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1931/3851] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:35 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:37.943334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:37.954414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:38.018919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24fbbe-29b5-46ab-b3f8-139a37712ea4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:38.024572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:38.025546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:38.025900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:38.026242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] PATH_INFO: `/v3/users/c8c7b8da9fad49dd841de183d89408f4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:38.027522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c7b8da9fad49dd841de183d89408f4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:38.029547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:38.084894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c7b8da9fad49dd841de183d89408f4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:38.092381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c7b8da9fad49dd841de183d89408f4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:38.095449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c7b8da9fad49dd841de183d89408f4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:38.107402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c7b8da9fad49dd841de183d89408f4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:38.115869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c7b8da9fad49dd841de183d89408f4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:38.122277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1921/3852] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:37 2021] DELETE /identity/v3/users/c8c7b8da9fad49dd841de183d89408f4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:38.126815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:38.127305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:38.127433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:38.149590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:38.151077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:38.267958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1932/3853] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:38.278416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:38.280158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:38.388688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653f60-aedd-4a85-820a-8d56ceb3ca41 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:38.394056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:38.395013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:38.395539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:38.396017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:38.408689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:38.411056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:38.424535 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1922/3854] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:39.142631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:39.144228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:39.165690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ce45b-615a-40d9-a9f5-edbd49086caa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:39.177502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:39.178548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:39.179062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:39.179435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] PATH_INFO: `/v3/projects/44e60ca27e834896a209c46485c178e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:39.183534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e60ca27e834896a209c46485c178e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:39.186512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:39.298485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e60ca27e834896a209c46485c178e7', 'request_id': 'req-5523bc3c-6892-40b8-aab9-a2f7751bf27b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.315798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e60ca27e834896a209c46485c178e7', 'request_id': 'req-5523bc3c-6892-40b8-aab9-a2f7751bf27b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.337761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e60ca27e834896a209c46485c178e7', 'request_id': 'req-5523bc3c-6892-40b8-aab9-a2f7751bf27b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.373977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] The token cache is being invalidate because project 44e60ca27e834896a209c46485c178e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:39.376869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.378596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5523bc3c-6892-40b8-aab9-a2f7751bf27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.380828 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1933/3855] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:39 2021] DELETE /identity/v3/projects/44e60ca27e834896a209c46485c178e7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:39.384523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:39.418831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88cbe-4a5d-4a61-9c9c-c9e41a7fe098 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:39.557207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:39.558327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:39.558947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:39.559393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] PATH_INFO: `/v3/users/bbb752c65ee0435b8a042cbacafe4787` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:39.561056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb752c65ee0435b8a042cbacafe4787)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:39.563224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:39.655097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb752c65ee0435b8a042cbacafe4787'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.674828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb752c65ee0435b8a042cbacafe4787'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.676160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb752c65ee0435b8a042cbacafe4787'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.688526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:39.688963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:39.689506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:39.710635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb752c65ee0435b8a042cbacafe4787'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.725453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb752c65ee0435b8a042cbacafe4787'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:39.732784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1923/3856] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:03:39 2021] DELETE /identity/v3/users/bbb752c65ee0435b8a042cbacafe4787 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:39.769543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] MFA Rules not processed for user `43457152ab024c74b5bf1b83a69aa4be`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:39.770796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:39.921451 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1934/3857] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:39 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:39.951754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:39.953433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:40.039901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e6e8c-b626-4213-94aa-6fa27e591c4a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:40.044318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:40.045196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.045497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.045772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.055529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:40.057008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95cf42-cad6-4fa7-8e5b-ac380a2119c4 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:40.070693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1924/3858] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:40.313861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:40.315377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:40.403003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823da73-e940-4827-99b4-cccdeb4709d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:40.410275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:40.411255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.411603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.411944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] PATH_INFO: `/v3/projects/440118d612b34003bed95bffaa02fc3a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.413363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440118d612b34003bed95bffaa02fc3a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:40.415364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:40.495445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440118d612b34003bed95bffaa02fc3a', 'request_id': 'req-fb45913a-ec02-4986-bac3-5e860c683712'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:40.505922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440118d612b34003bed95bffaa02fc3a', 'request_id': 'req-fb45913a-ec02-4986-bac3-5e860c683712'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:40.516715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440118d612b34003bed95bffaa02fc3a', 'request_id': 'req-fb45913a-ec02-4986-bac3-5e860c683712'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:40.535310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] The token cache is being invalidate because project 440118d612b34003bed95bffaa02fc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:03:40.535551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:40.536494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb45913a-ec02-4986-bac3-5e860c683712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:03:40.540504 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1935/3859] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:03:40 2021] DELETE /identity/v3/projects/440118d612b34003bed95bffaa02fc3a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:40.547473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.547953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.548171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.583894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:40.585337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:40.692028 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1925/3860] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:40.699699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.699983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.700256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.731066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:40.735104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:40.758494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:40.770919 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1936/3861] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:40.773610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b3b94-7039-4a7b-b457-2cdabeb50eb4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:40.781441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:40.782953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.782953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.783306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.784302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:03:40.784712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:40.786440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:40.799188 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1926/3862] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:03:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:03:40.803912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:40.815542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35acbc7-fb5b-4545-836c-4f2456548599 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:40.820554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:40.822226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:40.822577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:40.822914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:40.823690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:40.832535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:40.868277 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1937/3863] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:40 2021] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:40.872866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:40.895970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772c95-3a4f-414a-a9dd-d2be3fc7c63a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:41.002009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:41.002990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.003478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.003917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.004856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:41.008676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:41.044982 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1927/3864] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:40 2021] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:41.049476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:41.063820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb64c-3626-4d3b-9580-e4fae32025f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:41.066349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:41.067129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.067473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.067815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.068641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:41.072501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:41.090966 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1938/3865] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:41 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:41.092181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:41.114034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741760-baba-4517-955b-6e52d4f0d683 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:41.131691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:41.132718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.133003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.133279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.134289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:41.135976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab247e-5e97-420e-a7db-4456e4216f84 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:41.147338 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1928/3866] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:41 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:41.151061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:41.166748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039900b4-d1ef-48fa-b9b5-e0b1d7371ea6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:41.174204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:41.175845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.176353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.176969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] PATH_INFO: `/v3/projects/f835c2b6ac5d4c459776f3c69d803eec/users/44dcae1e41bd4ea59252766325d8a092/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.207568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f835c2b6ac5d4c459776f3c69d803eec, user_id=44dcae1e41bd4ea59252766325d8a092, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:41.210224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:41.234662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1939/3867] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:41 2021] PUT /identity/v3/projects/f835c2b6ac5d4c459776f3c69d803eec/users/44dcae1e41bd4ea59252766325d8a092/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:41.240373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce21-128d-4830-a83c-200a3efdff90 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.240687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce21-128d-4830-a83c-200a3efdff90 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.240958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce21-128d-4830-a83c-200a3efdff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.273016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8f35ce21-128d-4830-a83c-200a3efdff90 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:41.274358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f35ce21-128d-4830-a83c-200a3efdff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:41.370520 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1929/3868] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:41.382526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:41.384348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:41.468128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87fae-da60-4048-ba0c-b0707bd59fd1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:41.473275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:41.474171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:41.474770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:41.475045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:41.485647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:41.487425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:41.498851 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1940/3869] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:42.704404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:42.705314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:42.705763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:42.749445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] MFA Rules not processed for user `44dcae1e41bd4ea59252766325d8a092`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:42.751375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:42.856641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1930/3870] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:42 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:42.861165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:42.875962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30bc8b-118c-419b-b2f6-a9b4b37d424d service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:42.882376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:42.883718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:42.884001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:42.884276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:42.885025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:42.887790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:42.945887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1941/3871] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:03:42 2021] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:03:42.949824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:42.961923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa59de-0912-4c22-bd98-cd658a46a1b4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:43.052831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:43.053694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:43.055296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:43.055576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:43.057042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:43.059152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:43.095605 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1931/3872] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:03:42 2021] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:03:43.098734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:43.113598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377cc3-289e-4014-9c9f-29405f596157 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:43.120550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:43.121627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:43.122073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:43.122524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:43.123622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:43.126197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:43.141403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1942/3873] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:43.145508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:43.161659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f4ae-a803-4db1-abfe-0b96d5eaaacf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:43.177787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:43.178856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:43.179138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:43.179489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] PATH_INFO: `/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53/users/e9ef2eeaa3344503844fb935c3373fc6/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:43.211345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c13adb1db0b44a38a3d8613d7d72a53, user_id=e9ef2eeaa3344503844fb935c3373fc6, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:43.225510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:43.264343 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1932/3874] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:43 2021] PUT /identity/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53/users/e9ef2eeaa3344503844fb935c3373fc6/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:43.265608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:43.286434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe528-642d-47dd-9b7d-0b6d23b9e2b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:43.447690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:43.448363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:43.450020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:43.450307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:43.451065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:43.452739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d167f3-e75d-43f8-a762-b9afab68765e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:43.476274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1943/3875] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:03:43 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:03:43.480141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:43.503731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383ca41-742b-499d-9765-07feb5138d03 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:43.525219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:43.526203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:43.528868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:43.529235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] PATH_INFO: `/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53/users/e9ef2eeaa3344503844fb935c3373fc6/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:43.536338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c13adb1db0b44a38a3d8613d7d72a53, user_id=e9ef2eeaa3344503844fb935c3373fc6, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:43.545095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f99d-ec30-4c50-9dad-43ea312c2b5b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:43.574010 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1933/3876] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:03:43 2021] PUT /identity/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53/users/e9ef2eeaa3344503844fb935c3373fc6/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:03:44.879934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:44.880830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:44.881358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:44.916952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] MFA Rules not processed for user `e9ef2eeaa3344503844fb935c3373fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:44.918470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:45.016906 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1944/3877] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:44 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:45.027402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:45.028238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:45.028725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:45.061205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] MFA Rules not processed for user `44dcae1e41bd4ea59252766325d8a092`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:45.062693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:45.191562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1934/3878] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:45.210987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:45.212770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:45.303634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f6f4-f038-49c8-b7ec-d16f657e5a61 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:45.309802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:45.310609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:45.310889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:45.311162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:45.320311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:45.322460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467959b-4045-449d-8bdd-d735f386d057 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:45.346512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1945/3879] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:45 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:53.798252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:53.815135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5056d3-6da7-4b5b-a6d3-200e3fc27bf4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:53.831700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:53.832361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:53.832725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:53.833348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:53.834803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:53.911908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:53.913541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869c8fd-e311-4a7f-915d-e22266cb81c8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:53.928757 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1935/3880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:53 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:54.815578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:54.816119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:54.816119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:54.819190 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1946/3881] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:03:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:03:54.827428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b13a-6e22-40ec-9145-44d4a6daa6cd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:54.832570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b13a-6e22-40ec-9145-44d4a6daa6cd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:54.833071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b13a-6e22-40ec-9145-44d4a6daa6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:54.868924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-55d4b13a-6e22-40ec-9145-44d4a6daa6cd None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:54.870723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-55d4b13a-6e22-40ec-9145-44d4a6daa6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:54.948197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1936/3882] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:03:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:54.975093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:54.977284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:55.004635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772a3d-d63b-4a93-b919-b2db31916564 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:55.010100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:55.011008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:55.011392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:55.011883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:55.029532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:55.032514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15da534-d2f3-47a7-9093-bb30a4bee771 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:55.051128 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1947/3883] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:03:55.116813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:55.118391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:55.118746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:55.199811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] MFA Rules not processed for user `43457152ab024c74b5bf1b83a69aa4be`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:55.201116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:55.361705 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1937/3884] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:55 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:03:55.366429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:55.367285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:55.367658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:55.414702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] MFA Rules not processed for user `43457152ab024c74b5bf1b83a69aa4be`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:03:55.416396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:55.425959 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1948/3885] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:03:55 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:03:55.803400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:03:55.808444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:55.873483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c375b4-c1ae-436f-8a8c-15db06633752 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:03:55.877365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:03:55.878084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:03:55.878436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:03:55.878780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:03:55.881616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:03:55.892752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:03:55.895139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:03:55.904162 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1938/3886] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:03:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:06.507166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:06.508673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:06.525784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb626e5-6a8b-48ce-b992-f9bd3ed0be1a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:06.531636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:06.532489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:06.533009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:06.533484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:06.543367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:06.545225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:06.556074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1949/3887] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:06 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:07.185318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:07.186791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:07.313868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0bc37-8632-4dc6-975b-df1791e03bf8 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:07.319085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:07.320043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:07.320388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:07.321022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] PATH_INFO: `/v3/users/5ce44da17b9e472cbe7198389c3eeedb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:07.322832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce44da17b9e472cbe7198389c3eeedb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:07.325158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:07.393506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce44da17b9e472cbe7198389c3eeedb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:07.401740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce44da17b9e472cbe7198389c3eeedb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:07.403181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce44da17b9e472cbe7198389c3eeedb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:07.419398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce44da17b9e472cbe7198389c3eeedb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:07.432737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b083ae85-2a37-4c91-bb3c-0438a0757b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce44da17b9e472cbe7198389c3eeedb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:07.449991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1939/3888] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:07 2021] DELETE /identity/v3/users/5ce44da17b9e472cbe7198389c3eeedb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:07.867205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:07.893994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a4d-d204-4248-b744-c2ba87b8ca2e service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:07.994493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:07.995298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:07.995583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:07.995850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] PATH_INFO: `/v3/projects/945d0f391e364fe6a10ff981b10e4a89` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:07.997116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=945d0f391e364fe6a10ff981b10e4a89)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:07.999170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.057491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945d0f391e364fe6a10ff981b10e4a89', 'request_id': 'req-db920de7-1d10-465f-a8c4-e1e790a69e0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:08.064468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945d0f391e364fe6a10ff981b10e4a89', 'request_id': 'req-db920de7-1d10-465f-a8c4-e1e790a69e0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:08.072419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945d0f391e364fe6a10ff981b10e4a89', 'request_id': 'req-db920de7-1d10-465f-a8c4-e1e790a69e0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:08.088411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] The token cache is being invalidate because project 945d0f391e364fe6a10ff981b10e4a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:08.089064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:08.089958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db920de7-1d10-465f-a8c4-e1e790a69e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:08.092064 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1950/3889] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:07 2021] DELETE /identity/v3/projects/945d0f391e364fe6a10ff981b10e4a89 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:08.097801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.098411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.098699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.127334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:08.128485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:08.207607 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1940/3890] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:04:08.208227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.208227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.208456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.239842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:08.241227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:08.251136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1951/3891] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:08.256754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.278445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d725-bb24-4a22-bbc8-881f896a3420 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.284734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.285414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.285692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.286171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.287077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:08.287565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.290934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.310719 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1941/3892] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:04:08.315326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.327224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4973-8d9b-4a9f-b3b2-84c6b7626a6c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.346171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.347156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.347602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.348058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.349001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.351054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.387832 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1952/3893] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:08 2021] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:08.392458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.413940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af1ee-2bcb-4f78-be4e-8095d0db4968 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.491140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.492324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.493016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.493512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.494434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.497122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.531803 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1942/3894] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:08 2021] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:08.537211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.553442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cabbed-30ef-449f-98ea-56c6850525e2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.560533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.561632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.562340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.563252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.564381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.566552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.580188 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1953/3895] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:08.584496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.598744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d401-0f02-47d7-b6ad-b91f915390f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.607283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.608580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.609917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.610481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.611566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.614643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275a8c-0fd6-4e29-80ed-216d83f3b414 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.630192 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1943/3896] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:08.637402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.652063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3592b-f7ed-4c01-8661-bb45099e9155 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.659882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.661556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.661972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.662353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] PATH_INFO: `/v3/projects/30a29aec41654205a386adc6e2de0b11/users/b0e407b4a87f420b879c57ba30c84e1d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.692408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a29aec41654205a386adc6e2de0b11, user_id=b0e407b4a87f420b879c57ba30c84e1d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:08.695478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:08.709862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1954/3897] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:08 2021] PUT /identity/v3/projects/30a29aec41654205a386adc6e2de0b11/users/b0e407b4a87f420b879c57ba30c84e1d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:08.715077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774439-c93b-4871-839e-bccfa1f3d69f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.715391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774439-c93b-4871-839e-bccfa1f3d69f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.715692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774439-c93b-4871-839e-bccfa1f3d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:08.734575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8e774439-c93b-4871-839e-bccfa1f3d69f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:08.735968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e774439-c93b-4871-839e-bccfa1f3d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:08.812711 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1944/3898] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:08.822875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:08.839511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:08.945146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b25c-aec5-4d51-959e-2c24ebefc499 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:08.963978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:08.964817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:08.965108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:08.965446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:09.005760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:09.007200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:09.039319 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1955/3899] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:10.671798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:10.672274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:10.672393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:10.711285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] MFA Rules not processed for user `4b20a09147544f20941d8afd17c21e16`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:10.713834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:10.844662 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1945/3900] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:10 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:16.386705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:16.388320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:16.404736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b60ef0-c6ff-4a74-ae31-be2428cb07fc service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:16.413199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:16.413685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:16.414029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:16.415210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] PATH_INFO: `/v3/users/5bd148dc620a41cf9e5e817216c7c67d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:16.416936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd148dc620a41cf9e5e817216c7c67d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:16.419040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:16.507676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd148dc620a41cf9e5e817216c7c67d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:16.518999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd148dc620a41cf9e5e817216c7c67d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:16.520216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd148dc620a41cf9e5e817216c7c67d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:16.521503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd148dc620a41cf9e5e817216c7c67d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:16.535410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9392f19e-d9db-4cd0-b3ab-2fe0df1fd79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd148dc620a41cf9e5e817216c7c67d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:16.569578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1956/3901] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:16 2021] DELETE /identity/v3/users/5bd148dc620a41cf9e5e817216c7c67d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:17.167441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:17.182717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cef90-e310-413d-8fe4-1ced15bf34cd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:17.387465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:17.397056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:17.397344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:17.397621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] PATH_INFO: `/v3/projects/a15de5c4a094498d9dd5da826df51b9a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:17.399430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15de5c4a094498d9dd5da826df51b9a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:17.405675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:17.537312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15de5c4a094498d9dd5da826df51b9a', 'request_id': 'req-30f75707-1639-4972-96ac-6eb28dc109bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:17.548104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15de5c4a094498d9dd5da826df51b9a', 'request_id': 'req-30f75707-1639-4972-96ac-6eb28dc109bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:17.559161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15de5c4a094498d9dd5da826df51b9a', 'request_id': 'req-30f75707-1639-4972-96ac-6eb28dc109bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:17.586376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] The token cache is being invalidate because project a15de5c4a094498d9dd5da826df51b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:17.587084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:17.588230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30f75707-1639-4972-96ac-6eb28dc109bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:17.595876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1946/3902] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:17 2021] DELETE /identity/v3/projects/a15de5c4a094498d9dd5da826df51b9a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:17.597486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:17.597985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:17.598091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:17.635674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:17.636972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:17.763470 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1957/3903] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:04:17.771371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:17.771652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:17.772114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:17.792656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:17.794215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:17.810246 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1947/3904] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:17.810752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:17.830895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e050a1-801f-4e6f-b8c5-5ddc2505631d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:17.842857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:17.843544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:17.844008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:17.845030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:17.846021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:17.846507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:17.848304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:17.874885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:17.875133 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1958/3905] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:04:17.887705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1a724-a2f4-453a-a4f5-ab8d66873f88 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:17.896172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:17.897802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:17.898450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:17.898967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:17.899923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:17.904928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:17.962106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1948/3906] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:17 2021] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:04:17.965350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:17.979977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc8882-16e8-4dd1-a6f3-836140bca302 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:18.065372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:18.066364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.066862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.067304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.068416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:18.070771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:18.106711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1959/3907] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:17 2021] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:18.107772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:18.123672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b2b03-4abb-43f5-af6a-e07d472c98eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:18.130715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:18.131043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.131336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.131608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.132356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:18.134478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:18.151726 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1949/3908] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:04:18.152800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:18.164546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448906c-a890-40b6-b6c7-c27707c6dc56 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:18.172462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:18.173393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.173738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.174079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.174896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:18.176768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31c486-68d0-4ee8-af02-02d8e5a89b6c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:18.192822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1960/3909] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:04:18.195036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:18.209453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9bb4-86a6-4d3d-835d-a81f8c68017a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:18.216407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:18.217697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.218570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.218858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] PATH_INFO: `/v3/projects/244a8033b1724ecbb48b20fea4dbfed2/users/ea2779eda54843f6a018d81a2d74e3b0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.238127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244a8033b1724ecbb48b20fea4dbfed2, user_id=ea2779eda54843f6a018d81a2d74e3b0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:18.242369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:18.264507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1950/3910] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:18 2021] PUT /identity/v3/projects/244a8033b1724ecbb48b20fea4dbfed2/users/ea2779eda54843f6a018d81a2d74e3b0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:18.266888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3744b-8e0e-4005-a424-7d55ce7dc6f5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.267164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3744b-8e0e-4005-a424-7d55ce7dc6f5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.267444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3744b-8e0e-4005-a424-7d55ce7dc6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.303843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-afa3744b-8e0e-4005-a424-7d55ce7dc6f5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:18.305187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-afa3744b-8e0e-4005-a424-7d55ce7dc6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:18.451654 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1961/3911] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:18.480775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:18.482862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:18.603359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7885b2-dc31-4592-bfa9-c20982976915 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:18.609391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:18.610330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:18.610770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:18.611689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:18.641010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:18.648565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5f38-b1ea-420d-a3b0-e51a5aeac1af service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:18.663013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1951/3912] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:20.706104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:20.706603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:20.706694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:20.756850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] MFA Rules not processed for user `ea2779eda54843f6a018d81a2d74e3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:20.759892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:20.911875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1962/3913] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:20 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:20.924557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:20.925058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:20.925231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:20.953395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] MFA Rules not processed for user `ea2779eda54843f6a018d81a2d74e3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:20.955076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:20.982977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1952/3914] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:20 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:20.994411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:20.996356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:21.116009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c298fab-a8e7-4c87-ac8f-da6ad079fbcf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:21.124249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:21.125049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:21.125809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:21.125809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:21.143449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:21.145861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:21.167300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1963/3915] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:20 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:21.173964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:21.175783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:21.196264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1053-1d48-4f13-a6d9-a33bf7fc9baf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:21.238335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:21.240037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:21.240569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:21.241968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] PATH_INFO: `/v3/users/44dcae1e41bd4ea59252766325d8a092` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:21.244559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44dcae1e41bd4ea59252766325d8a092)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:21.247295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:21.344437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44dcae1e41bd4ea59252766325d8a092'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:21.353180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44dcae1e41bd4ea59252766325d8a092'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:21.353811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44dcae1e41bd4ea59252766325d8a092'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:21.387125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44dcae1e41bd4ea59252766325d8a092'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:21.411959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44dcae1e41bd4ea59252766325d8a092'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:21.420690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1953/3916] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:21 2021] DELETE /identity/v3/users/44dcae1e41bd4ea59252766325d8a092 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:21.844823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:21.859563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed70f6-e4e9-4e21-8cb6-709321e24541 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:21.933202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:21.934657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:21.935100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:21.935716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] PATH_INFO: `/v3/projects/f835c2b6ac5d4c459776f3c69d803eec` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:21.937269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f835c2b6ac5d4c459776f3c69d803eec)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:21.939693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:22.023549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f835c2b6ac5d4c459776f3c69d803eec', 'request_id': 'req-8ac4c807-92d3-47f6-9970-98afbb5208ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.031834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f835c2b6ac5d4c459776f3c69d803eec', 'request_id': 'req-8ac4c807-92d3-47f6-9970-98afbb5208ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.041983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f835c2b6ac5d4c459776f3c69d803eec', 'request_id': 'req-8ac4c807-92d3-47f6-9970-98afbb5208ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.056322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] The token cache is being invalidate because project f835c2b6ac5d4c459776f3c69d803eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:22.056631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.057468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ac4c807-92d3-47f6-9970-98afbb5208ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.059445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1964/3917] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:21 2021] DELETE /identity/v3/projects/f835c2b6ac5d4c459776f3c69d803eec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:22.063353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:22.064945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:22.080321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc734e8-c4a7-487b-921c-a50c35170b65 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:22.153512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:22.154605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:22.155068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:22.156069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] PATH_INFO: `/v3/users/e9ef2eeaa3344503844fb935c3373fc6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:22.157623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ef2eeaa3344503844fb935c3373fc6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:22.160496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:22.234809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ef2eeaa3344503844fb935c3373fc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.247756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ef2eeaa3344503844fb935c3373fc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.255219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ef2eeaa3344503844fb935c3373fc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.295681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ef2eeaa3344503844fb935c3373fc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.310057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ef2eeaa3344503844fb935c3373fc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.317184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1954/3918] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:22 2021] DELETE /identity/v3/users/e9ef2eeaa3344503844fb935c3373fc6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:22.538913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:22.539297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:22.539723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:22.591465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] MFA Rules not processed for user `b0e407b4a87f420b879c57ba30c84e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:22.593046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:22.692574 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1965/3919] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:22 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:22.710483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:22.712093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:22.805535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec239dd-8083-49e1-ab1e-0fb1b9387e15 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:22.813321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:22.815060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:22.815615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:22.816057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] PATH_INFO: `/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:22.818121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c13adb1db0b44a38a3d8613d7d72a53)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:22.820525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:22.916332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c13adb1db0b44a38a3d8613d7d72a53', 'request_id': 'req-d6686a14-0aa1-417b-b7f2-ade73bbf9459'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.934902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c13adb1db0b44a38a3d8613d7d72a53', 'request_id': 'req-d6686a14-0aa1-417b-b7f2-ade73bbf9459'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.947092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c13adb1db0b44a38a3d8613d7d72a53', 'request_id': 'req-d6686a14-0aa1-417b-b7f2-ade73bbf9459'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.988422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] The token cache is being invalidate because project 5c13adb1db0b44a38a3d8613d7d72a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:22.988762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.989818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d6686a14-0aa1-417b-b7f2-ade73bbf9459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:22.992194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1955/3920] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:22 2021] DELETE /identity/v3/projects/5c13adb1db0b44a38a3d8613d7d72a53 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:22.998571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:22.998571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:23.002729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37658-441b-4dcd-8ee6-154d390ee71d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.003076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37658-441b-4dcd-8ee6-154d390ee71d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.003327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37658-441b-4dcd-8ee6-154d390ee71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.049120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-49a37658-441b-4dcd-8ee6-154d390ee71d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:23.050538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49a37658-441b-4dcd-8ee6-154d390ee71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:23.126667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd85a22-e0df-4528-b900-1f51485c3250 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.177575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1956/3921] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:23.187175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.187739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.188389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.214846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:23.216641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:23.231502 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1957/3922] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:23.232715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.238161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.239287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.239287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.239559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.243577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:23.245035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f6ae-c913-4793-9a87-c517b4292664 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.252681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.255889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.256380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.257427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.258384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:23.258686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.260529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.298850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1958/3923] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:04:23.305353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.320590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35b7ca-7f67-4980-927b-2287112f8bee admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.330770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.332715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.333209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.334333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.336854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.341557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.393837 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1959/3924] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:23 2021] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:23.396872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.425171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.426902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.450488 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1966/3925] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:22 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:04:23.541925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95aec0-10c0-47a2-8e16-32898b9b5aad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.550271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.551496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.563074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.563620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.565916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.574179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.625108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.625385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1960/3926] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:23 2021] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:23.646878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972daa6-b10d-4e9c-94d0-561702b4fcf4 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.655690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.656371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.656704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.656988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.657734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.659321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.697822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.700306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1967/3927] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:23 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:04:23.717291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b37ed-9781-4a82-aded-1a2e585c46ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.736193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.739246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.739706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.740195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.742115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.746004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858393b5-a921-4168-8765-fd92825bf69f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.780642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1961/3928] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:23 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:23.781529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:23.795061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e252-8ea7-4776-8518-a0435289f45f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:23.809094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:23.810007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.810292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.810622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] PATH_INFO: `/v3/projects/c7f317e2f65b4592bf90d1b445c80c01/users/ea8ddcbae0894e4f8215c391a7991c04/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.862589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f317e2f65b4592bf90d1b445c80c01, user_id=ea8ddcbae0894e4f8215c391a7991c04, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:23.865413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:23.896302 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1968/3929] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:23 2021] PUT /identity/v3/projects/c7f317e2f65b4592bf90d1b445c80c01/users/ea8ddcbae0894e4f8215c391a7991c04/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:23.902809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a249-5c88-418a-93fe-5c061a740807 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:23.903172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a249-5c88-418a-93fe-5c061a740807 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:23.903455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a249-5c88-418a-93fe-5c061a740807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:23.937543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-66b2a249-5c88-418a-93fe-5c061a740807 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:23.938911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66b2a249-5c88-418a-93fe-5c061a740807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:24.085876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1962/3930] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:24.136985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:24.140794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:24.298482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6088032-8151-4be0-b8f4-66eb800914d2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:24.307514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:24.308099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:24.308560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:24.311286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:24.332997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:24.335138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f57f6-bd42-4a83-9d1c-e632600b9cd3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:24.379585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1969/3931] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:29.245366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d042-0b79-4e2a-a07d-87919ae1b3de None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:29.246144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d042-0b79-4e2a-a07d-87919ae1b3de None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:29.246434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d042-0b79-4e2a-a07d-87919ae1b3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:29.296122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-98f8d042-0b79-4e2a-a07d-87919ae1b3de None None] MFA Rules not processed for user `b0e407b4a87f420b879c57ba30c84e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:29.298233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-98f8d042-0b79-4e2a-a07d-87919ae1b3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:29.414855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1963/3932] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:29 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:32.727741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:32.728793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:32.729504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:32.732152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1970/3933] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:04:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:04:32.747176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:32.747666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:32.747760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:32.783830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:32.789506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:32.923450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1964/3934] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:04:32 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:32.950085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:32.958270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:32.980116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b46a-d225-49ae-9b34-38b31405342b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:32.986328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:32.987458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:32.987961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:32.989271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:33.000164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:33.002797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:33.029539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1971/3935] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:32 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:33.309807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:33.336299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3272c-ce1a-4d51-b5a3-a8ad6a5b3f95 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:33.347036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:33.347741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:33.348023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:33.348299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:33.350671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:33.364520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:33.366308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246455-fc4f-41d0-b817-2ed866bca775 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:33.391258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1965/3936] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:34.145174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:34.147215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:34.161786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5b59-cb1d-4a5a-82cb-ca77c78a63fb service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:34.166386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:34.167126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:34.167891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:34.168424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:34.171269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:34.181847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:34.183761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:34.193169 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1972/3937] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:39.601524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:39.602072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:39.602072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:39.661019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] MFA Rules not processed for user `ea8ddcbae0894e4f8215c391a7991c04`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:39.662328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:39.739542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:39.741547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:39.757308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d6a-8608-46ef-92ff-ba6d81c2086c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:39.761088 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1966/3938] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:39 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:39.770097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:39.772343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:39.772795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:39.773795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:39.774178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:39.774556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] PATH_INFO: `/v3/users/1425015068994a7c93a716cce5408ddb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:39.776084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1425015068994a7c93a716cce5408ddb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:39.778487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:39.859820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1425015068994a7c93a716cce5408ddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:39.871262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1717-da33-4c62-bbc6-676481bc4c7b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:39.875548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1425015068994a7c93a716cce5408ddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:39.877748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1425015068994a7c93a716cce5408ddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:39.877973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:39.878928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:39.879063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1425015068994a7c93a716cce5408ddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:39.879504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:39.879964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:39.882222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:39.892423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98b4854b-1820-49e7-9881-9b077fbdf409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1425015068994a7c93a716cce5408ddb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:39.913772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:39.919108 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1973/3939] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:39 2021] DELETE /identity/v3/users/1425015068994a7c93a716cce5408ddb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:39.922848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:39.924387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:39.924957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:39.925377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:39.937320 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1967/3940] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:04:39.972333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:39.974452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:40.059973 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1974/3941] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:04:40.079956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:40.081496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:40.099339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f57d-1c80-439b-b1d0-41a24b623c6f service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:40.167230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:40.168036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:40.168324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:40.168685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:40.182961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:40.186672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:40.199586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1968/3942] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:40.447183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:40.448680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:40.464640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cee9-076f-4520-a8cb-8f768ca55117 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:40.474671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:40.475999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:40.475999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:40.476379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] PATH_INFO: `/v3/projects/71ea56897b9f4bbba4887bdf3f6948fe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:40.478260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ea56897b9f4bbba4887bdf3f6948fe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:40.480646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:40.563170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ea56897b9f4bbba4887bdf3f6948fe', 'request_id': 'req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.569357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ea56897b9f4bbba4887bdf3f6948fe', 'request_id': 'req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.577313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ea56897b9f4bbba4887bdf3f6948fe', 'request_id': 'req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.600966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] The token cache is being invalidate because project 71ea56897b9f4bbba4887bdf3f6948fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:40.601460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.602520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.604887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1975/3943] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:40 2021] DELETE /identity/v3/projects/71ea56897b9f4bbba4887bdf3f6948fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:04:40.609125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:40.621753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aace9-d647-44cf-96cd-5e68d572b94b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:40.729338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:40.731755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:40.732270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:40.732838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] PATH_INFO: `/v3/users/3f3d94ff9fa14243b022721d1ea8ec35` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:40.736437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3d94ff9fa14243b022721d1ea8ec35)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:40.739051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:40.813313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3d94ff9fa14243b022721d1ea8ec35'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.825453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3d94ff9fa14243b022721d1ea8ec35'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.827785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3d94ff9fa14243b022721d1ea8ec35'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.845607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3d94ff9fa14243b022721d1ea8ec35'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.855707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd04c7c2-70ef-4ab4-af25-a1e75f65883a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3d94ff9fa14243b022721d1ea8ec35'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:40.863566 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1969/3944] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:40 2021] DELETE /identity/v3/users/3f3d94ff9fa14243b022721d1ea8ec35 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:41.702921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:41.705009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:41.725353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fdf-b3d8-4240-ad2a-59ff282c0b56 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:41.799335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:41.800530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:41.801024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:41.801461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] PATH_INFO: `/v3/projects/e831456d8de44493b3dda3d8b5cb546a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:41.803053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e831456d8de44493b3dda3d8b5cb546a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:41.805425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:41.899299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e831456d8de44493b3dda3d8b5cb546a', 'request_id': 'req-944811b4-7190-4f4a-b324-943be177edd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:41.911219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e831456d8de44493b3dda3d8b5cb546a', 'request_id': 'req-944811b4-7190-4f4a-b324-943be177edd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:41.928833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e831456d8de44493b3dda3d8b5cb546a', 'request_id': 'req-944811b4-7190-4f4a-b324-943be177edd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:41.953453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] The token cache is being invalidate because project e831456d8de44493b3dda3d8b5cb546a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:41.953870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:41.954775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-944811b4-7190-4f4a-b324-943be177edd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:41.956644 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1976/3945] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:41 2021] DELETE /identity/v3/projects/e831456d8de44493b3dda3d8b5cb546a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:41.963694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:41.964585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:41.964904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:41.989824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:41.991078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:42.103619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1970/3946] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:42.112016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.112292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.113096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.134872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:42.136440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:42.157835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.159052 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1977/3947] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:42.174378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31386-c7b7-4f0d-a00a-e2d6846920f8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.189368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.190286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.192778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.193140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.194261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:42.194643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.196457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.218983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.225943 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1971/3948] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:04:42.231067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52efdda-35b4-47b7-9a3b-3db3c189d16d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.238967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.240238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.241080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.241568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.242524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.245032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.297579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.305752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1978/3949] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:42 2021] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:42.325680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1c11-f7bf-4f7c-855d-88557451d2ab admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.430212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.431164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.432232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.432712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.433732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.436757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.489578 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1972/3950] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:42 2021] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:42.493431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.508741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4158-9870-4d38-80f5-67136d49e55f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.513929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.514686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.514965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.515238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.515983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.518238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.535885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.543379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1979/3951] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:42 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:42.549278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289627a2-66e8-4bba-847b-4696bfb94736 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.555947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.556845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.557530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.557895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.559090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.561604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccada1-2153-4ac6-9b0d-0568fe545e60 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.581083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.582208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1973/3952] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:42 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:42.593303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464b49-8704-45cd-b59d-7ff19780ccb2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.598547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.599829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.600634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.601026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] PATH_INFO: `/v3/projects/d3486f66ff174bb3b9063479d08fa188/users/a532daccd70f4535a0dbd9ce8f512500/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.622269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3486f66ff174bb3b9063479d08fa188, user_id=a532daccd70f4535a0dbd9ce8f512500, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.626370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:42.657204 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1980/3953] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:42 2021] PUT /identity/v3/projects/d3486f66ff174bb3b9063479d08fa188/users/a532daccd70f4535a0dbd9ce8f512500/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:42.657870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.659093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.659769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.695219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] MFA Rules not processed for user `a532daccd70f4535a0dbd9ce8f512500`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:42.698415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:42.843804 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1974/3954] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:42 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:42.848261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:42.939140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad897d3-8e3c-40ba-9029-f8fd59801dfe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:42.948438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:42.949144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:42.949419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:42.949677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:42.950443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:42.952589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.021604 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1981/3955] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:42 2021] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:04:43.025473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:43.042963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5702-c952-419a-b707-d2e8e0507217 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:43.141130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:43.142248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.142696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.143139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.144122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:43.146239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.178651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1975/3956] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:43 2021] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:04:43.182998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:43.197972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296c53-7efb-453f-a478-03d8e4accfe3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:43.212373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:43.213887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.214176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.214610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.216641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:43.221988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.244944 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1982/3957] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:43.252301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:43.262494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05226f7-88ec-4966-b3de-2e7e5af5556e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:43.270795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:43.272586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.272902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.273178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] PATH_INFO: `/v3/projects/38954a9977d649a382ce3d661543c372/users/50733d7557a14bf39db5baa66c4a1830/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.290469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38954a9977d649a382ce3d661543c372, user_id=50733d7557a14bf39db5baa66c4a1830, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:43.293171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.309045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1976/3958] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:43 2021] PUT /identity/v3/projects/38954a9977d649a382ce3d661543c372/users/50733d7557a14bf39db5baa66c4a1830/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:43.313777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:43.330758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd8055-5a4c-4167-942f-f2a4b1355b06 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:43.405873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:43.406795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.407294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.407912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.408814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:43.410521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48483165-9011-4784-9ca0-8d105ee509c7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.424664 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1983/3959] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:43.427192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:43.441040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c90b-b149-4b38-a902-c6f71487a57b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:43.461949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:43.464260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.466395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.466929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] PATH_INFO: `/v3/projects/38954a9977d649a382ce3d661543c372/users/50733d7557a14bf39db5baa66c4a1830/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.472599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38954a9977d649a382ce3d661543c372, user_id=50733d7557a14bf39db5baa66c4a1830, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:43.478478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74fb15-021f-4d06-9e6e-6f3439bf0692 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:43.513693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1977/3960] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:43 2021] PUT /identity/v3/projects/38954a9977d649a382ce3d661543c372/users/50733d7557a14bf39db5baa66c4a1830/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:43.580993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.581393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.581763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.613867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] MFA Rules not processed for user `50733d7557a14bf39db5baa66c4a1830`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:43.617535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:43.722443 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1984/3961] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:43 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:43.735218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2ce6-bb87-4d58-839a-2d2551c355e2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:43.736213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2ce6-bb87-4d58-839a-2d2551c355e2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:43.736977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2ce6-bb87-4d58-839a-2d2551c355e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:43.776593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b2fc2ce6-bb87-4d58-839a-2d2551c355e2 None None] MFA Rules not processed for user `a532daccd70f4535a0dbd9ce8f512500`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:43.778512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b2fc2ce6-bb87-4d58-839a-2d2551c355e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:43.923645 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1978/3962] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:43 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:44.148089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:44.150479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:44.252792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cd7e-9875-4af6-be7a-ab5af1781952 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:44.261205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:44.262047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:44.262331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:44.262606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:44.271961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:44.274178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:44.288539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1985/3963] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:44 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:48.999580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:49.000219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:49.000219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:49.018846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] MFA Rules not processed for user `4b20a09147544f20941d8afd17c21e16`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:49.020027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:49.138839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1979/3964] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:48 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:56.153936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:56.156676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:56.255150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26bb6f-6a02-40dd-849a-1c6e848a1922 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:56.260895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:56.261766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:56.262221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:56.262674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:56.265381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:56.278987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:56.281744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:56.313153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1986/3965] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:56.532669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:56.554815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac58a-a789-40f9-9eb2-5a2b8b220e78 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:56.564713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:56.565380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:56.565818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:56.566098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:56.568068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:56.587652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:56.589476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:56.617436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1980/3966] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:56.962162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:56.963587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:57.027765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c12e6-3ba8-4fbe-bf39-062fb8f896da service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:57.032591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:57.033529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.033804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.034070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] PATH_INFO: `/v3/users/ea8ddcbae0894e4f8215c391a7991c04` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.035254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8ddcbae0894e4f8215c391a7991c04)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:57.037166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:57.084801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8ddcbae0894e4f8215c391a7991c04'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.093604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8ddcbae0894e4f8215c391a7991c04'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.094326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8ddcbae0894e4f8215c391a7991c04'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.095457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8ddcbae0894e4f8215c391a7991c04'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.108598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6078a6c2-37af-4fe4-aed6-c45d262660f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8ddcbae0894e4f8215c391a7991c04'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.137609 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1987/3967] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:56 2021] DELETE /identity/v3/users/ea8ddcbae0894e4f8215c391a7991c04 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:57.413892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:57.442928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cec8d-6922-4a42-a4bf-42d109b1440c service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:57.551430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:57.552209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.552780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.553052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] PATH_INFO: `/v3/projects/c7f317e2f65b4592bf90d1b445c80c01` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.554451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f317e2f65b4592bf90d1b445c80c01)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:57.556714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:57.614900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f317e2f65b4592bf90d1b445c80c01', 'request_id': 'req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.623239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f317e2f65b4592bf90d1b445c80c01', 'request_id': 'req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.633643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f317e2f65b4592bf90d1b445c80c01', 'request_id': 'req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.655813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] The token cache is being invalidate because project c7f317e2f65b4592bf90d1b445c80c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:57.656360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.657251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-195f330b-97b1-4e3b-88ae-7a7159a0f2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:57.660082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1981/3968] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:57 2021] DELETE /identity/v3/projects/c7f317e2f65b4592bf90d1b445c80c01 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:57.666898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.667897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.668308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.697472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:57.699189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:57.785312 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1988/3969] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:57.794178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.794481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.794822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.819426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:57.831641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:57.842891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:57.844898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:57.863019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1982/3970] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:57.864083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:57.891230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48430e58-a038-44a5-ab80-417f00c12e54 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:57.897375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:57.898263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.898717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.899160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.900054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:57.900522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:57.902569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:57.919355 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1983/3971] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:04:57.920482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:57.931772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fece-f5b0-4406-9dd3-956ffb3bf341 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:57.937814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:57.938686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.938986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.939418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.940033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:57.942381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:57.965864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758ede-b694-4866-8ab5-6b8d7acb56ae None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:57.977161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:57.978233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:57.978752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:57.979124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:57.981177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1984/3972] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:57 2021] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:57.981733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:57.985498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.058923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893e7b-e67c-4f3c-b46a-5270acfb1e92 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.064539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.065365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.065803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.066168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.066942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.068953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.090041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.093192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.102066 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1985/3973] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:57 2021] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:58.103105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.108298 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1989/3974] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:57 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:04:58.113940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396e3d-6219-4d33-aa0b-a509d70fe2ae admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.119339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.120203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.120688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.121127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.122139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.124902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.145110 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1986/3975] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:04:58.145743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.158166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799860a-09bf-4cf4-b45c-feee73d76ec8 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.165006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.166021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.166566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.166965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.167910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.170567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d144-1d09-4bd8-9893-80223cc6a24c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.190251 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1990/3976] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:04:58.191631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.212254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c01a-34fb-482c-b3e8-7bbcc81d9b4e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.218083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.218987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.219267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.219541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] PATH_INFO: `/v3/projects/04ab059933214f588a9aa0e13cb1ddeb/users/2e9e49e0c8df405796720c107ca4e8b4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.236330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ab059933214f588a9aa0e13cb1ddeb, user_id=2e9e49e0c8df405796720c107ca4e8b4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.239376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf9d94-9ce7-4ed9-a6b5-e76e61cfb695 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.270069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1987/3977] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:58 2021] PUT /identity/v3/projects/04ab059933214f588a9aa0e13cb1ddeb/users/2e9e49e0c8df405796720c107ca4e8b4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:58.277807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.278101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.278412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.316044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] MFA Rules not processed for user `2e9e49e0c8df405796720c107ca4e8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:58.317975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:58.399424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1991/3978] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:58 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:58.409403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.409639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.409965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.437533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] MFA Rules not processed for user `2e9e49e0c8df405796720c107ca4e8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:58.438922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:58.450624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1988/3979] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:58 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:58.527226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.530118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:58.642591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482607d9-31cd-4466-9994-681299ba02a5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.656056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.656594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.656933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.657427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.668418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.671351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:58.685720 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1992/3980] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:04:58 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:04:58.876040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:58.877563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:58.954660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8ce1-939e-4553-b5f2-033e2b211386 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:58.959298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:58.960389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:58.960899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:58.961169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] PATH_INFO: `/v3/users/ea2779eda54843f6a018d81a2d74e3b0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:58.962583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2779eda54843f6a018d81a2d74e3b0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:58.964697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.038791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2779eda54843f6a018d81a2d74e3b0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.049355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2779eda54843f6a018d81a2d74e3b0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.050421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2779eda54843f6a018d81a2d74e3b0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.066244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2779eda54843f6a018d81a2d74e3b0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.078035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ca654d83-d1cb-46ad-b9f5-d1e5c8bc48c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2779eda54843f6a018d81a2d74e3b0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.108623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1989/3981] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:04:58 2021] DELETE /identity/v3/users/ea2779eda54843f6a018d81a2d74e3b0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:59.367146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.381042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc04dfe-ed27-4ad5-8185-602d223e1f6c service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.461139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.462504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.462885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.463258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] PATH_INFO: `/v3/projects/244a8033b1724ecbb48b20fea4dbfed2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.464589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244a8033b1724ecbb48b20fea4dbfed2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.466691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.527001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244a8033b1724ecbb48b20fea4dbfed2', 'request_id': 'req-7a012aa9-874b-4765-a679-ce3186a6deb0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.534141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244a8033b1724ecbb48b20fea4dbfed2', 'request_id': 'req-7a012aa9-874b-4765-a679-ce3186a6deb0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.544428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244a8033b1724ecbb48b20fea4dbfed2', 'request_id': 'req-7a012aa9-874b-4765-a679-ce3186a6deb0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.562185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] The token cache is being invalidate because project 244a8033b1724ecbb48b20fea4dbfed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:04:59.562468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.563279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a012aa9-874b-4765-a679-ce3186a6deb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:04:59.565240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1993/3982] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:04:59 2021] DELETE /identity/v3/projects/244a8033b1724ecbb48b20fea4dbfed2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:04:59.572663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.573137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.573471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.594041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:59.595410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:59.663784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1990/3983] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:59.672942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.673496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.673496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.695998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:04:59.698083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:04:59.707421 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1994/3984] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:04:59.711672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.722757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3920ffb-a3a7-43a7-ad23-3693d878dfe7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.727863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.728547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.728859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.729132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.729867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:04:59.730165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.731779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.748648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1991/3985] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:04:59.750801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.760202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0248c-63c6-44c2-aaea-efac2f1224d7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.764893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.765539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.765823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.766092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.766799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.768678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.798353 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1995/3986] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:04:59 2021] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:04:59.806675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.818048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5c2e4-4bc1-4caf-8685-23dcc492ae8b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.885969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.886658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.886898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.887176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.887935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.890023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.913633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1992/3987] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:04:59 2021] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:04:59.917613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.928218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba50f0-319a-4fda-8a1d-77a4c8e0a235 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.933036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.933764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.934117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.934457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.935316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.948476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.961048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1996/3988] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:04:59.964888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:04:59.975244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1334d4-3b15-488c-9050-b6b7efad02dd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:04:59.980030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:04:59.980727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:04:59.981008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:04:59.981278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:04:59.983447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:04:59.985255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdbee1-4325-401a-90c6-01edf0b85d1a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:04:59.996098 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1993/3989] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:00.000753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:00.010727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc700b-3547-457e-8a4c-3f6a52096144 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:00.019489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:00.020545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:00.021140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:00.021965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] PATH_INFO: `/v3/projects/922909b8fd6a4f5abf9817fc893e8e7a/users/96d29211fc5841fda3fddea9f63b086c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:00.040759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=922909b8fd6a4f5abf9817fc893e8e7a, user_id=96d29211fc5841fda3fddea9f63b086c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:00.043995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:00.060827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1997/3990] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:04:59 2021] PUT /identity/v3/projects/922909b8fd6a4f5abf9817fc893e8e7a/users/96d29211fc5841fda3fddea9f63b086c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:00.065742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:00.066330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:00.066772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:00.088643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:00.090823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:00.178411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1994/3991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:00.189663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:00.191515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:00.258049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f522-7eaf-4b6f-9668-a30ef10aa2ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:00.262477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:00.263137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:00.263495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:00.263967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:00.298915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:00.304885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994502a5-ed04-4c17-9fa2-5a38b563b881 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:00.328922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1998/3992] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:02.428841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:02.431083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:02.471387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3967-013f-41a3-af3c-0cd8881c8392 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:02.484227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:02.486499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:02.486966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:02.487248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] PATH_INFO: `/v3/users/a532daccd70f4535a0dbd9ce8f512500` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:02.491788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a532daccd70f4535a0dbd9ce8f512500)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:02.493926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:02.624652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a532daccd70f4535a0dbd9ce8f512500'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:02.641689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a532daccd70f4535a0dbd9ce8f512500'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:02.644881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a532daccd70f4535a0dbd9ce8f512500'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:02.677023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a532daccd70f4535a0dbd9ce8f512500'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:02.692466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a532daccd70f4535a0dbd9ce8f512500'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:02.705915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1995/3993] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:05:02 2021] DELETE /identity/v3/users/a532daccd70f4535a0dbd9ce8f512500 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:02.707441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:02.708249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:02.708533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:02.738900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:02.742878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:02.863585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 1999/3994] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:02.913841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:02.916647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:03.026497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cdda0-1446-4330-9eb7-7dd85ac2b9e7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:03.036783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:03.038115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:03.039237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:03.057328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:03.093007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:03.095411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:03.120585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1996/3995] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:03.677291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:03.684532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:03.702384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dc1d1-ae78-4b0e-aa79-68f6555718d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:03.721684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:03.722570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:03.722854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:03.723131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] PATH_INFO: `/v3/projects/d3486f66ff174bb3b9063479d08fa188` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:03.724371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3486f66ff174bb3b9063479d08fa188)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:03.726544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:03.822564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3486f66ff174bb3b9063479d08fa188', 'request_id': 'req-7558593e-7268-4114-bb8d-78749d822b18'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:03.831171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3486f66ff174bb3b9063479d08fa188', 'request_id': 'req-7558593e-7268-4114-bb8d-78749d822b18'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:03.841329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3486f66ff174bb3b9063479d08fa188', 'request_id': 'req-7558593e-7268-4114-bb8d-78749d822b18'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:03.857465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] The token cache is being invalidate because project d3486f66ff174bb3b9063479d08fa188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:05:03.857775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:03.858850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:03.860584 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2000/3996] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:05:03 2021] DELETE /identity/v3/projects/d3486f66ff174bb3b9063479d08fa188 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:03.864912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:03.879645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a99ee-45f6-44fb-b7e2-32fd51b55ee8 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:03.984402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:03.985593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:03.986430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:03.986909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] PATH_INFO: `/v3/users/50733d7557a14bf39db5baa66c4a1830` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:03.989145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50733d7557a14bf39db5baa66c4a1830)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:03.992973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:04.064964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50733d7557a14bf39db5baa66c4a1830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:04.074860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50733d7557a14bf39db5baa66c4a1830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:04.075688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50733d7557a14bf39db5baa66c4a1830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:04.093019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50733d7557a14bf39db5baa66c4a1830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:04.104454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-22174de8-8353-4ee6-a82a-2ff7fb873b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50733d7557a14bf39db5baa66c4a1830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:04.117530 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1997/3997] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:05:03 2021] DELETE /identity/v3/users/50733d7557a14bf39db5baa66c4a1830 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:05.211645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:05.213258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:05.238230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558593e-7268-4114-bb8d-78749d822b18 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:05.335121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:05.336296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.336784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.337230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] PATH_INFO: `/v3/projects/38954a9977d649a382ce3d661543c372` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.339872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38954a9977d649a382ce3d661543c372)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:05.345130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:05.414133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38954a9977d649a382ce3d661543c372', 'request_id': 'req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:05.420889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38954a9977d649a382ce3d661543c372', 'request_id': 'req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:05.430379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38954a9977d649a382ce3d661543c372', 'request_id': 'req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:05.457207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] The token cache is being invalidate because project 38954a9977d649a382ce3d661543c372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:05:05.457942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:05.458926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-71ba0d87-9ed3-4ce2-b4f7-8c907dc60a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:05.461066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2001/3998] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:05:05 2021] DELETE /identity/v3/projects/38954a9977d649a382ce3d661543c372 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:05.467858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.468375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.468375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.514635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:05.516477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:05.625847 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1998/3999] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:05.628382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.628639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.629008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.668101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:05.669374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:05.680586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2002/4000] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:05.693203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:05.713950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46c7ad-630c-41fe-912c-e695297169bc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:05.724916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:05.727365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.727691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.727972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.732712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:05:05.732712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:05.738740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:05.768061 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 1999/4001] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:05:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:05:05.773891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:05.783454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cf164-3e19-49b2-9d46-51f6bfc132db None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:05.799304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:05.799986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.800263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.800554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.801396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:05.814277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:05.869935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2003/4002] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:05:05 2021] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:05.874890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:05.887487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e011-33c2-43fd-9826-f240ab3f9e82 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:05.963649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:05.964470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:05.964837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:05.966028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:05.967010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:05.969336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.001985 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2000/4003] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:05:05 2021] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:06.006635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.018854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a91066-1f53-4892-b0f1-3c69b9a778d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.042066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.044327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.045445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.045895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.052154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.055061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.093889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2004/4004] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:06 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:06.095940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.118453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0977fa-600a-4442-8773-d508403c3eb4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.131479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.132218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.132503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.133147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.134015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.135695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854fb49-af6a-4876-a4ed-1fb1570dd635 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.174948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.178186 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2001/4005] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:06 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:06.191178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c42b5-7c16-4462-b27c-8bb2ab63c2e5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.205531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.206531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.206908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.207277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] PATH_INFO: `/v3/projects/e1c973c6baca4920be3d9c09587c79c8/users/f7d9b8cbb4534bad97a81d8ca968209a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.239860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c973c6baca4920be3d9c09587c79c8, user_id=f7d9b8cbb4534bad97a81d8ca968209a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.245105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.275372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2005/4006] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:06 2021] PUT /identity/v3/projects/e1c973c6baca4920be3d9c09587c79c8/users/f7d9b8cbb4534bad97a81d8ca968209a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:06.285293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.285639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.285840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.386299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] MFA Rules not processed for user `f7d9b8cbb4534bad97a81d8ca968209a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:06.389204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:06.530009 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2002/4007] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:06 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:06.530671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.630775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018803f6-80a3-4d1a-b634-ba514ad8967e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.641019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.642532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.642532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.642532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.643366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.645952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.705648 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2006/4008] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:05:06 2021] POST /identity/v3/projects => generated 393 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:05:06.709377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.731269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca39e98-ccc7-43ce-964c-2d44132acd5c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.854582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.855550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.857057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.857744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.860301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.862475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.910954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2003/4009] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:05:06 2021] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:06.911641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.925556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845b3e-f433-436d-9d63-87d2ccb87c8f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.936025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:06.936740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:06.937013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:06.937482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:06.942628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:06.950448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:06.964569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2007/4010] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:06 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:06.968645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:06.990777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59582b3-95ea-4660-9b6c-56ed81020b5c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:06.997560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.000537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.000955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.001296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] PATH_INFO: `/v3/projects/8c8c5fc51c7646fd834da9522795046f/users/98a1983ff1f74ed68560e1ae147d1666/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.021045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8c5fc51c7646fd834da9522795046f, user_id=98a1983ff1f74ed68560e1ae147d1666, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.025237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.049920 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2004/4011] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:06 2021] PUT /identity/v3/projects/8c8c5fc51c7646fd834da9522795046f/users/98a1983ff1f74ed68560e1ae147d1666/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:07.053874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.086640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd5b9-43b0-49ed-b683-b68ce64e696c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:07.180537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.181383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.181759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.182129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.182988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.189451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d655-ab7c-410b-b54e-567721c582c9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.205427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.212431 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2008/4012] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:07 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:07.218843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b75f-9779-4247-a5ea-1433d8973df6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:07.224636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.225649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.226025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.226394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] PATH_INFO: `/v3/projects/8c8c5fc51c7646fd834da9522795046f/users/98a1983ff1f74ed68560e1ae147d1666/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.228537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8c5fc51c7646fd834da9522795046f, user_id=98a1983ff1f74ed68560e1ae147d1666, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.231440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.255619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2005/4013] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:07 2021] PUT /identity/v3/projects/8c8c5fc51c7646fd834da9522795046f/users/98a1983ff1f74ed68560e1ae147d1666/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:07.257186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f7c3-dbc7-45a0-9402-c1791c4d4963 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.258092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f7c3-dbc7-45a0-9402-c1791c4d4963 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.258617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f7c3-dbc7-45a0-9402-c1791c4d4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.318745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5f79f7c3-dbc7-45a0-9402-c1791c4d4963 None None] MFA Rules not processed for user `98a1983ff1f74ed68560e1ae147d1666`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:07.335723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f79f7c3-dbc7-45a0-9402-c1791c4d4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:07.501377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2009/4014] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:07 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:07.508436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.510170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:07.610470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3412-6fee-45e8-9128-bc362dbc7461 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.611022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3412-6fee-45e8-9128-bc362dbc7461 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.611482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3412-6fee-45e8-9128-bc362dbc7461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.659472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2ea0-9546-4b7b-8d3b-68f5094d1838 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:07.660984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-315f3412-6fee-45e8-9128-bc362dbc7461 None None] MFA Rules not processed for user `96d29211fc5841fda3fddea9f63b086c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:07.664211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-315f3412-6fee-45e8-9128-bc362dbc7461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:07.666226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.666823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.667341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.667654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.679795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.681587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.692297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2006/4015] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:07 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:07.753890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.769893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac8ef-6245-49b5-9721-e4f8ba06e330 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:07.785319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.786093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.786368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.786638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.823370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2010/4016] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:07 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:07.833151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.833427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.833750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.875960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] MFA Rules not processed for user `96d29211fc5841fda3fddea9f63b086c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:07.877889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:07.892314 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2011/4017] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:07 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:07.910625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.910865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.912466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:07.912800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.924829 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2007/4018] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:07 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:05:07.932711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2f01-7e89-4de5-aa69-d2b1bf5c31de None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:07.940588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:07.940952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:07.941721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:07.942104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:07.942481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:07.953230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:07.955067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda0a84-5501-4802-b69d-620d954a1c03 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:07.970277 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2012/4019] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:07 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:08.055377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f83e4-10a8-4941-a900-4ffb1428a1df service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:08.064088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:08.065830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:08.066250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:08.066713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] PATH_INFO: `/v3/users/f7d9b8cbb4534bad97a81d8ca968209a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:08.069406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d9b8cbb4534bad97a81d8ca968209a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:08.071433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:08.127451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d9b8cbb4534bad97a81d8ca968209a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:08.148058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d9b8cbb4534bad97a81d8ca968209a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:08.148894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d9b8cbb4534bad97a81d8ca968209a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:08.164709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d9b8cbb4534bad97a81d8ca968209a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:08.177870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d9b8cbb4534bad97a81d8ca968209a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:08.194155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2008/4020] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:05:07 2021] DELETE /identity/v3/users/f7d9b8cbb4534bad97a81d8ca968209a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:08.199110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a874f-e008-4ea8-91e3-4e963cadf2cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:08.199390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a874f-e008-4ea8-91e3-4e963cadf2cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:08.199619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a874f-e008-4ea8-91e3-4e963cadf2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:08.224098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8b5a874f-e008-4ea8-91e3-4e963cadf2cc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:08.225337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b5a874f-e008-4ea8-91e3-4e963cadf2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:08.292968 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2013/4021] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:08.303575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:08.306942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:08.383632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e09bc-ecdf-4588-98c3-ccaef087fc93 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:08.391634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:08.391634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:08.391634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:08.391634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:08.410470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:08.414581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:08.425541 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2009/4022] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:08.856452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:08.856794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:08.857649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:08.888018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] MFA Rules not processed for user `96d29211fc5841fda3fddea9f63b086c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:08.889554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:08.974880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:08.976250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:08.986008 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2014/4023] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:08 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:08.991639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7bad1-ed13-4003-8208-9382d6a9e445 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:09.002841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:09.004517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:09.004981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:09.006440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] PATH_INFO: `/v3/projects/e1c973c6baca4920be3d9c09587c79c8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:09.031013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c973c6baca4920be3d9c09587c79c8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:09.052529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:09.150667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c973c6baca4920be3d9c09587c79c8', 'request_id': 'req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.157746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c973c6baca4920be3d9c09587c79c8', 'request_id': 'req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.168392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c973c6baca4920be3d9c09587c79c8', 'request_id': 'req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.195505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] The token cache is being invalidate because project e1c973c6baca4920be3d9c09587c79c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:05:09.196340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.198066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.200395 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2010/4024] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:05:08 2021] DELETE /identity/v3/projects/e1c973c6baca4920be3d9c09587c79c8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:09.204336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:09.233268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518456b2-6e4a-423f-87bc-46420abdcac5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:09.426172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:09.428269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:09.428932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:09.429243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] PATH_INFO: `/v3/users/98a1983ff1f74ed68560e1ae147d1666` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:09.433163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a1983ff1f74ed68560e1ae147d1666)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:09.435718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:09.557449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a1983ff1f74ed68560e1ae147d1666'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.566809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a1983ff1f74ed68560e1ae147d1666'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.567524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a1983ff1f74ed68560e1ae147d1666'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.568131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a1983ff1f74ed68560e1ae147d1666'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.582974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e8cf8e9-0bf7-4358-b718-1a5b357946ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a1983ff1f74ed68560e1ae147d1666'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:09.646044 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2015/4025] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:05:09 2021] DELETE /identity/v3/users/98a1983ff1f74ed68560e1ae147d1666 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:10.212224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:10.213726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:10.243813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f2fb5-2bdc-49ac-b365-b6bf8f495583 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:10.440343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:10.442623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.443129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.443613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] PATH_INFO: `/v3/projects/8c8c5fc51c7646fd834da9522795046f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.446206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8c5fc51c7646fd834da9522795046f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:10.448847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:10.519542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8c5fc51c7646fd834da9522795046f', 'request_id': 'req-a1daa915-b6de-4da4-a163-a90f2ef937d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:10.529795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8c5fc51c7646fd834da9522795046f', 'request_id': 'req-a1daa915-b6de-4da4-a163-a90f2ef937d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:10.549139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8c5fc51c7646fd834da9522795046f', 'request_id': 'req-a1daa915-b6de-4da4-a163-a90f2ef937d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:10.572515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] The token cache is being invalidate because project 8c8c5fc51c7646fd834da9522795046f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:05:10.572760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:10.573635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1daa915-b6de-4da4-a163-a90f2ef937d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:05:10.578382 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2011/4026] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:05:10 2021] DELETE /identity/v3/projects/8c8c5fc51c7646fd834da9522795046f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:10.591180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f05e-81d9-4818-a883-883672de34c7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.592314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f05e-81d9-4818-a883-883672de34c7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.592731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f05e-81d9-4818-a883-883672de34c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.620032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593902-32a8-4bb1-9e5a-cc5e783bb154 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.620488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593902-32a8-4bb1-9e5a-cc5e783bb154 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.620878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593902-32a8-4bb1-9e5a-cc5e783bb154 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.624311 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2012/4027] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:05:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:05:10.638907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-45e7f05e-81d9-4818-a883-883672de34c7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:10.644961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103408-185c-4b72-b752-c977abfab5ea None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.645203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45e7f05e-81d9-4818-a883-883672de34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:10.645507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103408-185c-4b72-b752-c977abfab5ea None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.645949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103408-185c-4b72-b752-c977abfab5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.687602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-15103408-185c-4b72-b752-c977abfab5ea None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:10.689743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-15103408-185c-4b72-b752-c977abfab5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:10.840272 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2016/4028] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:10.851036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.852088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.852088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.870977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2013/4029] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:05:10 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:10.880594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:10.886283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:10.898135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2017/4030] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:10.902136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103408-185c-4b72-b752-c977abfab5ea None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:10.917007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:10.920417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103408-185c-4b72-b752-c977abfab5ea None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:10.920897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:10.930682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:10.932099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.932383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.932677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.938476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:05:10.938899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:10.943004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:10.962792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2014/4031] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:05:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:05:10.963008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c382ea-b7a1-4f89-8092-381c9febb689 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:10.964179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:10.977112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b76b8-58c0-4381-b273-06d4fc4e8c68 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:10.981826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:10.984105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:10.984535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.984844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.985152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:10.985381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:10.985707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.986305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:10.986506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:10.988592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.005827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.011288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.034132 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2018/4032] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:11.038961 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2015/4033] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:05:10 2021] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:05:11.041580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:11.058619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef228f-175b-40c8-bd7b-cc51cff31c25 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:11.200786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:11.205188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.205495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.205780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.206597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.217187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.274619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2019/4034] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:05:11 2021] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:11.277474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:11.307997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c50-d393-488c-ae65-7c20f7d7cd80 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:11.322486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:11.323807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.324305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.324866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.326243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.328115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.362263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2016/4035] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:11 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:11.365475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:11.381040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88576-3b1e-495b-9c26-41662b780503 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:11.403278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:11.404812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.405542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.406207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.421344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.424676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82641bac-4758-432a-8aad-cfc3bc512d5f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.458787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2020/4036] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:11 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:11.464127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:11.487510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1a8e-85a2-457b-82c9-bae19fd52074 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:11.498621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:11.499923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.500556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.501111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] PATH_INFO: `/v3/projects/98d2add7649d478b822e887bff3db0d9/users/f900805fbd3e4508bb42f780bf00491f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.533673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d2add7649d478b822e887bff3db0d9, user_id=f900805fbd3e4508bb42f780bf00491f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.551463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.613675 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2017/4037] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:11 2021] PUT /identity/v3/projects/98d2add7649d478b822e887bff3db0d9/users/f900805fbd3e4508bb42f780bf00491f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:11.619564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfd30-aa55-4872-88de-6eef946e8e34 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.620858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfd30-aa55-4872-88de-6eef946e8e34 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.621382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfd30-aa55-4872-88de-6eef946e8e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.649503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-78fdfd30-aa55-4872-88de-6eef946e8e34 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:11.651438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-78fdfd30-aa55-4872-88de-6eef946e8e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:11.767931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2021/4038] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:11.777109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:11.779577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:11.855634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd37ab-c91a-42f8-b349-6e02c822ad9e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:11.860586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:11.861390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:11.861773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:11.862147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:11.874750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:11.876580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:11.892655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2018/4039] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:18.567278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a90-0ddb-4e27-9af1-3ec77d7f41d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:18.568284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a90-0ddb-4e27-9af1-3ec77d7f41d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:18.568792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a90-0ddb-4e27-9af1-3ec77d7f41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:18.603289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-48be5a90-0ddb-4e27-9af1-3ec77d7f41d8 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:18.606846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-48be5a90-0ddb-4e27-9af1-3ec77d7f41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:18.755671 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2022/4040] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:05:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:18.802866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:18.805674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:18.904511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93b5b-f85a-4508-9807-33fbd396a848 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:18.905915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:18.906464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:18.906464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:18.911931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:18.912765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:18.913064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:18.913367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:18.927128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:18.930367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:18.959257 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2019/4041] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:05:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:05:18.982186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] MFA Rules not processed for user `f900805fbd3e4508bb42f780bf00491f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:18.985375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:19.154214 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2023/4042] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:19.157146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:19.172420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975869e-269f-4dec-ae55-4429d0cfbf4e service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:19.184363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:19.187076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:19.187870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:19.188393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:19.190481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:19.192907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:19.237333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2020/4043] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:05:19 2021] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:19.239068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:19.260020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7cf19-132d-44c9-b348-ab0db9ad437e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:19.477477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:19.480397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:19.480937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:19.482702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:19.484167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:19.491984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:19.554904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2024/4044] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:05:19 2021] POST /identity/v3/users => generated 299 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:05:19.558197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:19.574948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6daa35-9e6b-4903-a614-ad670cf3c07e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:19.598768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:19.599768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:19.600550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:19.602945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:19.606902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:19.608750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:19.647397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:19.655631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2021/4045] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:19.665660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9356-f240-49e8-89b0-92757e78fc84 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:19.679560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:19.680968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:19.683840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:19.685777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] PATH_INFO: `/v3/projects/695d59928f7741bebf381d7911052a99/users/83a9542b24e040249134f9ab82b6f548/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:19.733982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695d59928f7741bebf381d7911052a99, user_id=83a9542b24e040249134f9ab82b6f548, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:19.737287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:19.764747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2025/4046] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:19 2021] PUT /identity/v3/projects/695d59928f7741bebf381d7911052a99/users/83a9542b24e040249134f9ab82b6f548/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:05:19.769157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:19.804502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d1590-4f83-4958-81d1-be023098a026 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:19.979881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:19.980864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:19.983629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:19.985609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:19.986601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:19.989850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090ca3-0c31-4368-ab81-24c5161457ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:20.026105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2022/4047] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:05:20.029675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:20.049910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef882cf-f9ec-476f-8664-a722df0d1b82 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:20.057994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:20.060827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:20.061346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:20.061793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] PATH_INFO: `/v3/projects/695d59928f7741bebf381d7911052a99/users/83a9542b24e040249134f9ab82b6f548/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:20.064405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695d59928f7741bebf381d7911052a99, user_id=83a9542b24e040249134f9ab82b6f548, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:20.067442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:20.088298 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2026/4048] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:05:20 2021] PUT /identity/v3/projects/695d59928f7741bebf381d7911052a99/users/83a9542b24e040249134f9ab82b6f548/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:05:30.585367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52451-4c32-4394-964f-9baf182aa9f3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:30.585968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52451-4c32-4394-964f-9baf182aa9f3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:30.585968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52451-4c32-4394-964f-9baf182aa9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:30.626393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-69f52451-4c32-4394-964f-9baf182aa9f3 None None] MFA Rules not processed for user `83a9542b24e040249134f9ab82b6f548`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:30.628704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-69f52451-4c32-4394-964f-9baf182aa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:30.731336 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2023/4049] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:30 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:30.751399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:30.755285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:30.905292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf9c7-f849-4742-a4f5-a01963d1be61 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:30.910493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:30.913687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:30.914179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:30.914778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:30.953043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:30.960220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73d96-040f-47a4-a744-b8db3e9385df service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:31.006296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2027/4050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:30 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:35.565438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:35.566111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:35.566111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:35.598283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] MFA Rules not processed for user `4b20a09147544f20941d8afd17c21e16`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:35.600086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:35.683649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2024/4051] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:35 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:44.199200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ade2-82aa-43a2-a47a-09f5df5a68f6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:44.200959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ade2-82aa-43a2-a47a-09f5df5a68f6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:44.201422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ade2-82aa-43a2-a47a-09f5df5a68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:44.255844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f083ade2-82aa-43a2-a47a-09f5df5a68f6 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:44.257639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f083ade2-82aa-43a2-a47a-09f5df5a68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:44.374909 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2028/4052] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:05:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:44.396526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:44.499279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b463cc-5a3b-4fca-9f3f-6853dc05d8eb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:44.503278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:44.504191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:44.504692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:44.505083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:44.514242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:44.515986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:44.524530 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2025/4053] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:05:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:05:44.976143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84acc23-ebfb-457a-af81-afd114fef0b4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:44.976472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84acc23-ebfb-457a-af81-afd114fef0b4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:44.978216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84acc23-ebfb-457a-af81-afd114fef0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:45.004499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a84acc23-ebfb-457a-af81-afd114fef0b4 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:45.006154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a84acc23-ebfb-457a-af81-afd114fef0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:45.021513 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2029/4054] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:05:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:05:45.040080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:45.055398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd482-d949-420a-920d-ca3476c026d9 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:45.073583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:45.078056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:45.078562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:45.079165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:45.090626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:45.094741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:45.120344 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2026/4055] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:05:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:05:49.110051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1470a-8eb1-43db-91eb-77e8d346b478 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:49.113221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1470a-8eb1-43db-91eb-77e8d346b478 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:49.113788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1470a-8eb1-43db-91eb-77e8d346b478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:49.141221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-adc1470a-8eb1-43db-91eb-77e8d346b478 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:49.142433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-adc1470a-8eb1-43db-91eb-77e8d346b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:49.151709 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2030/4056] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:05:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:49.173581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:49.188599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fd21b-766f-4bcc-83c4-65a1d5e4b763 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:49.199510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:49.201262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:49.201602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:49.201963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:49.219036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:49.221808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba39e5-c08b-4967-a3f3-01ee224cdb44 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:49.232543 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2027/4057] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:05:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:05:57.048996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:57.049608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:57.049608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:57.051541 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2031/4058] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:05:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:05:57.060221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f0bb-f7e9-43e3-a71c-6ce59fa4c2f0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:57.061225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f0bb-f7e9-43e3-a71c-6ce59fa4c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:57.062223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f0bb-f7e9-43e3-a71c-6ce59fa4c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:57.090294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5134f0bb-f7e9-43e3-a71c-6ce59fa4c2f0 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:57.092810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5134f0bb-f7e9-43e3-a71c-6ce59fa4c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:57.205054 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2028/4059] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:05:57 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:57.217449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:57.222311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:57.246189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe77a-0bed-4570-b9da-a5eb554f069b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:57.253091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:57.253969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:57.254495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:57.254937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:57.267639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:57.269583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:57.310627 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2032/4060] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:57.713079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:57.713402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:57.713676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:57.745009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] MFA Rules not processed for user `f900805fbd3e4508bb42f780bf00491f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:05:57.746345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:57.833579 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2029/4061] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:05:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:05:58.021178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:58.022860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:58.133448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd72f8f-cca7-4834-8d11-be45374d537e service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:58.138221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:58.138924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:58.140069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:58.141166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:58.143111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:05:58.145209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:58.153030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:05:58.260970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e2176-1bfe-4d2c-ac36-86d28a9fc859 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:05:58.268233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:05:58.268982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:05:58.269261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:05:58.269866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:05:58.281801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:58.283270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40682-8e36-407f-880b-ea5f73f63ec3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:58.285462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:05:58.287471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:05:58.299796 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2033/4062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:05:58.323623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2030/4063] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:05:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:06:02.441304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae5cc8-a871-4967-a8fe-a6a8a0af511c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:02.441857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae5cc8-a871-4967-a8fe-a6a8a0af511c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:02.441857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae5cc8-a871-4967-a8fe-a6a8a0af511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:02.474494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-71ae5cc8-a871-4967-a8fe-a6a8a0af511c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:02.475768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71ae5cc8-a871-4967-a8fe-a6a8a0af511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:02.503638 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2034/4064] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:06:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:02.522559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:02.538198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4104e-1c7f-495f-b7e8-ddf9953dbbb7 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:02.562532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:02.563294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:02.571859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:02.572141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:02.607452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:02.610594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:02.669273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2031/4065] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:06:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:06:03.879862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff224b4-d43b-4c9f-a03f-2419b4e4d348 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:03.880504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff224b4-d43b-4c9f-a03f-2419b4e4d348 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:03.880860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff224b4-d43b-4c9f-a03f-2419b4e4d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:03.909950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7ff224b4-d43b-4c9f-a03f-2419b4e4d348 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:03.911332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ff224b4-d43b-4c9f-a03f-2419b4e4d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:03.920834 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2035/4066] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:06:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:06:03.949193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:03.963865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb05cd-0596-4929-aa8b-709494c5ecdc service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:03.972384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:03.973474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:03.974241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:03.974726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:03.987163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:03.989214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d68d9-8344-4705-982c-9f76fb9a8b32 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:04.001090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2032/4067] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:06:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:06:12.113561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b00a-7e54-4dd4-b9ec-32d882a3ce03 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:12.114173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b00a-7e54-4dd4-b9ec-32d882a3ce03 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:12.114173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b00a-7e54-4dd4-b9ec-32d882a3ce03 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:12.115936 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2036/4068] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:06:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:06:12.121834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:12.122295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:12.122412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:12.141485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:12.157644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:12.170562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2033/4069] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:06:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:12.192542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263b00a-7e54-4dd4-b9ec-32d882a3ce03 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:12.204109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263b00a-7e54-4dd4-b9ec-32d882a3ce03 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:12.207958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:12.208594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:12.208947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:12.209279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:12.218008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:12.219585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0b18-9e97-4078-90df-a8a254c5b320 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:12.229431 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2037/4070] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:06:17.420230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:17.421939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:17.495526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b580161-7286-47cf-bce0-72a5eb1b2100 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:17.501641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:17.502559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:17.502831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:17.503101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] PATH_INFO: `/v3/users/2e9e49e0c8df405796720c107ca4e8b4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:17.504320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9e49e0c8df405796720c107ca4e8b4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:17.506263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:17.563757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9e49e0c8df405796720c107ca4e8b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:17.571762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9e49e0c8df405796720c107ca4e8b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:17.572571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9e49e0c8df405796720c107ca4e8b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:17.585293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9e49e0c8df405796720c107ca4e8b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:17.592851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9e49e0c8df405796720c107ca4e8b4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:17.600392 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2034/4071] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:17 2021] DELETE /identity/v3/users/2e9e49e0c8df405796720c107ca4e8b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:17.605102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:17.605648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:17.605648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:17.638236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:17.639414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:17.763316 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2038/4072] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:06:17.779682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:17.781684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:17.860555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7a35-a16d-41f5-84b7-e5287bbee5c2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:17.864351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:17.865099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:17.865451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:17.865717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:17.875781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:17.877268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccce3e-8a08-4a15-bb24-77b65dccb954 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:17.886830 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2035/4073] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:06:18.114415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.115981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:18.132862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0b177-46b5-485b-bdb7-55d80a698b44 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.137697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.138552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.138940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.139181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] PATH_INFO: `/v3/projects/04ab059933214f588a9aa0e13cb1ddeb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.140687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ab059933214f588a9aa0e13cb1ddeb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.142978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.212545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ab059933214f588a9aa0e13cb1ddeb', 'request_id': 'req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:18.219305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ab059933214f588a9aa0e13cb1ddeb', 'request_id': 'req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:18.227121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ab059933214f588a9aa0e13cb1ddeb', 'request_id': 'req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:18.246119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] The token cache is being invalidate because project 04ab059933214f588a9aa0e13cb1ddeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:18.246506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:18.247221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa9b6bb-a0c5-41ca-a3e4-7954e2e3a95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:18.248887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2039/4074] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:18 2021] DELETE /identity/v3/projects/04ab059933214f588a9aa0e13cb1ddeb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:18.255127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba914e-5357-4946-ac91-ee7824911165 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.255405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba914e-5357-4946-ac91-ee7824911165 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.255883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba914e-5357-4946-ac91-ee7824911165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.273980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-beba914e-5357-4946-ac91-ee7824911165 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:18.275629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-beba914e-5357-4946-ac91-ee7824911165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:18.338400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2036/4075] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:18.346592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.346877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.347146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.368412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:18.369995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:18.380527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2040/4076] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:18.385157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba914e-5357-4946-ac91-ee7824911165 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.398215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba914e-5357-4946-ac91-ee7824911165 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.405428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.406084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.406358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.406624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.407385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:06:18.407678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.409367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.421055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2037/4077] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:06:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:06:18.425393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.434553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b268b59-97d1-43b6-b70c-910c8a1736e5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.439105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.439744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.440023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.440295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.441033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.442939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.471707 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2041/4078] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:18 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:18.476134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.486464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d51c1-34de-456c-b5ad-edf19b596401 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.545317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.546110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.546460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.546690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.547373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.549533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.575641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2038/4079] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:18 2021] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:18.579706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.592774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735f1f-7918-4677-97d2-bc0f62a29408 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.598250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.598997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.599271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.599539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.600272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.601896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.612930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2042/4080] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:18.617685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.627715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6cef-889c-423d-b725-da3388fe5d1d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.632595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.633288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.633566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.633838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.634577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.636160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed5579-797d-43f4-82c3-192ec40df50c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.647678 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2039/4081] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:18.651878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.663320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b6ca-a2a4-4d09-a23a-aba15aa6646a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.668171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.669118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.669395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.669668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] PATH_INFO: `/v3/projects/0bbc3503e04f448a98783d13d4a1bff2/users/0862f54023e945e19f9314fa3e8325db/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.688028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbc3503e04f448a98783d13d4a1bff2, user_id=0862f54023e945e19f9314fa3e8325db, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.690589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.706308 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2043/4082] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:18 2021] PUT /identity/v3/projects/0bbc3503e04f448a98783d13d4a1bff2/users/0862f54023e945e19f9314fa3e8325db/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:18.716766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.717051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.717322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.759741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] MFA Rules not processed for user `0862f54023e945e19f9314fa3e8325db`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:18.761026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:18.834067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2040/4083] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:18 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:18.847005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:18.850075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:18.943312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f975e-2681-48d5-9bb8-6c0763f545aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:18.950798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:18.951701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:18.952029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:18.952348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:18.963572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:18.965545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694f57b-4443-4720-83fc-b51ffbcd103d service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:18.975211 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2044/4084] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:18 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:23.006139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:23.080191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31357c-7423-4a32-b92d-ece41cb8cac2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:23.085026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:23.085994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:23.086376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:23.086890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] PATH_INFO: `/v3/users/0862f54023e945e19f9314fa3e8325db` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:23.088355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0862f54023e945e19f9314fa3e8325db)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:23.090980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:23.146878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0862f54023e945e19f9314fa3e8325db'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:23.155238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0862f54023e945e19f9314fa3e8325db'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:23.156346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0862f54023e945e19f9314fa3e8325db'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:23.173391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0862f54023e945e19f9314fa3e8325db'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:23.181457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0862f54023e945e19f9314fa3e8325db'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:23.189524 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2041/4085] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:23 2021] DELETE /identity/v3/users/0862f54023e945e19f9314fa3e8325db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:23.194272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:23.194822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:23.195032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:23.212913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:23.214380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:23.280572 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2045/4086] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:23.293788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:23.295273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:23.374620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397253-52b3-4b74-816f-68b21a4d57da admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:23.379386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:23.380316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:23.380740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:23.381104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:23.391911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:23.393509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c34496-9802-45b4-b568-a940c37d36c7 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:23.406178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2042/4087] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:23.824035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:23.825798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:23.842928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2b8a4-ddd3-4445-b935-9940197db7b5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:23.868158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:23.869206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:23.869499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:23.869759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] PATH_INFO: `/v3/projects/0bbc3503e04f448a98783d13d4a1bff2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:23.882431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbc3503e04f448a98783d13d4a1bff2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:23.884568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.001586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbc3503e04f448a98783d13d4a1bff2', 'request_id': 'req-c6df592f-a054-451a-a646-e1d5e4921398'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:24.009434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbc3503e04f448a98783d13d4a1bff2', 'request_id': 'req-c6df592f-a054-451a-a646-e1d5e4921398'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:24.019674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbc3503e04f448a98783d13d4a1bff2', 'request_id': 'req-c6df592f-a054-451a-a646-e1d5e4921398'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:24.041955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] The token cache is being invalidate because project 0bbc3503e04f448a98783d13d4a1bff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:24.042609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:24.044391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c6df592f-a054-451a-a646-e1d5e4921398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:24.047273 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2046/4088] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:23 2021] DELETE /identity/v3/projects/0bbc3503e04f448a98783d13d4a1bff2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:24.054082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.054588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.055036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.075636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:24.076979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:24.166440 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2043/4089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:06:24.178144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.178426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.178705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.202332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:24.204175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:24.214414 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2047/4090] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:24.220364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.233355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9fc94-b00a-42a4-8eb9-234bdb204496 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.240089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.242087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.242514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.242888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.245048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:06:24.245447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.247917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.263495 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2044/4091] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:06:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:06:24.268555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.280542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12ef4-0d27-4246-af0f-9155a2e4295d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.286709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.287524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.288364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.288364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.289203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.291178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.321586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2048/4092] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:24 2021] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:24.326280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.339278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560a80-df5f-4c96-8493-7b2aab143ad3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.420524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.421612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.422088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.422562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.423431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.426404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.457518 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2045/4093] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:24 2021] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:24.462118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.488037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339118d5-0fac-4e9b-9a7c-1375e6479507 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.493605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.494222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.494532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.494770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.495507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.497349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.511384 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2049/4094] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:24.516657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.529776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e9bf-7987-40c7-a971-9069cb9e4d14 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.537109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.538248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.538926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.539053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.539967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.542179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617cc33-713a-4ad5-9bd3-c4a3300a6b97 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.569178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2046/4095] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:24 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:24.570145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.586974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbad7-4abe-475c-8525-6ddc1f2e3d91 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.594262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.595268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.595684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.596300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] PATH_INFO: `/v3/projects/c3aa5eb57eed4a08886f209520775cc9/users/de14696cbebe4b6fa15502526d41d82c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.616998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aa5eb57eed4a08886f209520775cc9, user_id=de14696cbebe4b6fa15502526d41d82c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.619815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.639043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2050/4096] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:24 2021] PUT /identity/v3/projects/c3aa5eb57eed4a08886f209520775cc9/users/de14696cbebe4b6fa15502526d41d82c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:24.644528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669af81-03cd-4ca0-b2ce-beae7353a7f0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.645107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669af81-03cd-4ca0-b2ce-beae7353a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.645424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669af81-03cd-4ca0-b2ce-beae7353a7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.668256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4669af81-03cd-4ca0-b2ce-beae7353a7f0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:24.669753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4669af81-03cd-4ca0-b2ce-beae7353a7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:24.767280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2047/4097] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:24.781130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:24.783198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:24.904120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3444-0968-4d48-8ffd-8d4d6594b225 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:24.908386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:24.909373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:24.910033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:24.910532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:24.928300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:24.930474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:24.949234 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2051/4098] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:31.461398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88714ce-95e8-4fd5-9665-8202b775ffa9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:31.462713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88714ce-95e8-4fd5-9665-8202b775ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:31.463292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88714ce-95e8-4fd5-9665-8202b775ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:31.569607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d88714ce-95e8-4fd5-9665-8202b775ffa9 None None] MFA Rules not processed for user `de14696cbebe4b6fa15502526d41d82c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:31.573278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d88714ce-95e8-4fd5-9665-8202b775ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:31.714014 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2048/4099] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:31 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:31.724097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:31.725556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:31.799356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a02c8-8bfa-4410-81a4-3f2ca50b37ea service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:31.804897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:31.805534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:31.805813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:31.806083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:31.814527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:31.816083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719310f-31d8-440c-bc54-0e6e876b4dfb service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:31.825823 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2052/4100] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:31 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:34.748695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:34.749172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:34.749172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:34.792929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:34.796646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:34.805310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:34.806503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:34.807119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:34.842099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] MFA Rules not processed for user `de14696cbebe4b6fa15502526d41d82c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:34.843281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:34.868775 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2053/4101] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:34 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:06:34.940037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2049/4102] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:06:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:34.972162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:34.973693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:35.090965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3e363-e00d-4088-810d-2d47870dc764 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:35.101105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:35.102777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:35.103485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:35.104001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:35.117354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:35.119265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:35.132344 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2054/4103] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:06:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:06:37.404437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:37.406007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:37.421262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1138d37-a718-4afa-aaa2-4b4b1106ffe5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:37.425916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:37.426781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:37.427091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:37.427362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] PATH_INFO: `/v3/users/4b20a09147544f20941d8afd17c21e16` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:37.428667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b20a09147544f20941d8afd17c21e16)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:37.430636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:37.479797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b20a09147544f20941d8afd17c21e16'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.487887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b20a09147544f20941d8afd17c21e16'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.488654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b20a09147544f20941d8afd17c21e16'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.501052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b20a09147544f20941d8afd17c21e16'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.509099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b20a09147544f20941d8afd17c21e16'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.517818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2050/4104] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:37 2021] DELETE /identity/v3/users/4b20a09147544f20941d8afd17c21e16 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:37.708329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:37.728307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7295f-e5cc-4ada-86ed-d19adb72eba0 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:37.809848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:37.811056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:37.811653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:37.811939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] PATH_INFO: `/v3/projects/c676f4ec86b44df399be6886b57d34f9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:37.813917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c676f4ec86b44df399be6886b57d34f9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:37.816279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:37.882278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c676f4ec86b44df399be6886b57d34f9', 'request_id': 'req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.888932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c676f4ec86b44df399be6886b57d34f9', 'request_id': 'req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.895098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c676f4ec86b44df399be6886b57d34f9', 'request_id': 'req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.910761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] The token cache is being invalidate because project c676f4ec86b44df399be6886b57d34f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:37.911056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.911943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:37.913582 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2055/4105] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:37 2021] DELETE /identity/v3/projects/c676f4ec86b44df399be6886b57d34f9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:37.917633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:37.919594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:37.935433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b42e-a7b4-4410-9ba7-78a0c3c0f04f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:38.003341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:38.004484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:38.004908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:38.005280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] PATH_INFO: `/v3/users/2c0d6f65ad364e9eb14297470df9f4d7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:38.009231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0d6f65ad364e9eb14297470df9f4d7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:38.011320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:38.065950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0d6f65ad364e9eb14297470df9f4d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:38.078736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0d6f65ad364e9eb14297470df9f4d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:38.079672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0d6f65ad364e9eb14297470df9f4d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:38.106060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0d6f65ad364e9eb14297470df9f4d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:38.116739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a426f3c-aaa4-4765-8168-7900764d7a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0d6f65ad364e9eb14297470df9f4d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:38.133021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2051/4106] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:37 2021] DELETE /identity/v3/users/2c0d6f65ad364e9eb14297470df9f4d7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:38.910787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:38.913116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:38.939788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f266-8d6e-4e30-9a54-8539c0dcf4db admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.017364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.018431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.018778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.019129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] PATH_INFO: `/v3/projects/83ecaf331fc44b74abe363e4efb43ec0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.020396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ecaf331fc44b74abe363e4efb43ec0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.022492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.098706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ecaf331fc44b74abe363e4efb43ec0', 'request_id': 'req-6f30dd86-e0e3-4acf-bcf8-10299426baee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:39.104917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ecaf331fc44b74abe363e4efb43ec0', 'request_id': 'req-6f30dd86-e0e3-4acf-bcf8-10299426baee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:39.113574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ecaf331fc44b74abe363e4efb43ec0', 'request_id': 'req-6f30dd86-e0e3-4acf-bcf8-10299426baee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:39.141426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] The token cache is being invalidate because project 83ecaf331fc44b74abe363e4efb43ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:39.141877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:39.143121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f30dd86-e0e3-4acf-bcf8-10299426baee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:39.153635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.154273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.154699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.167502 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2056/4107] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:38 2021] DELETE /identity/v3/projects/83ecaf331fc44b74abe363e4efb43ec0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:39.199966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:39.201498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:39.318459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2052/4108] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:39.328631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.329218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.329646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.370277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:39.372361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:39.393477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2057/4109] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:39.399788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.410879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d4d0-2497-435d-83f7-c0825ade4f71 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.424571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.427050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.429008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.429603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.431923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:06:39.434476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.436777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.457811 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2053/4110] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:06:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:06:39.458373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.475261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7f98-94de-4879-a747-3f2caafe9ab5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.482014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.483477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.483847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.484226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.485125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.487121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.526340 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2058/4111] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:39 2021] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:06:39.530808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.542010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d70bd-6345-44aa-9b50-17e53511c09a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.665609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.666303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.669197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.669496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.671619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.676118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.720404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2054/4112] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:39 2021] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:39.724443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.740304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4d5da-7e17-4db3-9a1c-3ac15009b51c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.754582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.755457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.755749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.756217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.757700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.772950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.813110 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2059/4113] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:39 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:39.818689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.836152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4e4b-3dd3-4a49-8cd8-ef4d9dd46fe8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.842359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.843239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.845401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.845723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.846614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.848414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb0e27-49eb-49f1-be9c-82f8ab113cc7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:39.873014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:39.873700 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2055/4114] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:39 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:39.886359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff5d7-70f1-4f13-b22b-8ffc39af6b68 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:39.909321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:39.912809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:39.913347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:39.913887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] PATH_INFO: `/v3/projects/e9d1b72115d6435f8ad2ef48f736a7c0/users/9a7c4d59a09d48dc99b9bdc5e95fa204/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:39.984194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d1b72115d6435f8ad2ef48f736a7c0, user_id=9a7c4d59a09d48dc99b9bdc5e95fa204, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:39.986868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.027050 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2060/4115] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:39 2021] PUT /identity/v3/projects/e9d1b72115d6435f8ad2ef48f736a7c0/users/9a7c4d59a09d48dc99b9bdc5e95fa204/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:40.039038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.039323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.039600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.094603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] MFA Rules not processed for user `9a7c4d59a09d48dc99b9bdc5e95fa204`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:40.096316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:40.271091 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2056/4116] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:40 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:40.272185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:40.386439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fb9f-db6f-4088-9c49-f65f9855d4c7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:40.401515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:40.402503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.403876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.404316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.405236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:40.407353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.448733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2061/4117] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:40 2021] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:40.453771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:40.468082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38163125-72b0-4bfe-a6d2-bc509f352a9d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:40.581333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:40.582255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.582721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.583102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.586819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:40.591257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.639563 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2057/4118] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:40 2021] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:06:40.640866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:40.659985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3e50-6ce3-4258-ae52-872905396952 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:40.667278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:40.669754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.670267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.670733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.671654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:40.673756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.691206 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2062/4119] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:40 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:40.695862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:40.711786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d5997-ea70-4f36-a86b-9cb38a43ddda admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:40.720769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:40.721631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.721916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.722185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] PATH_INFO: `/v3/projects/6f1be3261088470db470afae6018cbfe/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.744091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1be3261088470db470afae6018cbfe, user_id=c3426f57fe7b4a6aa1e5bd7efc1e43ba, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:40.747963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.772700 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2058/4120] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:40 2021] PUT /identity/v3/projects/6f1be3261088470db470afae6018cbfe/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:40.775717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:40.790375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a074ac-1084-44cd-b6d6-d132032645fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:40.955188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:40.956678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:40.957099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:40.957508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:40.958415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:40.960143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb8fc7-7572-4c57-bdd7-a2d1528fe2d1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:40.986264 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2063/4121] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:40 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:40.990429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:41.009095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7730d6-b5a4-43a4-bb4d-287ccb36d7cb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:41.044737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:41.046823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:41.048583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:41.048895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] PATH_INFO: `/v3/projects/6f1be3261088470db470afae6018cbfe/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:41.052678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1be3261088470db470afae6018cbfe, user_id=c3426f57fe7b4a6aa1e5bd7efc1e43ba, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:41.060680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc7de-8cee-4c74-93f0-75410d4724cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:41.096331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2059/4122] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:40 2021] PUT /identity/v3/projects/6f1be3261088470db470afae6018cbfe/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:41.108144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:41.108451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:41.108761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:41.179174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] MFA Rules not processed for user `c3426f57fe7b4a6aa1e5bd7efc1e43ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:41.180395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:41.332867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2064/4123] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:41 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:41.334018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:41.335237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:41.335237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:41.365198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] MFA Rules not processed for user `9a7c4d59a09d48dc99b9bdc5e95fa204`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:41.369626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:41.448813 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2060/4124] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:41 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:41.461969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:41.463411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:41.588133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16131-a11f-4fe4-ac67-273299ac5120 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:41.610618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:41.611452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:41.625374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:41.625960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:41.638136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:41.640044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:41.656622 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2065/4125] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:41 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:48.414396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:48.416037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:48.490288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327306e-7c21-4646-9c0a-5add8bfae9a6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:48.495690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:48.497089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:48.497777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:48.498059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] PATH_INFO: `/v3/users/b0e407b4a87f420b879c57ba30c84e1d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:48.499280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e407b4a87f420b879c57ba30c84e1d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:48.501224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:48.551946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e407b4a87f420b879c57ba30c84e1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:48.563529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e407b4a87f420b879c57ba30c84e1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:48.564270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e407b4a87f420b879c57ba30c84e1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:48.581279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e407b4a87f420b879c57ba30c84e1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:48.588552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4fd26698-b179-4baf-bf1b-16b00a7282e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e407b4a87f420b879c57ba30c84e1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:48.597161 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2061/4126] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:48 2021] DELETE /identity/v3/users/b0e407b4a87f420b879c57ba30c84e1d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:48.930759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:48.952374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de9e7-d934-4c70-992c-9ec61eb8cefa service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.084374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.085845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.086218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.086391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] PATH_INFO: `/v3/projects/30a29aec41654205a386adc6e2de0b11` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.087632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a29aec41654205a386adc6e2de0b11)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.091509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.183994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a29aec41654205a386adc6e2de0b11', 'request_id': 'req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:49.190844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a29aec41654205a386adc6e2de0b11', 'request_id': 'req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:49.201646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a29aec41654205a386adc6e2de0b11', 'request_id': 'req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:49.219058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] The token cache is being invalidate because project 30a29aec41654205a386adc6e2de0b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:49.219424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:49.220124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f03f7a6-0d77-42f8-829d-4b8ba31c38e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:49.222297 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2066/4127] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:48 2021] DELETE /identity/v3/projects/30a29aec41654205a386adc6e2de0b11 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:49.228115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.228810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.229227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.250756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:49.253319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:49.344654 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2062/4128] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:49.352968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.353459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.353875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.391406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:49.399750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:49.416261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2067/4129] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:49.416479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.428646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1468137-dd47-49f6-aea1-544f2c38bfc3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.435658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.437073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.437671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.438225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.440436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:06:49.441059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.442968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.457981 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2063/4130] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:06:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:06:49.462531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.478008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a8ff-9b35-4c6f-ba04-2e79a4d01655 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.483463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.484451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.485925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.485925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.487147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.489200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.522881 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2068/4131] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:49 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:49.525563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.536749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc393d-5268-4f72-a5a1-2dcbe4a6f2b6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.598397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.599065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.599492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.599903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.600808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.603756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.643800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2064/4132] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:49 2021] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:49.644656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.660859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a7ca-8ca5-4c8c-bc7b-6cf7df27789f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.671059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.671915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.672199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.678820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.679816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.682602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.698069 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2069/4133] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:49 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:49.702577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.716029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11990ad-e407-4574-9ed6-34ee7e7fe000 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.733274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.734143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.734425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.734703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.735566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.738136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440224c4-c270-46c9-af4a-30b3f3677539 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.753398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2065/4134] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:49 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:49.757286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.772710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704f60-807f-425b-bbed-ad59ea125e45 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:49.778193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:49.779519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.779806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.780083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] PATH_INFO: `/v3/projects/b05c03f4e9dc4e1d9e8f759b8f0c7c06/users/885977f4f57f46a2a938d8cd81bdb3fc/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.806777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05c03f4e9dc4e1d9e8f759b8f0c7c06, user_id=885977f4f57f46a2a938d8cd81bdb3fc, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:49.810675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:49.830864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2070/4135] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:49 2021] PUT /identity/v3/projects/b05c03f4e9dc4e1d9e8f759b8f0c7c06/users/885977f4f57f46a2a938d8cd81bdb3fc/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:49.836588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:49.837238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:49.837613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:49.865619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:49.866963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:49.949984 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2066/4136] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:49.969583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:49.971977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:50.137891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d6e6-f6ed-4cdc-99cb-2c899e978c6f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:50.142160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:50.142924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:50.143310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:50.143687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:50.154446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:50.156020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:50.167972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2071/4137] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:50.658272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:50.660271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:50.684970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298c99-880f-40e6-93dd-6f12328fea27 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:50.695481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:50.696287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:50.696842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:50.697284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] PATH_INFO: `/v3/users/f900805fbd3e4508bb42f780bf00491f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:50.700938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f900805fbd3e4508bb42f780bf00491f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:50.705517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:50.762116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f900805fbd3e4508bb42f780bf00491f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:50.769756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f900805fbd3e4508bb42f780bf00491f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:50.771226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f900805fbd3e4508bb42f780bf00491f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:50.785700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f900805fbd3e4508bb42f780bf00491f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:50.796855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c49d422f-357a-4d74-a355-22c6aae87835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f900805fbd3e4508bb42f780bf00491f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:50.812159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2067/4138] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:50 2021] DELETE /identity/v3/users/f900805fbd3e4508bb42f780bf00491f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:50.993692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:51.005964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac66b-66ea-429f-abfa-26f65434e5c7 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:51.076820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:51.076820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.077262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.077745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] PATH_INFO: `/v3/projects/98d2add7649d478b822e887bff3db0d9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.079889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d2add7649d478b822e887bff3db0d9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:51.083897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:51.084842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cf44-5b6f-4638-bf6c-0b72510ccca3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.085215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cf44-5b6f-4638-bf6c-0b72510ccca3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.085557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cf44-5b6f-4638-bf6c-0b72510ccca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.113309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0dc8cf44-5b6f-4638-bf6c-0b72510ccca3 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:51.115250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0dc8cf44-5b6f-4638-bf6c-0b72510ccca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.161147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d2add7649d478b822e887bff3db0d9', 'request_id': 'req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.170625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d2add7649d478b822e887bff3db0d9', 'request_id': 'req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.178543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d2add7649d478b822e887bff3db0d9', 'request_id': 'req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.195252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] The token cache is being invalidate because project 98d2add7649d478b822e887bff3db0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:51.196143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.196899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.199990 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2072/4139] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:50 2021] DELETE /identity/v3/projects/98d2add7649d478b822e887bff3db0d9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:51.205198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:51.208494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.247119 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2068/4140] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:51 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:51.258027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.258308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.258604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.287412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:51.288769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.335305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c3603-c4ae-4ec8-a20b-af1d8cda6122 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:51.337657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:51.338699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.338909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.339234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] PATH_INFO: `/v3/users/83a9542b24e040249134f9ab82b6f548` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.341303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a9542b24e040249134f9ab82b6f548)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:51.343268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:51.353609 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2069/4141] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:51 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:51.373360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:51.375488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.399875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a9542b24e040249134f9ab82b6f548'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.408788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a9542b24e040249134f9ab82b6f548'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.410212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a9542b24e040249134f9ab82b6f548'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.410914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a9542b24e040249134f9ab82b6f548'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.424825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a9542b24e040249134f9ab82b6f548'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.456475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2073/4142] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:06:51 2021] DELETE /identity/v3/users/83a9542b24e040249134f9ab82b6f548 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:51.480574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21ed0-5f94-448f-afb4-2cdccdd63a78 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:51.577291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:51.578024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.578379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.578725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.580595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.647677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:51.649516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88110e-887c-4555-a4e2-e9adcc8b0b9a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:51.669828 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2070/4143] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:51 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:51.672017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:51.675269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:51.767524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1e85-d059-4c73-b327-4ae0012305f2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:51.774737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:51.775900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.776283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.776760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] PATH_INFO: `/v3/projects/695d59928f7741bebf381d7911052a99` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.778765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695d59928f7741bebf381d7911052a99)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:51.781238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:51.876493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695d59928f7741bebf381d7911052a99', 'request_id': 'req-6ed07ada-8af5-4980-8841-3aef5f983b94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.882565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695d59928f7741bebf381d7911052a99', 'request_id': 'req-6ed07ada-8af5-4980-8841-3aef5f983b94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.892896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695d59928f7741bebf381d7911052a99', 'request_id': 'req-6ed07ada-8af5-4980-8841-3aef5f983b94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.916473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] The token cache is being invalidate because project 695d59928f7741bebf381d7911052a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:06:51.917089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.917876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ed07ada-8af5-4980-8841-3aef5f983b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:06:51.924687 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2074/4144] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:06:51 2021] DELETE /identity/v3/projects/695d59928f7741bebf381d7911052a99 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:06:51.930365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:51.930649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:51.930923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:51.950955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:51.952469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:52.053793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2071/4145] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:52.055994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.056434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.056561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.082576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:52.083866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:52.097246 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2075/4146] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:52.097966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.109753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6030-506d-4284-96e5-3b5f5180be39 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.114901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.116012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.116294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.116568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.117830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:06:52.118124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.119926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.140312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.140829 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2072/4147] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:06:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:06:52.151032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fea744-ecaf-4779-8909-ac4061a8bb6b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.155908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.157137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.157415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.157688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.158943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.162259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.205269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2076/4148] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:06:52 2021] POST /identity/v3/projects => generated 413 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:52.205491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.215530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8c236-c262-48a8-92e2-16276a67c422 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.286419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.287126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.287788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.288070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.288983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.290870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.312442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2073/4149] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:06:52 2021] POST /identity/v3/users => generated 307 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:06:52.316550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.332772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5200-fcab-44da-9030-4549f75968c0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.339993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.340866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.341282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.341712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.342825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.345029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.360716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2077/4150] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:06:52.364259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.376220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197187-d455-4602-af71-e11921a978f4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.382036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.383010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.383427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.383721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.384518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.386451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b167a-c410-4756-a16e-a5dcff5e960a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.399528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2074/4151] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:06:52.403482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.420769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6edd1-5b10-4e89-8e56-e60b5672ecc5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.438025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.439154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.439438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.439713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] PATH_INFO: `/v3/projects/8fe68e6d649c4be8bf54ca0033ab888b/users/79ce626b4844427fb43ef399a2e88132/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.460160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe68e6d649c4be8bf54ca0033ab888b, user_id=79ce626b4844427fb43ef399a2e88132, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.463024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.479836 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2078/4152] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:06:52 2021] PUT /identity/v3/projects/8fe68e6d649c4be8bf54ca0033ab888b/users/79ce626b4844427fb43ef399a2e88132/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:06:52.486520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.487073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.487484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.518998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:52.520598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:52.642331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2075/4153] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:06:52.656427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:52.658977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:52.749981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda3bf-f210-4ba1-88f5-0ee52b77532a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:52.756552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:52.757586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:52.758101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:52.758577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:52.773192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:52.774654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447c5d-af21-4834-89f6-5aae3f8fbbad service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:52.784984 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2079/4154] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:56.520672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:06:56.522892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:56.650968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64e409-1e9c-4bce-b148-343641c4ecff None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:06:56.657370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:06:56.658395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:56.659923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:56.660411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:56.664293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:56.778645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:06:56.780154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f3f77-6ca2-46ba-9b5a-794ed972105e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:06:56.790986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2076/4155] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:06:56 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:06:57.162369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187d5e-f3dc-4664-9b3a-0fa993b0b51b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:06:57.162888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187d5e-f3dc-4664-9b3a-0fa993b0b51b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:06:57.162888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187d5e-f3dc-4664-9b3a-0fa993b0b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:06:57.181565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0f187d5e-f3dc-4664-9b3a-0fa993b0b51b None None] MFA Rules not processed for user `9a7c4d59a09d48dc99b9bdc5e95fa204`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:06:57.182802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f187d5e-f3dc-4664-9b3a-0fa993b0b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:06:57.240147 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2080/4156] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:06:57 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:01.253447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:01.253937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:01.254036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:01.303472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] MFA Rules not processed for user `79ce626b4844427fb43ef399a2e88132`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:01.304826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:01.431222 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2077/4157] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:01 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:01.441322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:01.442213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:01.442634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:01.463717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] MFA Rules not processed for user `79ce626b4844427fb43ef399a2e88132`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:01.465315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:01.474229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2081/4158] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:01 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:01.571091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:01.590360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffdd44-58ad-43e3-b5db-19bf77eb3f6c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:01.601780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:01.602457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:01.602735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:01.604438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:01.614533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:01.616197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:01.627442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2078/4159] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:01 2021] GET /identity/v3/auth/tokens => generated 3280 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:11.356532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:11.371801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf07ee-9dcf-4067-8c55-4eb505d4ab07 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:11.379408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:11.380517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:11.380835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:11.381110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:11.383082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:11.399139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:11.401132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:11.413820 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2082/4160] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:11.601898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:11.603758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:11.653126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898df2-28f3-493b-a263-6adf04b02558 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:11.665851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:11.666805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:11.667679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:11.668173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] PATH_INFO: `/v3/users/96d29211fc5841fda3fddea9f63b086c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:11.669710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d29211fc5841fda3fddea9f63b086c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:11.682170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:11.760855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:11.762647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:11.777267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf65da1-b214-4792-8359-aa90bd24dc54 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:11.779342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d29211fc5841fda3fddea9f63b086c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:11.789834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d29211fc5841fda3fddea9f63b086c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:11.790923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d29211fc5841fda3fddea9f63b086c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:11.793249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:11.794120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:11.794546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:11.794963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:11.797223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:11.821255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:11.822067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d29211fc5841fda3fddea9f63b086c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:11.822877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430edd5-91a8-4120-8785-efbdbb45107f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:11.831947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d29211fc5841fda3fddea9f63b086c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:11.848980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2079/4161] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:11 2021] DELETE /identity/v3/users/96d29211fc5841fda3fddea9f63b086c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:11.859406 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2083/4162] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:07:12.163079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.164633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:12.243738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65b4c-db36-4aff-af4f-72fad9d8e818 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.250071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.251469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.251798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.252136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] PATH_INFO: `/v3/projects/922909b8fd6a4f5abf9817fc893e8e7a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.253534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922909b8fd6a4f5abf9817fc893e8e7a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.255522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.302739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922909b8fd6a4f5abf9817fc893e8e7a', 'request_id': 'req-94654c3f-febd-4cc5-9a11-56ad97d29872'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:12.307898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922909b8fd6a4f5abf9817fc893e8e7a', 'request_id': 'req-94654c3f-febd-4cc5-9a11-56ad97d29872'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:12.313926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922909b8fd6a4f5abf9817fc893e8e7a', 'request_id': 'req-94654c3f-febd-4cc5-9a11-56ad97d29872'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:12.325749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] The token cache is being invalidate because project 922909b8fd6a4f5abf9817fc893e8e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:12.326055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:12.326668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94654c3f-febd-4cc5-9a11-56ad97d29872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:12.328178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2080/4163] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:12 2021] DELETE /identity/v3/projects/922909b8fd6a4f5abf9817fc893e8e7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:12.334701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.334984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.335255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.353113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:12.354284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:12.410829 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2084/4164] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:12.418236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.418527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.418806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.436995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:12.438223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:12.446230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2081/4165] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:12.451224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.460789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3912e1b-1c3d-4732-ac25-17cbb4a0025f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.465968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.466633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.466911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.467186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.467914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:07:12.468214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.469818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.481057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2085/4166] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:07:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:07:12.485205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.494634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2a98-03e0-4616-82d4-b9bde4a4546c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.499248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.499879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.500150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.500416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.501137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.503028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.528219 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2082/4167] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:07:12 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:12.532203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.542596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2cb94-3d3d-4563-84b5-53950a1c9ed3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.599257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.600090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.600465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.600875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.601687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.603659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.627647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2086/4168] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:07:12 2021] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:07:12.632572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.643661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d42226-40cd-41eb-abe8-e8e700b6c59d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.648593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.649302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.649575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.649846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.650595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.652771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.663681 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2083/4169] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:12.667955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.680883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1be9-c5be-46d7-979b-241e5898739b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.686682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.687423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.687759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.688089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.689003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.690776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e153cb-14c1-4cda-8840-278d90e55817 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.709935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2087/4170] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:07:12.711006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:12.723134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635a7a0-d613-4991-905a-63087cacbad7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:12.729792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:12.730918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.731299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.731648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] PATH_INFO: `/v3/projects/8a508785224a45a3aee783be4038c41a/users/e69e85dd996d4284bcf39ea4f3a30a2b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.765710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a508785224a45a3aee783be4038c41a, user_id=e69e85dd996d4284bcf39ea4f3a30a2b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:12.770070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:12.786866 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2084/4171] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:07:12 2021] PUT /identity/v3/projects/8a508785224a45a3aee783be4038c41a/users/e69e85dd996d4284bcf39ea4f3a30a2b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:12.798486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25d56-e20f-4d1d-a927-dfb7a0972fe0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:12.798843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25d56-e20f-4d1d-a927-dfb7a0972fe0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:12.799347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25d56-e20f-4d1d-a927-dfb7a0972fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:12.844424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e8e25d56-e20f-4d1d-a927-dfb7a0972fe0 None None] MFA Rules not processed for user `e69e85dd996d4284bcf39ea4f3a30a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:12.845932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e8e25d56-e20f-4d1d-a927-dfb7a0972fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:12.960052 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2088/4172] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:12 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:12.998724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:13.073823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2042094-bed9-4cca-85a5-4a6fb9a3c652 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:13.079705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:13.080541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.080831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.081105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] PATH_INFO: `/v3/users/e69e85dd996d4284bcf39ea4f3a30a2b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.082313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69e85dd996d4284bcf39ea4f3a30a2b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:13.084323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:13.145810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69e85dd996d4284bcf39ea4f3a30a2b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.152907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69e85dd996d4284bcf39ea4f3a30a2b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.153643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69e85dd996d4284bcf39ea4f3a30a2b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.167994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69e85dd996d4284bcf39ea4f3a30a2b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.184384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5c423edc-1c63-4b70-8e55-341b04343dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69e85dd996d4284bcf39ea4f3a30a2b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.192551 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2085/4173] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:12 2021] DELETE /identity/v3/users/e69e85dd996d4284bcf39ea4f3a30a2b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:13.197251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.197628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.197974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.223382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.223703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.223952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.234134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:13.236143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:13.242786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:13.243998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:13.306604 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2086/4174] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:13.347646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2089/4175] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:13.362262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:13.363759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:13.438948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d327e-24a9-4891-97ed-1e9ed0df2d11 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:13.444474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:13.445321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.445785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.446075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.456904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:13.458340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156551b-a8bc-4c52-a2e3-539c6cbaafc4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:13.469785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2087/4176] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:13.800493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:13.804698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:13.820052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7d0a3-e9ca-49b4-84e3-7116a9d50b9c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:13.827082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:13.828305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.828795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.829227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] PATH_INFO: `/v3/projects/8a508785224a45a3aee783be4038c41a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.830735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a508785224a45a3aee783be4038c41a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:13.832718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:13.893478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a508785224a45a3aee783be4038c41a', 'request_id': 'req-a819be3d-567b-4c51-8919-f74b8c49b0c5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.899979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a508785224a45a3aee783be4038c41a', 'request_id': 'req-a819be3d-567b-4c51-8919-f74b8c49b0c5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.911414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a508785224a45a3aee783be4038c41a', 'request_id': 'req-a819be3d-567b-4c51-8919-f74b8c49b0c5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.927434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] The token cache is being invalidate because project 8a508785224a45a3aee783be4038c41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:13.928185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.929294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a819be3d-567b-4c51-8919-f74b8c49b0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:13.931125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2090/4177] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:13 2021] DELETE /identity/v3/projects/8a508785224a45a3aee783be4038c41a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:13.939386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:13.940692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:13.941291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:13.974222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:13.975877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:14.056501 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2088/4178] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:14.065734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.065944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.066371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.085845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:14.087043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:14.095065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2091/4179] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:14.099739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.110093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acbb31-2b49-48a7-9997-d19ec2a098f1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.114841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.115495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.115893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.116175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.116997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:07:14.117300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.118905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.131127 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2089/4180] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:07:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:07:14.136083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.146042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab85b-761a-4968-b0d5-3825d0ef8f0a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.150714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.151457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.151855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.152133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.152894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.154765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.182555 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2092/4181] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:07:14 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:14.187409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.197465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849fc5-f4fa-4a7c-94fb-6519406ac578 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.272215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.273102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.273918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.274087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.274850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.277543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.308800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2090/4182] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:07:14 2021] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:14.311488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.325340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12853-76a0-4766-a50a-e15b57c4db3d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.330968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.331753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.332109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.332500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.333364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.335528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.353999 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2093/4183] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:14 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:14.356332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.370238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab58d60-35fc-4e78-a672-f4e18f2892b6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.376991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.378525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.378817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.379140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.379896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.382636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1903d5a-749d-46b3-8fed-3056b4fa1fc9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.399590 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2091/4184] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:14 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:14.400858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.414785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e74ec-4b4e-4589-9e9e-4cb67e1281b8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.421190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.422096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.422375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.422648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] PATH_INFO: `/v3/projects/1cb3ad32a40543dd84c0805ec7f39b5b/users/d009c583f1e547879ada9e3f030cec40/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.444819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb3ad32a40543dd84c0805ec7f39b5b, user_id=d009c583f1e547879ada9e3f030cec40, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.459997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.478882 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2094/4185] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:07:14 2021] PUT /identity/v3/projects/1cb3ad32a40543dd84c0805ec7f39b5b/users/d009c583f1e547879ada9e3f030cec40/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:14.485220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdcf5-96cc-493f-ba99-c61006547007 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.485636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdcf5-96cc-493f-ba99-c61006547007 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.485901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdcf5-96cc-493f-ba99-c61006547007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.506388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f96fdcf5-96cc-493f-ba99-c61006547007 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:14.507589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f96fdcf5-96cc-493f-ba99-c61006547007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:14.597453 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2092/4186] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:14.608446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:14.610437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:14.727124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07567043-002b-4ef3-9f47-e695151c4fa6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:14.731410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:14.732058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:14.732782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:14.733036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:14.742767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:14.744208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c1cc-0ba3-45e1-a0d9-05d2f7c611f6 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:14.754364 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2095/4187] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:16.357008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:16.357495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:16.357931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:16.414889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] MFA Rules not processed for user `d009c583f1e547879ada9e3f030cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:16.418375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:16.533825 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2093/4188] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:16.546560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:16.547323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:16.547323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:16.586737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] MFA Rules not processed for user `d009c583f1e547879ada9e3f030cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:16.588176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:16.601020 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2096/4189] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:16.720831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:16.723141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:16.811161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579186-f77a-4837-aab7-c59de67428e1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:16.818664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:16.819646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:16.819964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:16.820359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:16.832762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:16.834468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:16.848818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2094/4190] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:16 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:22.613097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:22.631621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc198-77ea-4215-90c4-de46e2fea729 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:22.638220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:22.638950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:22.639228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:22.639500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:22.641285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:22.654709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:22.656237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab68a1-1209-4fec-9732-aca6a17d2b61 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:22.668579 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2097/4191] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:22.910438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:22.912126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:22.926481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a2d20-9fb1-480f-9163-13659f3048b2 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:22.931181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:22.932303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:22.933206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:22.933558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] PATH_INFO: `/v3/users/9a7c4d59a09d48dc99b9bdc5e95fa204` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:22.934861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7c4d59a09d48dc99b9bdc5e95fa204)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:22.936873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:22.984874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7c4d59a09d48dc99b9bdc5e95fa204'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:22.991455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7c4d59a09d48dc99b9bdc5e95fa204'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:22.992153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7c4d59a09d48dc99b9bdc5e95fa204'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.004144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7c4d59a09d48dc99b9bdc5e95fa204'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.011638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7c4d59a09d48dc99b9bdc5e95fa204'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.017983 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2095/4192] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:22 2021] DELETE /identity/v3/users/9a7c4d59a09d48dc99b9bdc5e95fa204 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:23.022865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:23.023225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:23.023572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:23.043444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:23.044919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:23.104057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2098/4193] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:23.114444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:23.115851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:23.171843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110ac1-d89e-4bb5-8c75-b73df852ac14 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:23.175781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:23.176425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:23.176798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:23.177088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:23.187209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:23.188664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:23.198192 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2096/4194] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:07:23.477123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:23.480832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:23.517862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa722-09a8-4885-9f26-6006f844bd37 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:23.523464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:23.525521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:23.526632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:23.526913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] PATH_INFO: `/v3/projects/e9d1b72115d6435f8ad2ef48f736a7c0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:23.528463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d1b72115d6435f8ad2ef48f736a7c0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:23.532602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:23.606193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d1b72115d6435f8ad2ef48f736a7c0', 'request_id': 'req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.613148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d1b72115d6435f8ad2ef48f736a7c0', 'request_id': 'req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.627143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d1b72115d6435f8ad2ef48f736a7c0', 'request_id': 'req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.645070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] The token cache is being invalidate because project e9d1b72115d6435f8ad2ef48f736a7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:23.645518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.646274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.652416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2099/4195] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:23 2021] DELETE /identity/v3/projects/e9d1b72115d6435f8ad2ef48f736a7c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:23.653261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:23.669617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee3ad-be4f-4d3f-addf-7bf4fa7a1f44 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:23.747853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:23.748960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:23.749470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:23.749850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] PATH_INFO: `/v3/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:23.751718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3426f57fe7b4a6aa1e5bd7efc1e43ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:23.754856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:23.826316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3426f57fe7b4a6aa1e5bd7efc1e43ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.835530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3426f57fe7b4a6aa1e5bd7efc1e43ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.836252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3426f57fe7b4a6aa1e5bd7efc1e43ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.849179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3426f57fe7b4a6aa1e5bd7efc1e43ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.859830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3edbe09-74e1-4349-bf89-480cf5cf80b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3426f57fe7b4a6aa1e5bd7efc1e43ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:23.874174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2097/4196] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:23 2021] DELETE /identity/v3/users/c3426f57fe7b4a6aa1e5bd7efc1e43ba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:24.064926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.066984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:24.085486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35557a-4d65-42e8-ba95-8bdc53bc3e96 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.154225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.155082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.155355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.155623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] PATH_INFO: `/v3/projects/6f1be3261088470db470afae6018cbfe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.157489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1be3261088470db470afae6018cbfe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.160116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.210022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1be3261088470db470afae6018cbfe', 'request_id': 'req-530aec37-5939-487c-955d-676b3254bd26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:24.216695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1be3261088470db470afae6018cbfe', 'request_id': 'req-530aec37-5939-487c-955d-676b3254bd26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:24.223313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1be3261088470db470afae6018cbfe', 'request_id': 'req-530aec37-5939-487c-955d-676b3254bd26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:24.237559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] The token cache is being invalidate because project 6f1be3261088470db470afae6018cbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:24.237850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:24.238461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-530aec37-5939-487c-955d-676b3254bd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:24.240433 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2100/4197] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:24 2021] DELETE /identity/v3/projects/6f1be3261088470db470afae6018cbfe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:24.246415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.246928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.247155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.268006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:24.269053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:24.332749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2098/4198] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:24.342780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.343373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.343694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.365306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:24.366577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:24.376379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2101/4199] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:24.380423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.390977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc97b-2135-4b43-b193-5839d4a0e8c0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.397033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.397847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.398228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.398564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.399285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:07:24.399608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.402258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.416042 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2099/4200] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:07:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:07:24.421083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.431627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef18054-e3d5-47f9-b957-b123b85c7920 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.438154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.438890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.439287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.439687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.440626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.443000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.477123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2102/4201] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:07:24 2021] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:07:24.480248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.492498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd61e4-ca06-4f54-b12f-6222c4dbe967 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.575887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.576559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.576868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.577461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.578149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.580855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.606649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2100/4202] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:07:24 2021] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:24.611433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.626850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28d67-8976-4fae-b3ec-1b91835441d6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.632424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.636953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.637385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.637759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.639442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.644450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.667197 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2103/4203] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:24 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:24.668967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.682064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1f58-eeef-4826-85ef-a665db83c2e9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.687451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.688144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.688657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.688868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.689437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.691266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcce145-e420-49ff-845c-1f980f8b9fbb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.712649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2101/4204] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:24.723122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.736418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef3de-a8e5-4b40-8edb-25152f6ce862 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.742734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.743971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.744255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.744494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] PATH_INFO: `/v3/projects/45e5a7dbbfae4bcea48020c7dbf81b13/users/702de0ff3c7044b2ad6babbe08e948f6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.764775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e5a7dbbfae4bcea48020c7dbf81b13, user_id=702de0ff3c7044b2ad6babbe08e948f6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:24.768132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:24.794177 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2104/4205] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:07:24 2021] PUT /identity/v3/projects/45e5a7dbbfae4bcea48020c7dbf81b13/users/702de0ff3c7044b2ad6babbe08e948f6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:24.799381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.799853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.800206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:24.830494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:24.833709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:24.907315 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2102/4206] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:24.915319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:24.917398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:24.985187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a8832-5ee1-45f4-8190-b8e31a1ac126 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:24.990179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:24.991995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:24.992336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:24.992704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:25.005785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:25.007617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c97a00-7a81-4ae5-a9da-742b49c1bb70 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:25.019075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2105/4207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:28.554093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:28.555694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:28.581502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f3be-5291-44d5-83a0-60dd41bad7ee None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:28.589639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:28.590678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:28.591729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:28.592224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:28.595356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:28.660900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:28.662749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbeb3-d5f4-47fa-9e86-31291439ebd9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:28.756980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2103/4208] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:32.941412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:32.941891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:32.942013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:33.019076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] MFA Rules not processed for user `702de0ff3c7044b2ad6babbe08e948f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:33.021338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:33.102244 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2106/4209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:33.114900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:33.115354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:33.118394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:33.159971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] MFA Rules not processed for user `702de0ff3c7044b2ad6babbe08e948f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:33.161275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:33.171430 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2104/4210] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:33.184516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:33.188261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:33.310220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c3e1-f581-49c8-b172-cf4426589b0c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:33.325209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:33.326078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:33.327117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:33.327498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:33.342129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:33.344375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4c9d7-c450-4183-b9b4-849ab1da9281 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:33.355910 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2107/4211] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:33 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:34.492179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:34.500645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:34.746785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb372-6640-4ad1-b795-e41a7f1d124d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:34.758267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:34.758949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:34.759226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:34.761732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:34.766535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:34.795008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:34.797188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b457-0abc-475c-849d-a23d6f15c79d service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:34.820167 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2105/4212] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:36.532429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4efa8-6990-442b-a77e-253840932afd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:36.532938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4efa8-6990-442b-a77e-253840932afd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:36.532938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4efa8-6990-442b-a77e-253840932afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:36.569050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-66b4efa8-6990-442b-a77e-253840932afd None None] MFA Rules not processed for user `d009c583f1e547879ada9e3f030cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:36.574728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-66b4efa8-6990-442b-a77e-253840932afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:36.724981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2108/4213] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:36 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:37.314548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c662-85c7-4f50-a0ed-cd8ffbe73c25 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:37.315485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c662-85c7-4f50-a0ed-cd8ffbe73c25 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:37.315950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c662-85c7-4f50-a0ed-cd8ffbe73c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:37.342727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5867c662-85c7-4f50-a0ed-cd8ffbe73c25 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:37.344138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5867c662-85c7-4f50-a0ed-cd8ffbe73c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:37.433157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2106/4214] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:38.269931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4efa8-6990-442b-a77e-253840932afd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:38.282863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4efa8-6990-442b-a77e-253840932afd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:38.305285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:38.306005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:38.307443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:38.310405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:38.313321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:38.331683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:38.333472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec271-6ce0-4108-951f-c9276115511b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:38.349018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2109/4215] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:39.255696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b301c-fd54-4d42-87a3-f4daff2f7833 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:39.256844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b301c-fd54-4d42-87a3-f4daff2f7833 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:39.257318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b301c-fd54-4d42-87a3-f4daff2f7833 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:39.259587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2107/4216] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:07:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:07:39.268994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adb69-c782-46bb-adf0-2cbf56efcfaf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:39.269332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adb69-c782-46bb-adf0-2cbf56efcfaf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:39.269445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adb69-c782-46bb-adf0-2cbf56efcfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:39.296945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ac9adb69-c782-46bb-adf0-2cbf56efcfaf None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:39.298996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ac9adb69-c782-46bb-adf0-2cbf56efcfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:39.313749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2110/4217] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:07:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:39.346989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b301c-fd54-4d42-87a3-f4daff2f7833 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:39.372764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b301c-fd54-4d42-87a3-f4daff2f7833 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:39.385541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:39.387688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:39.389162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:39.389446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:39.408305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:39.413815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:39.444406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2108/4218] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:39.610845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:39.611244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:39.611550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:39.650954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:39.651918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:39.672131 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2111/4219] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:40.868821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:40.873543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:41.046896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc681ad-3b3f-4715-b874-09e5e581e971 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:41.058171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:41.060022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:41.060502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:41.061610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:41.066895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:41.091906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:41.095068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:41.134012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2109/4220] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:43.828808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:43.830960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:43.879086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fc77-4eb9-42a1-8707-40e414904dcb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:43.888216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:43.890142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:43.890603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:43.890944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] PATH_INFO: `/v3/users/79ce626b4844427fb43ef399a2e88132` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:43.893645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ce626b4844427fb43ef399a2e88132)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:43.896417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:43.971092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ce626b4844427fb43ef399a2e88132'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:43.981833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ce626b4844427fb43ef399a2e88132'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:43.983168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ce626b4844427fb43ef399a2e88132'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:43.984139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ce626b4844427fb43ef399a2e88132'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:43.997166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c234a31b-04c8-491b-a654-09eba58973be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ce626b4844427fb43ef399a2e88132'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.027149 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2112/4221] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:43 2021] DELETE /identity/v3/users/79ce626b4844427fb43ef399a2e88132 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:44.431054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:44.446589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd761744-f76d-41d6-9a20-f7f309a4db2c service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:44.516742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:44.517963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.518463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.518839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] PATH_INFO: `/v3/projects/8fe68e6d649c4be8bf54ca0033ab888b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.520413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe68e6d649c4be8bf54ca0033ab888b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:44.522574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:44.575894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe68e6d649c4be8bf54ca0033ab888b', 'request_id': 'req-d2de3abc-b207-4f89-bc9e-d802cba71905'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.582804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe68e6d649c4be8bf54ca0033ab888b', 'request_id': 'req-d2de3abc-b207-4f89-bc9e-d802cba71905'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.592072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe68e6d649c4be8bf54ca0033ab888b', 'request_id': 'req-d2de3abc-b207-4f89-bc9e-d802cba71905'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.612029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] The token cache is being invalidate because project 8fe68e6d649c4be8bf54ca0033ab888b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:44.612322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.613038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d2de3abc-b207-4f89-bc9e-d802cba71905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:44.614557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2110/4222] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:44 2021] DELETE /identity/v3/projects/8fe68e6d649c4be8bf54ca0033ab888b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:44.621645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.624464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.624961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.648446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:44.649703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:44.727131 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2113/4223] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:44.735896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8038-a916-4274-9cba-b542f67b009e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.736183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8038-a916-4274-9cba-b542f67b009e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.737194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8038-a916-4274-9cba-b542f67b009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.759190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-735d8038-a916-4274-9cba-b542f67b009e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:44.760430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-735d8038-a916-4274-9cba-b542f67b009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:44.768657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2111/4224] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:44.772832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:44.782468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d2c8-df77-4e1e-a2a0-e53bdb86f351 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:44.787046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:44.787698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.787981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.788263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.789046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:07:44.789352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:44.791526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:44.806395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2114/4225] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:07:44.808236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8038-a916-4274-9cba-b542f67b009e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:44.817601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8038-a916-4274-9cba-b542f67b009e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:44.822556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:44.823370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.823649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.824191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.825076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:44.827029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:44.859763 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2112/4226] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:07:44 2021] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:44.861327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:44.883686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d9dab-a57c-4d8d-8070-c94e96462eff admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:44.975324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:44.976130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:44.976483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:44.976864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:44.978166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:44.980965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.006872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2115/4227] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:07:44 2021] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:45.010876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.024830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951061-aca6-4643-a98f-b08481af39d0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.033126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.033810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.034088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.034364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.035690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.037375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.050082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2113/4228] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:45.054049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.064768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8552d2-b460-48e3-973f-4c529805957a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.069814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.070480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.070759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.071034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.071776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.073511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d578-f191-48e3-9feb-ca8bccfdde80 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.087286 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2116/4229] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:45.088936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.099223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c409e9-94dc-4dfd-a2b3-cb7da920a5b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.104995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.105878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.106162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.106439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] PATH_INFO: `/v3/projects/e380af3d93cb4deb9bcae8ba4b4d13de/users/19fd60e129fe4ffd81ed421eefb2aa47/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.121130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e380af3d93cb4deb9bcae8ba4b4d13de, user_id=19fd60e129fe4ffd81ed421eefb2aa47, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.123745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.136476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2114/4230] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:07:45 2021] PUT /identity/v3/projects/e380af3d93cb4deb9bcae8ba4b4d13de/users/19fd60e129fe4ffd81ed421eefb2aa47/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:45.147395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.147940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.148477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.189704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] MFA Rules not processed for user `19fd60e129fe4ffd81ed421eefb2aa47`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:45.190916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:45.255050 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2117/4231] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:45 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:45.266748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.268510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:45.346197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052708c3-98a7-4277-b397-434bb83bf6ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.354372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.355042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.355325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.355602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.364227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.365856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c98c1-c3d0-487e-b93c-15ffd47b55c0 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.375833 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2115/4232] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:45 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:45.411222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.483375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a2349-61eb-4e96-9cfd-ce4d3942a8f2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.490797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.491795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.492077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.492347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] PATH_INFO: `/v3/users/19fd60e129fe4ffd81ed421eefb2aa47` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.493669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fd60e129fe4ffd81ed421eefb2aa47)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.496118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.543723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fd60e129fe4ffd81ed421eefb2aa47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:45.551641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fd60e129fe4ffd81ed421eefb2aa47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:45.552488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fd60e129fe4ffd81ed421eefb2aa47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:45.553277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fd60e129fe4ffd81ed421eefb2aa47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:45.565662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fd60e129fe4ffd81ed421eefb2aa47'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:45.587084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2118/4233] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:07:45 2021] DELETE /identity/v3/users/19fd60e129fe4ffd81ed421eefb2aa47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:45.591986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.592462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.592563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.623918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:45.626146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:45.700126 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2116/4234] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:45.707541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:45.709034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:45.834716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b249e-0052-440a-8951-99954ae3e722 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:45.840521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:45.840521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:45.840896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:45.840977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:45.853641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:45.855284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:45.865842 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2119/4235] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:46.204090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.204930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:46.318815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096054-75e1-453f-8c7d-009b670fff0a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.330799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.331470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.331750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.332149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.336042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:46.349367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.351135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577f1a3-8216-4201-af7c-99ceb22fe92b service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.363182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2117/4236] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:46.429356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.431360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:46.453395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30873c9-d0d9-42f2-8aec-c2cd4e6aedb5 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.458238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.459106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.459388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.459671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] PATH_INFO: `/v3/projects/e380af3d93cb4deb9bcae8ba4b4d13de` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.465986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e380af3d93cb4deb9bcae8ba4b4d13de)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.467958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.529818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e380af3d93cb4deb9bcae8ba4b4d13de', 'request_id': 'req-83137522-4eda-4115-9103-dddb4bbf82d1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:46.538707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e380af3d93cb4deb9bcae8ba4b4d13de', 'request_id': 'req-83137522-4eda-4115-9103-dddb4bbf82d1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:46.546331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e380af3d93cb4deb9bcae8ba4b4d13de', 'request_id': 'req-83137522-4eda-4115-9103-dddb4bbf82d1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:46.567135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] The token cache is being invalidate because project e380af3d93cb4deb9bcae8ba4b4d13de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:07:46.567428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:46.568089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83137522-4eda-4115-9103-dddb4bbf82d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:07:46.569961 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2120/4237] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:07:46 2021] DELETE /identity/v3/projects/e380af3d93cb4deb9bcae8ba4b4d13de => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:46.575648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.575933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.576204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.594432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:46.595621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:46.657454 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2118/4238] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:07:46.665564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.665944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.666845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.685576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:46.686762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:46.694850 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2121/4239] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:46.699255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.709105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c052-59fb-437d-9bff-ebcb6403ccd3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.714369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.715032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.715313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.715586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.716312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:07:46.716630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.718223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.730071 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2119/4240] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:07:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:07:46.734553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.743947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e6c3-b26a-4215-ae66-c1bf0dbf492f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.748531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.749203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.749479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.749753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.750494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.752347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.793525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2122/4241] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:07:46 2021] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:07:46.797904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.825609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05be79-516a-495d-9385-299db8b4ba6a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.880177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.880878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.881161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.881428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.882137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.884030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.904751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2120/4242] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:07:46 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:07:46.909079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.930842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5e72-35fc-4cf2-bc40-4a0278750a07 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.935442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.936093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.936371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.936670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.937391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.938950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.950007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2123/4243] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:46.954057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.964417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6486-5980-4a1a-b6f4-b5dd146e8095 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:46.968984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:46.969655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:46.969930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:46.970202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:46.970928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:46.972492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6f94-e015-4397-a4a0-5fc51734dd15 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:46.982396 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2121/4244] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:07:46.986184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:46.995842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b59b-9719-436e-a0f6-f31a203c620c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:47.000362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:47.001258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:47.001534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:47.001804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] PATH_INFO: `/v3/projects/e047b3c23a5c4dbea0f8b67221c1a5eb/users/67e3e93293b94c1f9be1b7c501073c70/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:47.016460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e047b3c23a5c4dbea0f8b67221c1a5eb, user_id=67e3e93293b94c1f9be1b7c501073c70, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:47.019075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:47.031437 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2124/4245] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:07:46 2021] PUT /identity/v3/projects/e047b3c23a5c4dbea0f8b67221c1a5eb/users/67e3e93293b94c1f9be1b7c501073c70/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:07:47.036469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbe02-fdee-4f8f-9712-e282f7c099da None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:47.036786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbe02-fdee-4f8f-9712-e282f7c099da None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:47.037075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbe02-fdee-4f8f-9712-e282f7c099da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:47.054277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e3cbbe02-fdee-4f8f-9712-e282f7c099da None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:47.055458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e3cbbe02-fdee-4f8f-9712-e282f7c099da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:47.111553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2122/4246] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:47.121533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:47.123275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:47.178697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8685-a82d-4187-8cff-6f8f64661fb2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:47.182235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:47.182860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:47.183136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:47.183406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:47.192028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:47.193517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6afb2b-918c-4234-90d0-1cb8dc9ed521 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:47.203546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2125/4247] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:50.905560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:50.906027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:50.906301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:50.941109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] MFA Rules not processed for user `702de0ff3c7044b2ad6babbe08e948f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:50.942610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:51.053528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2123/4248] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:53.421154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f638a-9760-4154-963d-e0cc4976e869 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:53.421703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f638a-9760-4154-963d-e0cc4976e869 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:53.421703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f638a-9760-4154-963d-e0cc4976e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:53.482857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7a7f638a-9760-4154-963d-e0cc4976e869 None None] MFA Rules not processed for user `67e3e93293b94c1f9be1b7c501073c70`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:53.484279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7a7f638a-9760-4154-963d-e0cc4976e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:53.581269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2126/4249] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:53.627161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:53.628583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:53.710847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549e7-6afd-4735-a53b-f852287e463e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:53.711181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549e7-6afd-4735-a53b-f852287e463e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:53.711461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549e7-6afd-4735-a53b-f852287e463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:53.751177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d33549e7-6afd-4735-a53b-f852287e463e None None] MFA Rules not processed for user `d009c583f1e547879ada9e3f030cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:53.753130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d33549e7-6afd-4735-a53b-f852287e463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:53.767983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a626ee-14cc-41f6-b520-3243ce37eba1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:53.777411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:53.777986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:53.778262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:53.778531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:53.788008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:53.790284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:53.842216 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2124/4250] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:53 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:53.910986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2127/4251] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:53 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:54.568731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:07:54.582626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f427-0123-48e2-8838-9ced760b026e service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:07:54.589376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:07:54.590593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:54.591101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:54.591564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:54.595949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:54.611741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:07:54.613838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d78ae-7a1a-450e-a1a7-66d40aa0f6d9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:07:54.633132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2125/4252] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:07:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:07:57.896418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81380-aaa6-47dc-8aef-2d43c1870b8f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:57.897313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81380-aaa6-47dc-8aef-2d43c1870b8f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:57.897778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81380-aaa6-47dc-8aef-2d43c1870b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:57.918597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-55c81380-aaa6-47dc-8aef-2d43c1870b8f None None] MFA Rules not processed for user `67e3e93293b94c1f9be1b7c501073c70`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:57.920235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-55c81380-aaa6-47dc-8aef-2d43c1870b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:57.928846 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2128/4253] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:07:59.858934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:07:59.859407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:07:59.859654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:07:59.883721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:07:59.885294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:07:59.968781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2126/4254] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:07:59 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:13.130647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:13.131231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:13.131231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:13.149560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] MFA Rules not processed for user `d009c583f1e547879ada9e3f030cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:13.150818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:13.158044 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2129/4255] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:08:13.641421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:13.642873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:13.655865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e28a96-89b7-4eb4-8f75-8f13340aa476 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:13.659819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:13.660718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:13.661176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:13.661603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:13.664049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:13.692986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:13.694812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:13.704728 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2127/4256] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:14.643667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:14.719775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4929e-33f0-43c4-bcf9-4e41bf766b65 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:14.729091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:14.730038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:14.730604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:14.731033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:14.733255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:14.874026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:14.876823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:14.905965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2130/4257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:14 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:32.720175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:32.723190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:32.747166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815e7a-8778-478c-8939-556810b41d8f service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:32.752316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:32.753625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:32.753819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:32.754095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] PATH_INFO: `/v3/users/702de0ff3c7044b2ad6babbe08e948f6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:32.755330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] RBAC: Authorizing `identity:delete_user(user_id=702de0ff3c7044b2ad6babbe08e948f6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:32.757950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:32.810922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702de0ff3c7044b2ad6babbe08e948f6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:32.818152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702de0ff3c7044b2ad6babbe08e948f6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:32.818821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702de0ff3c7044b2ad6babbe08e948f6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:32.831506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702de0ff3c7044b2ad6babbe08e948f6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:32.839574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e9749627-24ed-4dfa-b3a3-2a0532c1ceec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702de0ff3c7044b2ad6babbe08e948f6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:32.845979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2128/4258] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:08:32 2021] DELETE /identity/v3/users/702de0ff3c7044b2ad6babbe08e948f6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:33.021348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.033648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bd1e-40e0-4cf4-8b12-66532b908445 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.111513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.112558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.112938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.113284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] PATH_INFO: `/v3/projects/45e5a7dbbfae4bcea48020c7dbf81b13` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.114787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e5a7dbbfae4bcea48020c7dbf81b13)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.116944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.179967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e5a7dbbfae4bcea48020c7dbf81b13', 'request_id': 'req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:33.185996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e5a7dbbfae4bcea48020c7dbf81b13', 'request_id': 'req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:33.193522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e5a7dbbfae4bcea48020c7dbf81b13', 'request_id': 'req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:33.210712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] The token cache is being invalidate because project 45e5a7dbbfae4bcea48020c7dbf81b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:08:33.211065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:33.212312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f8fdbc96-f5e2-4aa4-9722-0fb27f47da59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:33.214364 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2131/4259] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:08:33 2021] DELETE /identity/v3/projects/45e5a7dbbfae4bcea48020c7dbf81b13 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:33.220368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.220368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.220665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.302362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:33.303787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:33.422802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2129/4260] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:33.430196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.431093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.431384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.452015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:33.453187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:33.462764 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2132/4261] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:33.467039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.479071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efae63a-ccd3-485d-b658-4dbc02a409aa None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.488643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.490007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.490209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.490862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.491807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:08:33.492109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.493747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.507671 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2130/4262] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:08:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:08:33.512925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.523106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00ee5-b827-494d-90ad-2f13733102bd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.529177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.529995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.530279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.530709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.531591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.533744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.567352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2133/4263] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:08:33 2021] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:33.572291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.583198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07040e-e724-444a-9fa7-dabfcf760057 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.642388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.643104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.643336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.643609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.644626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.646232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.668669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2131/4264] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:08:33 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:33.673477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.685530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cf66b-3723-4dfb-8b37-71ea560349af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.692115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.692932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.693312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.693671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.694476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.696760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.710243 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2134/4265] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:08:33.714807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.725739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa91b-827c-47cc-b249-d892bce3b24d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.731810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.732550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.733182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.733782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.734588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.736238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff91e9-3140-4eac-b88c-46b211f25605 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.747955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2132/4266] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:33 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:33.752501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.764228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928bac0-751d-471c-be06-ed13252900fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.770267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.771897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.772403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.772855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] PATH_INFO: `/v3/projects/b4e92b2c7ccd40928d892f4cda1fbec3/users/02d437d7aabc4c9294f0fe5a0a6785e9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.789936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e92b2c7ccd40928d892f4cda1fbec3, user_id=02d437d7aabc4c9294f0fe5a0a6785e9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.792601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.805775 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2135/4267] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:08:33 2021] PUT /identity/v3/projects/b4e92b2c7ccd40928d892f4cda1fbec3/users/02d437d7aabc4c9294f0fe5a0a6785e9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:33.810843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.811128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.811405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.829808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:33.831006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:33.888097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2133/4268] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:33.897867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:33.900369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:33.955813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af77af3-d406-4470-808b-6273a3d84cc5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:33.959529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:33.960104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:33.960387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:33.960695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:33.969435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:33.970841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:33.979891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2136/4269] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:35.587500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:35.601360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407b4d7-3a44-420a-8c53-a02700c73ab5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:35.607929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:35.609271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:35.609271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:35.609467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:35.611923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:35.627808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:35.629353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431a095-11a7-4be8-9b7a-16915444bb30 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:35.653146 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2134/4270] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:39.194023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:39.195573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:39.325892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7195-e580-4e0e-a657-4a966194ffd7 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:39.334213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:39.335002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:39.335317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:39.335680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:39.338580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:39.470143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:39.472085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:39.484187 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2137/4271] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:08:40.039817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:40.040296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:40.040468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:40.066120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] MFA Rules not processed for user `02d437d7aabc4c9294f0fe5a0a6785e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:40.067312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:40.168666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2135/4272] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:40 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:40.177235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:40.178673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:40.209482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e039-561a-487e-8612-b92b0d428995 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:40.223376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:40.224281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:40.224559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:40.224909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:40.237661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:40.239577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:40.268850 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2138/4273] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:40 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:42.196670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:42.198902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:42.223720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b0df-db82-4c7d-b5ed-622f3555ed5f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:42.235462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:42.236326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:42.236726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:42.237097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] PATH_INFO: `/v3/users/18d81f586d0a4e8ea083ba207b9f905e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:42.239205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d81f586d0a4e8ea083ba207b9f905e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:42.242617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:42.327693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d81f586d0a4e8ea083ba207b9f905e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.337502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d81f586d0a4e8ea083ba207b9f905e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.338695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d81f586d0a4e8ea083ba207b9f905e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.352807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d81f586d0a4e8ea083ba207b9f905e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.366209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0231d56-2157-4ad6-9b87-2d64df077fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d81f586d0a4e8ea083ba207b9f905e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.384496 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2136/4274] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:08:42 2021] DELETE /identity/v3/users/18d81f586d0a4e8ea083ba207b9f905e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:42.586358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:42.603568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01382347-d0c2-467f-8e41-1f0274bafa9b service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:42.754721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:42.755908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:42.756351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:42.756877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] PATH_INFO: `/v3/projects/f44752ec82c74a28aa4dac2a2f8f88d3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:42.759145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44752ec82c74a28aa4dac2a2f8f88d3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:42.761342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:42.833244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44752ec82c74a28aa4dac2a2f8f88d3', 'request_id': 'req-85445293-8b13-4698-a8ab-3ddc287907be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.842591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44752ec82c74a28aa4dac2a2f8f88d3', 'request_id': 'req-85445293-8b13-4698-a8ab-3ddc287907be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.850704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44752ec82c74a28aa4dac2a2f8f88d3', 'request_id': 'req-85445293-8b13-4698-a8ab-3ddc287907be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.872017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] The token cache is being invalidate because project f44752ec82c74a28aa4dac2a2f8f88d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:08:42.872528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.873244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-85445293-8b13-4698-a8ab-3ddc287907be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:42.874812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2139/4275] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:08:42 2021] DELETE /identity/v3/projects/f44752ec82c74a28aa4dac2a2f8f88d3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:42.884057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00779-075a-45aa-9174-2062823d0955 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:42.884333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00779-075a-45aa-9174-2062823d0955 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:42.884947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00779-075a-45aa-9174-2062823d0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:42.904942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-95f00779-075a-45aa-9174-2062823d0955 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:42.906169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-95f00779-075a-45aa-9174-2062823d0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:42.975176 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2137/4276] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:42.983360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:42.990054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:42.990328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.019222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:43.023967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:43.054639 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2140/4277] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:43.058802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f00779-075a-45aa-9174-2062823d0955 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.071668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f00779-075a-45aa-9174-2062823d0955 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.087173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.087863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.088236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.089148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.092444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:08:43.092979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.101470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.120002 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2138/4278] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:08:43.120672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.130952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc287-cf04-4580-8ed7-de70e940c137 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.152725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.153401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.153681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.153957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.154681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.156580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.226610 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2141/4279] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:08:43 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:08:43.231466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.243823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb47d6-c2e6-4966-a0f5-38355375c192 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.318964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.319906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.320185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.320456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.321540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.323487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.353152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2139/4280] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:08:43 2021] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:43.357365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.369069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1bdc-ec31-4095-986c-46c7269215b0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.374520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.375276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.375626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.376430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.377063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.378662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.393774 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2142/4281] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:08:43.394968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.405889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720af-a5c3-4ca8-b19d-e41a42f20ca8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.411445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.412412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.412842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.413832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.415500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.419172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1d550-c623-4a13-905a-3d323200ed48 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.433458 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2140/4282] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:43 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:43.440264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.451416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28085-06e2-45d5-86f1-5da6c7992972 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.458028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.459799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.459894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.460152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] PATH_INFO: `/v3/projects/3c38e765554a44f284087c5b705ac3e6/users/88b35f501cd542c19f1260b3f0753e10/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.476258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c38e765554a44f284087c5b705ac3e6, user_id=88b35f501cd542c19f1260b3f0753e10, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.479460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.499228 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2143/4283] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:08:43 2021] PUT /identity/v3/projects/3c38e765554a44f284087c5b705ac3e6/users/88b35f501cd542c19f1260b3f0753e10/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:43.505761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324f79e-03f2-4fcf-b17b-652c10b82392 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.506120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324f79e-03f2-4fcf-b17b-652c10b82392 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.506473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324f79e-03f2-4fcf-b17b-652c10b82392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.527193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0324f79e-03f2-4fcf-b17b-652c10b82392 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:43.528410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0324f79e-03f2-4fcf-b17b-652c10b82392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:43.600676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2141/4284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:43.611503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:43.613249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:43.680864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613de44-ac9d-48c7-a822-2a240c284302 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:43.685477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:43.686475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:43.686910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:43.687342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:43.703445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:43.705007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804683e-f3b4-4ec9-ae65-9a83ef6b6307 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:43.716063 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2144/4285] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:44.693802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:44.694292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:44.695009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:44.727507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] MFA Rules not processed for user `88b35f501cd542c19f1260b3f0753e10`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:44.728854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:44.823843 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2142/4286] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:08:44.834847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:44.836966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:44.837607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:44.863364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] MFA Rules not processed for user `88b35f501cd542c19f1260b3f0753e10`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:44.865170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:44.876441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2145/4287] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:44.887603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:44.892010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:45.048071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fe8d2-a96b-44e0-8504-d4fb3b02593b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:45.061947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:45.062829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:45.063123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:45.063404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:45.073681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:45.075575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:45.085198 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2143/4288] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:44 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:08:46.230660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:46.232116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:46.249371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43ec5-99c4-44b6-844b-261de5efebbf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:46.255408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:46.256468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.257022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.257278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] PATH_INFO: `/v3/users/02d437d7aabc4c9294f0fe5a0a6785e9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.258768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d437d7aabc4c9294f0fe5a0a6785e9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:46.261204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:46.334455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d437d7aabc4c9294f0fe5a0a6785e9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.341259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d437d7aabc4c9294f0fe5a0a6785e9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.342111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d437d7aabc4c9294f0fe5a0a6785e9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.342754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d437d7aabc4c9294f0fe5a0a6785e9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.355171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5bcb3fa9-faac-4a1e-855f-9df8a153b8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d437d7aabc4c9294f0fe5a0a6785e9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.376300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2146/4289] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:08:46 2021] DELETE /identity/v3/users/02d437d7aabc4c9294f0fe5a0a6785e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:46.569596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:46.601877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93592-6b4f-41f0-9298-194cb1167ffd service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:46.678672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:46.679621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.680448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.680907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] PATH_INFO: `/v3/projects/b4e92b2c7ccd40928d892f4cda1fbec3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.682398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e92b2c7ccd40928d892f4cda1fbec3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:46.684580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:46.732264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e92b2c7ccd40928d892f4cda1fbec3', 'request_id': 'req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.737760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e92b2c7ccd40928d892f4cda1fbec3', 'request_id': 'req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.746013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e92b2c7ccd40928d892f4cda1fbec3', 'request_id': 'req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.759806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] The token cache is being invalidate because project b4e92b2c7ccd40928d892f4cda1fbec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:08:46.760091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.760781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56e2e8d2-3d3a-46fe-8815-2f4a888dc35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:46.762335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2144/4290] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:08:46 2021] DELETE /identity/v3/projects/b4e92b2c7ccd40928d892f4cda1fbec3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:46.768597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.768941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.769244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.787047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:46.788247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:46.855763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2147/4291] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:08:46.863419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.863732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.864012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.882362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:46.884141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:46.892017 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2145/4292] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:46.896166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:46.906562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e928-9346-4763-a42e-6eea68670398 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:46.911933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:46.912587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.912899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.913292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.914037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:08:46.914902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:46.916487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:46.928255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2148/4293] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:08:46.933125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:46.942353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50b44f-81ea-4b75-b166-8dd341732378 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:46.947973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:46.948782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:46.949008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:46.949595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:46.950245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:46.952952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:46.992402 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2146/4294] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:08:46 2021] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:46.996395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.007159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d152-4e44-402a-823a-6cb11d313451 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.108106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.109228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.109655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.110117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.111006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.113215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.159597 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2149/4295] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:08:46 2021] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:47.163131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.174541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439aa6-416a-4c0d-b495-d5a906cac3a7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.179499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.180787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.181067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.181339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.182079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.183661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.198259 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2147/4296] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:47.199893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.210267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745209dc-3700-4cb9-a4a2-c8b09a99eb8a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.215599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.216374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.216756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.217486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.217895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.219560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690aca-e220-4a3c-b0b5-a9d109bd45e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.231960 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2150/4297] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:47.235955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.247678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638287-a491-42b0-bdb8-7b05b1be574c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.254920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.255843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.256128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.256444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] PATH_INFO: `/v3/projects/9d7a58d7fa364ec3807cc9bb3bc43140/users/0948bb59b7294f20b2a037bb051afe91/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.274615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7a58d7fa364ec3807cc9bb3bc43140, user_id=0948bb59b7294f20b2a037bb051afe91, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.277409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.296672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2148/4298] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:08:47 2021] PUT /identity/v3/projects/9d7a58d7fa364ec3807cc9bb3bc43140/users/0948bb59b7294f20b2a037bb051afe91/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:47.304754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60e6e-af82-43be-842a-d46dad644cb1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.305179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60e6e-af82-43be-842a-d46dad644cb1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.305613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60e6e-af82-43be-842a-d46dad644cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.334518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-92b60e6e-af82-43be-842a-d46dad644cb1 None None] MFA Rules not processed for user `0948bb59b7294f20b2a037bb051afe91`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:47.335746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-92b60e6e-af82-43be-842a-d46dad644cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:47.433019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2151/4299] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:47.443183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.445276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:47.516822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd05e-51af-407d-af28-c5c152152954 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.521385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.522267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.522754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.523231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.533522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.535312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.548093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2149/4300] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:47.655924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729ebb-eff8-4f29-8d47-8a9c44ace63f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.656283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729ebb-eff8-4f29-8d47-8a9c44ace63f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.656827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729ebb-eff8-4f29-8d47-8a9c44ace63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.679062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-51729ebb-eff8-4f29-8d47-8a9c44ace63f None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:47.680684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51729ebb-eff8-4f29-8d47-8a9c44ace63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:47.739280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2152/4301] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:08:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:47.788283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:47.789904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:47.867986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf3b04-30a2-4f94-972d-cb998ad96292 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:47.873357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:47.874002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:47.874307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:47.874584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:47.882742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:47.884320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:47.893473 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2150/4302] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:08:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:08:48.871464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c314-fab9-46d3-8827-a451f68d680c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:48.871933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c314-fab9-46d3-8827-a451f68d680c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:48.872104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c314-fab9-46d3-8827-a451f68d680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:48.967826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1a78c314-fab9-46d3-8827-a451f68d680c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:48.969207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1a78c314-fab9-46d3-8827-a451f68d680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:48.989581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2153/4303] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:08:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:49.009507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:49.030999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd5e3-f17a-407d-bcf0-6e7e12a7f0b1 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:49.037554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:49.038278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:49.038621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:49.039014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:49.049845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:49.052184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:49.063914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2151/4304] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:08:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:08:54.090368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:54.090869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:54.090990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:54.138485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:54.140596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:54.162996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2154/4305] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:08:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:54.186850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:54.206570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fac1d-8df2-4b87-9d59-8bc0e0856807 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:54.220710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:54.223619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:54.224125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:54.225353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:54.271295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:54.278826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b3a22-bd9b-481b-bc52-17fcbfbe0e5d service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:54.333155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2152/4306] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:08:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:08:54.593637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:54.662707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f896-1c11-4d85-8927-416373a6f4e6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:54.668378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:54.669606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:54.670200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:54.670509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] PATH_INFO: `/v3/users/0948bb59b7294f20b2a037bb051afe91` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:54.671951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0948bb59b7294f20b2a037bb051afe91)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:54.674129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:54.747631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0948bb59b7294f20b2a037bb051afe91'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:54.760485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0948bb59b7294f20b2a037bb051afe91'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:54.761424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0948bb59b7294f20b2a037bb051afe91'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:54.762075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0948bb59b7294f20b2a037bb051afe91'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:54.778220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0948bb59b7294f20b2a037bb051afe91'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:54.797875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2155/4307] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:08:54 2021] DELETE /identity/v3/users/0948bb59b7294f20b2a037bb051afe91 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:54.810514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:54.810792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:54.813025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:54.837570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:54.839187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:54.916961 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2153/4308] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:54.926932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:54.928457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:55.006334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576a98f-31b2-4dad-ae58-817e75189ad8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:55.010808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:55.011588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.011842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.012122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.024543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:55.024543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be61c2-f282-429b-910c-71e06179145c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:55.036287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2156/4309] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:08:55.339495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:55.341981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:55.387899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a18a-25f5-4d51-825d-3e4e2779c40d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:55.394869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:55.398076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.398568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.399024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] PATH_INFO: `/v3/projects/9d7a58d7fa364ec3807cc9bb3bc43140` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.400906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7a58d7fa364ec3807cc9bb3bc43140)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:55.406497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:55.481298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7a58d7fa364ec3807cc9bb3bc43140', 'request_id': 'req-87bec6f4-6d8e-4087-b095-897dcaedec06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:55.488970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7a58d7fa364ec3807cc9bb3bc43140', 'request_id': 'req-87bec6f4-6d8e-4087-b095-897dcaedec06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:55.499145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7a58d7fa364ec3807cc9bb3bc43140', 'request_id': 'req-87bec6f4-6d8e-4087-b095-897dcaedec06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:55.520338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] The token cache is being invalidate because project 9d7a58d7fa364ec3807cc9bb3bc43140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:08:55.520708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:55.521517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87bec6f4-6d8e-4087-b095-897dcaedec06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:55.526102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2154/4310] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:08:55 2021] DELETE /identity/v3/projects/9d7a58d7fa364ec3807cc9bb3bc43140 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:55.536124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.537502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.537987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.578909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:55.580212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:55.690718 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2157/4311] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:55.700004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.700298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.700701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.725356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:55.727290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:55.736816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2155/4312] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:55.742751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:55.755359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c05783-954e-4687-846b-e3562deb7c6b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:55.760418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:55.761111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.761388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.761659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.762557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:08:55.762852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:55.765336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:55.785012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:55.792648 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2158/4313] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:08:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:08:55.796763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e75f2-f612-4eb9-9642-0dc99249ccc9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:55.812070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:55.813122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.813560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.814126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.815042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:55.817562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:55.859955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2156/4314] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:08:55 2021] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:55.862887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:55.872956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699073-5af9-4222-817a-44cfdbf8a862 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:55.941587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:55.942425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:55.942715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:55.943137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:55.943882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:55.946826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:55.979529 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2159/4315] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:08:55 2021] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:08:55.980476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:55.994416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c255e-d4cc-4508-a68d-0629865831cb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.010032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.010865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.011248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.011657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.012593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.014502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:56.039024 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2157/4316] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:55 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:56.040865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:56.056509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627213-a54f-484e-9bb2-58243e98ec92 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.073768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.077657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.078144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.078632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.079576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.081466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b46d3-168f-4060-a88f-bac1a742ac20 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:56.099220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2160/4317] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:56 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:56.099755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:56.116817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af7c5f-bf8c-4c9d-8e17-f47027802830 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.125279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.125996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.126271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.126542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] PATH_INFO: `/v3/projects/91bdda5d19404df0b210e3473eff2aea/users/062ac4ad112d4f95974bf70005028605/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.155919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bdda5d19404df0b210e3473eff2aea, user_id=062ac4ad112d4f95974bf70005028605, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.159271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:56.183808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2158/4318] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:08:56 2021] PUT /identity/v3/projects/91bdda5d19404df0b210e3473eff2aea/users/062ac4ad112d4f95974bf70005028605/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:56.194866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d415-a514-45f6-afa6-dd0adcdfe90b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.195156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d415-a514-45f6-afa6-dd0adcdfe90b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.195467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d415-a514-45f6-afa6-dd0adcdfe90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.241989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff04d415-a514-45f6-afa6-dd0adcdfe90b None None] MFA Rules not processed for user `062ac4ad112d4f95974bf70005028605`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:56.249022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff04d415-a514-45f6-afa6-dd0adcdfe90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.271274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:56.274094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.371949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2161/4319] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:56.382040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.382417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.382838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.411710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] MFA Rules not processed for user `062ac4ad112d4f95974bf70005028605`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:56.413345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.425421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0fb0d-d697-4cea-8530-62cd18298560 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.431846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.433239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.433697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.433822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2162/4320] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:08:56.434297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] PATH_INFO: `/v3/users/d009c583f1e547879ada9e3f030cec40` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.435793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d009c583f1e547879ada9e3f030cec40)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.438176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:56.444513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:56.448447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.501971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd009c583f1e547879ada9e3f030cec40'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:56.510683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd009c583f1e547879ada9e3f030cec40'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:56.511499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd009c583f1e547879ada9e3f030cec40'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:56.531776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd009c583f1e547879ada9e3f030cec40'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:56.545125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd009c583f1e547879ada9e3f030cec40'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:56.553914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2159/4321] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:08:56 2021] DELETE /identity/v3/users/d009c583f1e547879ada9e3f030cec40 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:08:56.579862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f9c02-b25a-43ba-b5ea-3b98a0df149a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.689738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.690545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.690830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.691105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.697663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.853984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:56.855628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:56.889003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.890628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13ec38-47ba-4ad0-b8cf-c7ff382a647c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:56.913106 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2163/4322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:56 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:08:56.949947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06435d4-1283-4be3-89ef-e7deef4ea4b7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:56.955014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:56.956305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:56.956784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:56.957129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] PATH_INFO: `/v3/projects/1cb3ad32a40543dd84c0805ec7f39b5b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:56.958399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb3ad32a40543dd84c0805ec7f39b5b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:56.960414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.041974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb3ad32a40543dd84c0805ec7f39b5b', 'request_id': 'req-f859f3e8-677d-4728-91c2-6895b7406a0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:57.048783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb3ad32a40543dd84c0805ec7f39b5b', 'request_id': 'req-f859f3e8-677d-4728-91c2-6895b7406a0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:57.056043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb3ad32a40543dd84c0805ec7f39b5b', 'request_id': 'req-f859f3e8-677d-4728-91c2-6895b7406a0a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:57.081966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] The token cache is being invalidate because project 1cb3ad32a40543dd84c0805ec7f39b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:08:57.082480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:57.083942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f859f3e8-677d-4728-91c2-6895b7406a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:08:57.086690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2160/4323] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:08:56 2021] DELETE /identity/v3/projects/1cb3ad32a40543dd84c0805ec7f39b5b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:57.093374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.093803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.094143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.123059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:57.124374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:57.232702 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2164/4324] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:57.240794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.241255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.241678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.285465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:57.286630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:57.297310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2161/4325] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:57.301296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.322207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7480-cdb1-4575-9699-328eb67258e1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.337407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.338115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.338399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.339170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.339826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:08:57.339826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.341591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.366359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.366660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2165/4326] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:08:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:08:57.380062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d414-d872-456c-8f1a-0abf258d0dd5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.388207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.390239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.390742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.391228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.392250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.394717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.447334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2162/4327] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:08:57 2021] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:57.449201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.462807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ba72-5269-4f76-a4d4-4102030de6ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.561094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.561839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.562129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.562403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.563144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.565258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.598311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.598877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2166/4328] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:08:57 2021] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:08:57.616776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227a4f-c7cb-46f1-bb71-5dcb5a7dc0d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.627462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.628215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.628584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.628971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.629914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.631784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.643957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2163/4329] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:57 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:57.647573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.661055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2b7a-a0ba-4d92-b097-861d04eb2a16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.672236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.673101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.673451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.673797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.674628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.676309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ee48a-db14-463a-af65-e740e3169501 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.687833 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2167/4330] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:08:57 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:08:57.691754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.702809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fd0cd-3e62-42b0-844f-462a8f0844b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:57.708280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:57.709500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.709798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.710149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] PATH_INFO: `/v3/projects/271f00a4ad02402fbd7b8f766261d599/users/14e59f66385f4e5090ea04544ec6d3e1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.731246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271f00a4ad02402fbd7b8f766261d599, user_id=14e59f66385f4e5090ea04544ec6d3e1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:57.734243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:57.763210 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2164/4331] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:08:57 2021] PUT /identity/v3/projects/271f00a4ad02402fbd7b8f766261d599/users/14e59f66385f4e5090ea04544ec6d3e1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:08:57.774266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:57.774588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:57.774928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:57.811890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] MFA Rules not processed for user `14e59f66385f4e5090ea04544ec6d3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:08:57.813159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:57.906736 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2168/4332] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:08:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:08:57.919134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:08:57.921387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:08:58.087529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90817a-dcf2-4a33-93f3-1e1de86f20b0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:08:58.106286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:08:58.107011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:08:58.107293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:08:58.109672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:08:58.130650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:08:58.132260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:08:58.153821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2165/4333] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:08:57 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:00.956562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:00.959727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:01.140732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24bdbc-d2cc-4ff1-adf9-f6d28e72935b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:01.155759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:01.156599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:01.156960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:01.157896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] PATH_INFO: `/v3/users/88b35f501cd542c19f1260b3f0753e10` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:01.161894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b35f501cd542c19f1260b3f0753e10)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:01.162932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:01.286791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b35f501cd542c19f1260b3f0753e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:01.306071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b35f501cd542c19f1260b3f0753e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:01.307412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b35f501cd542c19f1260b3f0753e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:01.314840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b35f501cd542c19f1260b3f0753e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:01.329018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bd7d3fcb-8450-4782-bf4e-1e5f3f3ec494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b35f501cd542c19f1260b3f0753e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:01.357339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2169/4334] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:00 2021] DELETE /identity/v3/users/88b35f501cd542c19f1260b3f0753e10 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:01.702417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:01.733916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0471-8043-4fb7-b67a-11664ffa67d3 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:01.906465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:01.907596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:01.908034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:01.908682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] PATH_INFO: `/v3/projects/3c38e765554a44f284087c5b705ac3e6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:01.917696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c38e765554a44f284087c5b705ac3e6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:01.920423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.007186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c38e765554a44f284087c5b705ac3e6', 'request_id': 'req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:02.017714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c38e765554a44f284087c5b705ac3e6', 'request_id': 'req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:02.026299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c38e765554a44f284087c5b705ac3e6', 'request_id': 'req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:02.061195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] The token cache is being invalidate because project 3c38e765554a44f284087c5b705ac3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:02.061663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:02.062590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaad559a-3a61-4ac5-8ca6-dac8acc0f7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:02.081333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2166/4335] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:01 2021] DELETE /identity/v3/projects/3c38e765554a44f284087c5b705ac3e6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:02.083376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.085130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.085275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.113024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:02.115129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:02.283343 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2170/4336] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:02.285277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.285441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.285733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.342165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:02.343775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:02.367824 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2167/4337] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:02.371650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.390670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5470b86-b32b-468e-a0cc-b68c15051fc7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.398091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.399022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.399301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.399812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.403531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:02.403973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.406243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.424310 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2171/4338] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:02.430250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.445897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043a1b-f247-4329-a489-5a65eec3cf58 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.463325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.464367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.464920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.468438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.469471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.471718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.525576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2168/4339] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:02 2021] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:02.531758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.546880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9a7f-ddc7-48cd-8ee5-23c3eed8a639 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.672148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.673449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.674324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.674968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.675954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.679318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.720872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2172/4340] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:02 2021] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:02.725550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.741525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c606-9ded-442b-b9d7-9482b6af14be admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.754498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.755994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.756472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.757014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.758151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.759993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.792431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2169/4341] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:02.800737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.819108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bec329-ed97-4af3-a4dc-26c9413ffddf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.827900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.828986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.829438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.830031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.831164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.833193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb84d-ed48-43a8-a3dd-1761faca87ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.860057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2173/4342] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:02.861967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:02.882894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4ed1-0902-4414-b8a1-ab1007294937 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:02.896081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:02.897415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.897959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.898581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] PATH_INFO: `/v3/projects/98e142c68d8145b6b141378452e1280e/users/51992c976c3248d9bce6335688cd3884/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:02.937411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e142c68d8145b6b141378452e1280e, user_id=51992c976c3248d9bce6335688cd3884, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:02.940233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:02.968929 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2170/4343] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:02 2021] PUT /identity/v3/projects/98e142c68d8145b6b141378452e1280e/users/51992c976c3248d9bce6335688cd3884/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:02.974452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e325e-5fe6-470c-b3d4-725f2a5338c5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:02.976015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e325e-5fe6-470c-b3d4-725f2a5338c5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:02.976015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e325e-5fe6-470c-b3d4-725f2a5338c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:03.002808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dd7e325e-5fe6-470c-b3d4-725f2a5338c5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:03.004429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dd7e325e-5fe6-470c-b3d4-725f2a5338c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:03.098791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2174/4344] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:03.110997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:03.113923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:03.195822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d9f7-680e-4a17-8e29-a5b2b934c16b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:03.200058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:03.200721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:03.201006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:03.201279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:03.212461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:03.214018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf6164-3a3a-42ee-b656-370300aa31e7 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:03.224655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2171/4345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:04.740020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:04.741030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:04.742508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:04.786414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:04.790000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:04.900011 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2175/4346] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:04 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:04.912871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:04.913398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:04.913398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:04.934848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:04.936372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:04.948711 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2172/4347] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:04 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:04.949187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:04.956405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:04.966205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:04.968143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:04.971994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798bd69-0a95-48ed-845f-2fbf2b691716 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:04.978219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:04.979091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:04.979362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:04.979886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] PATH_INFO: `/v3/users/14e59f66385f4e5090ea04544ec6d3e1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:04.981599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e59f66385f4e5090ea04544ec6d3e1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:04.983835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:05.033688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e59f66385f4e5090ea04544ec6d3e1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.040284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e59f66385f4e5090ea04544ec6d3e1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.040966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e59f66385f4e5090ea04544ec6d3e1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.041563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e59f66385f4e5090ea04544ec6d3e1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.046605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae317e6-611f-46c6-9a04-777cdd0c2739 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:05.048431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53563d6b-c209-420d-b3d2-e561b64ba594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e59f66385f4e5090ea04544ec6d3e1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.052222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:05.052897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.053190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.053445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.055238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.067018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2176/4348] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:04 2021] DELETE /identity/v3/users/14e59f66385f4e5090ea04544ec6d3e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:05.069139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:05.071291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:05.072992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.073280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.073555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.082085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2173/4349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:04 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:05.095311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:05.097528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.162475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2177/4350] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:05.173129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:05.174778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.188356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06d5c-db1f-44e1-86ea-6c4d0d929a32 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:05.248599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:05.249366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.249759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.250109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.261094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:05.262869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a281c8d-08c4-48db-9188-af51831b6398 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:05.273990 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2174/4351] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:09:05.660223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:05.661625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.674331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34301-7bcf-4fdf-93d9-41335ddd5742 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:05.679348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:05.680583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.680961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.681243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] PATH_INFO: `/v3/projects/271f00a4ad02402fbd7b8f766261d599` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.682474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271f00a4ad02402fbd7b8f766261d599)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:05.684356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:05.766885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271f00a4ad02402fbd7b8f766261d599', 'request_id': 'req-22f93ef5-a9cf-469d-b320-b3f48533b057'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.772686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271f00a4ad02402fbd7b8f766261d599', 'request_id': 'req-22f93ef5-a9cf-469d-b320-b3f48533b057'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.781702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271f00a4ad02402fbd7b8f766261d599', 'request_id': 'req-22f93ef5-a9cf-469d-b320-b3f48533b057'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.794638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] The token cache is being invalidate because project 271f00a4ad02402fbd7b8f766261d599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:05.794926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.795540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22f93ef5-a9cf-469d-b320-b3f48533b057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:05.797117 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2178/4352] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:05 2021] DELETE /identity/v3/projects/271f00a4ad02402fbd7b8f766261d599 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:05.802921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.803208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.803509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.830473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:05.830473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.901014 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2175/4353] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:05.902153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.902651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.903184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.927441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:05.929429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:05.939992 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2179/4354] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:05.944489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:05.970140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c6bd3-0640-4af4-ab28-479c69647613 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:05.984253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:05.985004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:05.985295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:05.985540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:05.986283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:05.986590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:05.989420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.021752 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2176/4355] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:06.028216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.039345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2475fb1-50c1-4595-83e3-1e2a024a69a9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.055515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.056208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.056579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.057410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.063804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.069035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.120498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.121959 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2180/4356] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:06 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:06.134196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd697-f281-4284-b3b9-0a3a1280135f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.209572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.210275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.210503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.211303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.212148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.214230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.253267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2177/4357] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:06 2021] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:06.257543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.271434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e78a3-b4ca-42b5-a50f-12f8fe7ecac8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.280816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.281742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.282198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.282673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.284114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.286265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.306212 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2181/4358] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:06 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:06.310897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.327580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19931-0bf1-4564-8a5e-210a8bb5b2f9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.336678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.339084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.339480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.339601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.340298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.343464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835cb3b-919f-4288-9adc-6bb7f0365fc7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.360667 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2178/4359] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:06 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:06.364725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.377934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfffcd-df10-4026-8903-28eac34394ce admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.388015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.389964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.390586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.390756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] PATH_INFO: `/v3/projects/e91f94f3874e421f89515559e7102c40/users/bd3d9874dca140c2bdecb204150c6dc9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.410657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91f94f3874e421f89515559e7102c40, user_id=bd3d9874dca140c2bdecb204150c6dc9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.413831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.432416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2182/4360] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:06 2021] PUT /identity/v3/projects/e91f94f3874e421f89515559e7102c40/users/bd3d9874dca140c2bdecb204150c6dc9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:06.445438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.446103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.446607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.505239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] MFA Rules not processed for user `bd3d9874dca140c2bdecb204150c6dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:06.507268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:06.622582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2179/4361] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:06 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:06.647952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:06.649783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:06.738954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa244-7571-41d3-bcb9-c911031c4d4c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:06.758195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:06.759235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:06.759696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:06.761781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:06.775591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:06.777678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dde44e-3063-4fc8-b065-57397e603d0a service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:06.795905 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2183/4362] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:06 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:07.115118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:07.227984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b28cec-2710-45cf-89bb-d25bbc46e2c7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:07.233201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:07.234581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:07.234581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:07.234581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] PATH_INFO: `/v3/users/bd3d9874dca140c2bdecb204150c6dc9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:07.235789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3d9874dca140c2bdecb204150c6dc9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:07.237761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:07.283612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3d9874dca140c2bdecb204150c6dc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:07.290924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3d9874dca140c2bdecb204150c6dc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:07.291646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3d9874dca140c2bdecb204150c6dc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:07.303526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3d9874dca140c2bdecb204150c6dc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:07.313893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3d9874dca140c2bdecb204150c6dc9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:07.321883 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2180/4363] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:07 2021] DELETE /identity/v3/users/bd3d9874dca140c2bdecb204150c6dc9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:07.327395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:07.327684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:07.327958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:07.344946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:07.346161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:07.425970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2184/4364] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:07.437761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:07.439062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:07.506565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caef47c-3c94-40d9-9633-fc68165a184a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:07.510428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:07.511030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:07.511338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:07.511607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:07.522631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:07.524752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5ea34-2e0c-4387-9a4c-df4c9f6f3917 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:07.535456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2181/4365] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:07.913871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:07.917090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:07.935976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49712f-cf33-43c9-95ce-c6973271589d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:07.944189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:07.946621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:07.948386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:07.948983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] PATH_INFO: `/v3/projects/e91f94f3874e421f89515559e7102c40` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:07.951933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91f94f3874e421f89515559e7102c40)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:07.955973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.020877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91f94f3874e421f89515559e7102c40', 'request_id': 'req-1a4521c8-580a-4481-bb79-0b3c6f782422'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:08.029957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91f94f3874e421f89515559e7102c40', 'request_id': 'req-1a4521c8-580a-4481-bb79-0b3c6f782422'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:08.037603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91f94f3874e421f89515559e7102c40', 'request_id': 'req-1a4521c8-580a-4481-bb79-0b3c6f782422'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:08.053201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] The token cache is being invalidate because project e91f94f3874e421f89515559e7102c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:08.053871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:08.055357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a4521c8-580a-4481-bb79-0b3c6f782422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:08.058233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2185/4366] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:07 2021] DELETE /identity/v3/projects/e91f94f3874e421f89515559e7102c40 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:08.065585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1003d-ca6c-4c25-904d-6bdf76d51400 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.065881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1003d-ca6c-4c25-904d-6bdf76d51400 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.066128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1003d-ca6c-4c25-904d-6bdf76d51400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.094689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8cd1003d-ca6c-4c25-904d-6bdf76d51400 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:08.096164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8cd1003d-ca6c-4c25-904d-6bdf76d51400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:08.135660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.135845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.136118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.172777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:08.176412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:08.181378 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2182/4367] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:08.190179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.190773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.195420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.229973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:08.231190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:08.242830 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2183/4368] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:08.249180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.264948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2186/4369] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:08.268332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757b6cf-8c44-4539-a3e9-cec873e71dc0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.273912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.275843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.275843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.275843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.276911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:08.277271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.278974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.283058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.285062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:08.292656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2184/4370] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:08.297662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.309301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8773ec-bb38-4e9c-b4ad-1b689854cacc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.314613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.315515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.315878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.316158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.316931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.318859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.367350 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2185/4371] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:08.372354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.444526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012af44-3218-4db3-a2af-be66f4783c03 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.471086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b8fa-4550-499d-8d47-0a5dcd658972 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.478375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.479223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.479676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.480096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.480970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.483001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.517786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2186/4372] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:08.518865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.529256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.530074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.530293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.530554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.531482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea697-bdb5-4324-bd03-f572da4b0ea1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.536735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.537507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.537788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.538360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.539143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.541368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.560182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2187/4373] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:08 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:08.565758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.579448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c572-e8fd-4e21-8a08-b597436173bd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.584549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.585548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.585833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.586107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.587309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.588788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.604950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2188/4374] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:08 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:08.606272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:08.607352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.609114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21d72-6a75-4a21-a89f-8857fd2d9348 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.621420 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2187/4375] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:09:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:09:08.629898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c0bb-8c2a-44cc-8d97-dd20ee3597b3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:08.636499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:08.637433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.637832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.637978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] PATH_INFO: `/v3/projects/376e4423dea94757a9af12adf3a547f4/users/33889c2dd1094ea69c18c275cb38f926/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.666107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=376e4423dea94757a9af12adf3a547f4, user_id=33889c2dd1094ea69c18c275cb38f926, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:08.670570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:08.700090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2189/4376] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:08 2021] PUT /identity/v3/projects/376e4423dea94757a9af12adf3a547f4/users/33889c2dd1094ea69c18c275cb38f926/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:08.706744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:08.707193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:08.707470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:08.762352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] MFA Rules not processed for user `33889c2dd1094ea69c18c275cb38f926`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:08.763511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:08.925047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2188/4377] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:08.931798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.027339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8dfd-6f6d-48ea-a752-6be54a19b7eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.037334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.038448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.039796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.040257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.041806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.044099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.084657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2190/4378] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:08 2021] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:09.091226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.107102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ebaf-1a7a-42a8-a11a-6d30c0368ce9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.184301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.185599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.186015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.186670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.187546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.190057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.211939 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2189/4379] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:09 2021] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:09.215866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.229793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c70d6-7a0c-4717-9e91-24ea9b5dd416 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.238732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.239526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.239792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.240060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.240887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.242670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.257888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2191/4380] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:09.258588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.275823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab66-a782-43ed-90d6-4a0646d6a737 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.283116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.284659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.285058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.293018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] PATH_INFO: `/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857/users/901ff9a4f7374e00a76d815a67c78f89/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.315440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd6658e64ee43e4a6fe2e81f6cce857, user_id=901ff9a4f7374e00a76d815a67c78f89, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.318270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.342031 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2190/4381] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:09 2021] PUT /identity/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857/users/901ff9a4f7374e00a76d815a67c78f89/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:09.346491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.358926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4baca6-475c-46ec-ab7a-4134adc26a46 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.426377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.426960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.427240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.427510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.428437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.430205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4732b-5ed1-4c61-a864-ba45a4874dbe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.444469 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2192/4382] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:09.449951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.462416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1a4b-e898-4da4-9ad5-471be44fc061 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.469744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.470777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.471126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.471476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] PATH_INFO: `/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857/users/901ff9a4f7374e00a76d815a67c78f89/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.473930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd6658e64ee43e4a6fe2e81f6cce857, user_id=901ff9a4f7374e00a76d815a67c78f89, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.477427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.492232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2191/4383] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:09 2021] PUT /identity/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857/users/901ff9a4f7374e00a76d815a67c78f89/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:09.566260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.566624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.566814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.600557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] MFA Rules not processed for user `901ff9a4f7374e00a76d815a67c78f89`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:09.601848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:09.685366 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2193/4384] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:09 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:09.690727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.702545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e941-bd24-4453-b91c-4227dd25927b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.707765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.708434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.708814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.709019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.709783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.711937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.735272 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2192/4385] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:09 2021] POST /identity/v3/domains => generated 246 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:09.739788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.749552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b0ff-8548-40d3-ab89-6ccf605c6e9e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.845454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.846222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.846569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.846909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.847756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.851099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:09.891109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2194/4386] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:09 2021] POST /identity/v3/projects => generated 408 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:09.895109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:09.911161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e3f6-7a75-4d8a-8334-43855c7044fe tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:09.975775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:09.977179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:09.977471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:09.977782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:09.978518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:09.980484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.002019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2193/4387] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:09 2021] POST /identity/v3/users => generated 348 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:10.006319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.017211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d873-e368-4664-897c-7bc7fa9905f0 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.021957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.022733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.023117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.023461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.024300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.026040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548eeecd-14aa-416f-a081-17c5ad376fb1 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.035958 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2195/4388] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:10.040387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.050549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6e7a6-c55a-4438-87ab-b3189e2c8428 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.055842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.056866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.057148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.057422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/projects/1e2f3f7eeee84f7e85f31d11455fb123/users/370c68ec408543d0bb7a8c6cc750e44e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.074952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f3f7eeee84f7e85f31d11455fb123, user_id=370c68ec408543d0bb7a8c6cc750e44e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.077586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e23ed7-c5be-4cdc-be33-d8eaf707c2ab tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.094292 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2194/4389] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:10 2021] PUT /identity/v3/projects/1e2f3f7eeee84f7e85f31d11455fb123/users/370c68ec408543d0bb7a8c6cc750e44e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:10.096222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.096648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.097009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.235328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] MFA Rules not processed for user `370c68ec408543d0bb7a8c6cc750e44e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:10.236571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:10.252921 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2196/4390] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:10 2021] POST /identity/v3/auth/tokens => generated 3353 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:10.262241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.262521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.262794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.280892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] MFA Rules not processed for user `370c68ec408543d0bb7a8c6cc750e44e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:10.282202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:10.289845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2195/4391] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:10 2021] POST /identity/v3/auth/tokens => generated 3353 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:10.294107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.305045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ada25d-b1ef-4035-b932-754637d27aa6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.310021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370c68ec408543d0bb7a8c6cc750e44e', 'user_domain_id': '34eb305602ae41d19dcc455ee3851b67', 'system_scope': None, 'project_id': '1e2f3f7eeee84f7e85f31d11455fb123', 'project_domain_id': '34eb305602ae41d19dcc455ee3851b67', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.310839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.311291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.311651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.322401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.324298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.334314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2197/4392] 10.222.0.13 () {56 vars in 1283 bytes} [Wed Nov 10 04:09:10 2021] GET /identity/v3/auth/tokens => generated 3353 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:10.339085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.428771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788759-6e1a-4ab0-a5a5-f48dde353d80 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.435225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.436366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.436676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.436956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/users/370c68ec408543d0bb7a8c6cc750e44e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.438181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:delete_user(user_id=370c68ec408543d0bb7a8c6cc750e44e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.440714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.514456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370c68ec408543d0bb7a8c6cc750e44e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.528286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370c68ec408543d0bb7a8c6cc750e44e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.533055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370c68ec408543d0bb7a8c6cc750e44e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.533742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370c68ec408543d0bb7a8c6cc750e44e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.543504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7456b900-6172-4131-9f38-1f905d261060 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370c68ec408543d0bb7a8c6cc750e44e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.563390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2196/4393] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:10 2021] DELETE /identity/v3/users/370c68ec408543d0bb7a8c6cc750e44e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:10.567545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.578877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7254-fd11-4585-8e90-6c9cdb5d91aa tempest-test_project-1160390017 tempest-user-1475173165] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.642565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.644798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.645306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.645773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/projects/1e2f3f7eeee84f7e85f31d11455fb123` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.649611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e2f3f7eeee84f7e85f31d11455fb123)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.652599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.779852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2f3f7eeee84f7e85f31d11455fb123', 'request_id': 'req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.791598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.791916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.792238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.805663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2f3f7eeee84f7e85f31d11455fb123', 'request_id': 'req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.817575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2f3f7eeee84f7e85f31d11455fb123', 'request_id': 'req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.821695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:10.822928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:10.843927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] The token cache is being invalidate because project 1e2f3f7eeee84f7e85f31d11455fb123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:10.844191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.844963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.852045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2198/4394] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:10 2021] DELETE /identity/v3/projects/1e2f3f7eeee84f7e85f31d11455fb123 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:10.853489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:10.855367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:10.935554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2197/4395] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:10.947267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e2b67-7cf7-4c04-b4c6-1d22da977ce4 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:10.953559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:10.954925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:10.955203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:10.955604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/domains/34eb305602ae41d19dcc455ee3851b67` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:10.958553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34eb305602ae41d19dcc455ee3851b67)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:10.959182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:10.985958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:10.986447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.016205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.016924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.019788 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2199/4396] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:10 2021] PATCH /identity/v3/domains/34eb305602ae41d19dcc455ee3851b67 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:11.024543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:11.036074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bd15b-7773-4e3f-a03a-4298803df735 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:11.100352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '901ff9a4f7374e00a76d815a67c78f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:11.101388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:11.101739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:11.102081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] PATH_INFO: `/v3/domains/34eb305602ae41d19dcc455ee3851b67` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:11.113924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34eb305602ae41d19dcc455ee3851b67)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:11.115620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:11.141354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.153991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34eb305602ae41d19dcc455ee3851b67'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.205003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.211897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.239769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.272914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] The token cache is being invalidate because project 34eb305602ae41d19dcc455ee3851b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:11.273953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.274987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.300555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.303088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.303859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34eb305602ae41d19dcc455ee3851b67', 'request_id': 'req-792d06a3-7e8e-4b03-8c58-3d56953cd2ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.318978 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2198/4397] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:11 2021] DELETE /identity/v3/domains/34eb305602ae41d19dcc455ee3851b67 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:11.319708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:11.321750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:11.418025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38210ef-c410-4ff2-b9a6-dacb5cac7f47 tempest-TestDefaultProjectId-383295043 tempest-TestDefaultProjectId-383295043-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:11.534128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:11.535129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:11.535517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:11.536199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] PATH_INFO: `/v3/users/33889c2dd1094ea69c18c275cb38f926` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:11.537620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33889c2dd1094ea69c18c275cb38f926)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:11.540193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:11.603262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33889c2dd1094ea69c18c275cb38f926'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.610966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33889c2dd1094ea69c18c275cb38f926'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.611767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33889c2dd1094ea69c18c275cb38f926'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.627969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33889c2dd1094ea69c18c275cb38f926'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.636548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33889c2dd1094ea69c18c275cb38f926'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:11.643701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2200/4398] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:11 2021] DELETE /identity/v3/users/33889c2dd1094ea69c18c275cb38f926 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:11.648154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:11.648579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:11.648971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:11.668335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:11.670333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:11.826043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2199/4399] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:11.838292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:11.840032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:11.925517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8ad7a-9a92-47b9-b30e-cd368783aa89 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:11.944911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:11.945594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:11.945881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:11.946694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:11.961612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:11.964489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:11.976879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2201/4400] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:12.486883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:12.491390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:12.513234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830753e-e2ad-47e6-ade4-996d4c9a6644 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:12.529813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:12.530911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:12.531236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:12.531513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] PATH_INFO: `/v3/projects/376e4423dea94757a9af12adf3a547f4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:12.535570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=376e4423dea94757a9af12adf3a547f4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:12.539378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:12.662603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376e4423dea94757a9af12adf3a547f4', 'request_id': 'req-a550159b-77d1-45d4-95a9-545e5d49e7aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.682672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376e4423dea94757a9af12adf3a547f4', 'request_id': 'req-a550159b-77d1-45d4-95a9-545e5d49e7aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.689173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376e4423dea94757a9af12adf3a547f4', 'request_id': 'req-a550159b-77d1-45d4-95a9-545e5d49e7aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.707571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] The token cache is being invalidate because project 376e4423dea94757a9af12adf3a547f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:12.708285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.709508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.712305 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2200/4401] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:12 2021] DELETE /identity/v3/projects/376e4423dea94757a9af12adf3a547f4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:12.716314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:12.733200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fbc9-d03d-42d6-97cd-e52259bfe923 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:12.836092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:12.839369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:12.839658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:12.839936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] PATH_INFO: `/v3/users/901ff9a4f7374e00a76d815a67c78f89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:12.844542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ff9a4f7374e00a76d815a67c78f89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:12.849523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:12.934718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ff9a4f7374e00a76d815a67c78f89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.944808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ff9a4f7374e00a76d815a67c78f89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.946524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ff9a4f7374e00a76d815a67c78f89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.964038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ff9a4f7374e00a76d815a67c78f89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.977809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15d1bdb5-ca13-4664-b3c7-7967ef91e8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ff9a4f7374e00a76d815a67c78f89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:12.990314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2202/4402] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:12 2021] DELETE /identity/v3/users/901ff9a4f7374e00a76d815a67c78f89 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:12.990533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:12.992408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:13.010355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550159b-77d1-45d4-95a9-545e5d49e7aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:13.136723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:13.138161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:13.138893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:13.139431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] PATH_INFO: `/v3/users/062ac4ad112d4f95974bf70005028605` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:13.142035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] RBAC: Authorizing `identity:delete_user(user_id=062ac4ad112d4f95974bf70005028605)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:13.144949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:13.222414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062ac4ad112d4f95974bf70005028605'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.234418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062ac4ad112d4f95974bf70005028605'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.235438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062ac4ad112d4f95974bf70005028605'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.237742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062ac4ad112d4f95974bf70005028605'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.272454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062ac4ad112d4f95974bf70005028605'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.322760 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2201/4403] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:12 2021] DELETE /identity/v3/users/062ac4ad112d4f95974bf70005028605 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:13.328521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:13.328905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:13.329084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:13.383173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:13.385247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:13.511117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2203/4404] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:13.531638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:13.533970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:13.667011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:13.668558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:13.692368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31f40b-b16a-4a4e-995b-6b77bbd2019c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:13.707407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851911-a8d4-4410-a945-1f56ea6d384d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:13.708509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:13.709251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:13.710029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:13.710837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:13.719397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:13.720270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:13.720551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:13.720850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] PATH_INFO: `/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:13.729301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd6658e64ee43e4a6fe2e81f6cce857)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:13.731332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:13.734648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:13.736086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37302f9-b4f4-40b7-9a45-31c5db7f5287 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:13.747788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2202/4405] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:13.795088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'request_id': 'req-aae8ee23-b621-4e90-823a-4f3490b2ca6b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.813384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'request_id': 'req-aae8ee23-b621-4e90-823a-4f3490b2ca6b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.823888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd6658e64ee43e4a6fe2e81f6cce857', 'request_id': 'req-aae8ee23-b621-4e90-823a-4f3490b2ca6b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.861759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] The token cache is being invalidate because project ecd6658e64ee43e4a6fe2e81f6cce857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:13.862053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.865115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:13.867895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2204/4406] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:13 2021] DELETE /identity/v3/projects/ecd6658e64ee43e4a6fe2e81f6cce857 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:13.873723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd2c7-4a34-49a4-bb82-b28b360cc0a5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:13.874012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd2c7-4a34-49a4-bb82-b28b360cc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:13.874289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd2c7-4a34-49a4-bb82-b28b360cc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:13.910175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-95fdd2c7-4a34-49a4-bb82-b28b360cc0a5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:13.911400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95fdd2c7-4a34-49a4-bb82-b28b360cc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.024339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2203/4407] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:14.024530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.024530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.026565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.026788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.027067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.054825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8ee23-b621-4e90-823a-4f3490b2ca6b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.060421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.060915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:14.061886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.062164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.062267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.062429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] PATH_INFO: `/v3/projects/91bdda5d19404df0b210e3473eff2aea` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.063860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bdda5d19404df0b210e3473eff2aea)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.072657 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2204/4408] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:14.078149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.082826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.092277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba44c8b-f592-4e4d-a0e5-0fc3b7c5e98a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.107597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.108964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.109402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.109843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.110743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:14.111206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.113051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.131788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2205/4409] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:14.137312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.162030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76e103-c715-412c-bd66-e5a30cff4730 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.177675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bdda5d19404df0b210e3473eff2aea', 'request_id': 'req-2c67531e-e51b-40b4-a606-53bc8fed0563'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:14.189408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bdda5d19404df0b210e3473eff2aea', 'request_id': 'req-2c67531e-e51b-40b4-a606-53bc8fed0563'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:14.207658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bdda5d19404df0b210e3473eff2aea', 'request_id': 'req-2c67531e-e51b-40b4-a606-53bc8fed0563'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:14.230922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] The token cache is being invalidate because project 91bdda5d19404df0b210e3473eff2aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:14.231856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:14.231856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2c67531e-e51b-40b4-a606-53bc8fed0563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:14.234116 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2205/4410] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:14 2021] DELETE /identity/v3/projects/91bdda5d19404df0b210e3473eff2aea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:14.240164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce235b-4901-4b1e-8d03-65b1a2e460a9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.240766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce235b-4901-4b1e-8d03-65b1a2e460a9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.241967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce235b-4901-4b1e-8d03-65b1a2e460a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.271627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4fce235b-4901-4b1e-8d03-65b1a2e460a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:14.273512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4fce235b-4901-4b1e-8d03-65b1a2e460a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.285990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.286800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.287165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.287499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.288561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.290562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.293955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2206/4411] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:14.301836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.302122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.302464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.325118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:14.326461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.348818 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2207/4412] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:14.350303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.352008 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2206/4413] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:14.356070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.360010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:14.363006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f2e5-50fa-42c2-8199-901861d5efbf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.442247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.443149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.443593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.444428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.446204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:14.446741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.449380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.467942 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2208/4414] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:14.473339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.485495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c89b-12ce-4a7a-9371-34fb14a8c0c8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.500528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3f42-b293-4f04-bd88-ebf630393667 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.510625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.513106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.513666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.514195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.515404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.516244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.516751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.517473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.517609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.520340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.520954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.522927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.565917 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2207/4415] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:14.571931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.584159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168135a-595f-47bc-87f4-1d54e070c055 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.589452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.590348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.590982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.591189 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2209/4416] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:14.591675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.592631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.594284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.595093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.673606 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2208/4417] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:14.676344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.722827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a33dd-2894-4dd8-9b8f-e36532c520ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.758359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34716-f5f3-4a13-8e81-38362dda74f8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.774376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.775072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.775420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.775701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.776424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.790116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.840846 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2210/4418] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:14 2021] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:14.844537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.879054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff2125-9c17-4600-8d22-8c58409c1a82 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.897038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.897708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.899419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.899557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.901067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.902921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.920972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.921931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.922160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.922433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.923176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.925819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.937898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2211/4419] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:14.939349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.944252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2209/4420] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:14.948234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:14.960455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213bcb-7031-42e6-ad9d-7612df125b14 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.963477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92be7e1-fe89-4769-9a18-5af5b2a59e26 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:14.967617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.970071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.971856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.972454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.973204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:14.974011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:14.974295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:14.974616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] PATH_INFO: `/v3/projects/388f0d276c1f49a2a0c7562092f336ff/users/c377329baa4c4be5a98ee2fa5341ec89/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:14.974894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.977509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:14.994669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388f0d276c1f49a2a0c7562092f336ff, user_id=c377329baa4c4be5a98ee2fa5341ec89, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:14.998081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94a687-60e1-4989-a019-c0884bd2c9f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.002219 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2212/4421] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:14 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:15.004654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.020658 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2210/4422] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:14 2021] PUT /identity/v3/projects/388f0d276c1f49a2a0c7562092f336ff/users/c377329baa4c4be5a98ee2fa5341ec89/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:15.023835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b7b3-8b74-49c5-b55e-f54faf8be976 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.031558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.031889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.032101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.082392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] MFA Rules not processed for user `c377329baa4c4be5a98ee2fa5341ec89`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:15.085903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:15.102889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.104033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.104409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.104858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] PATH_INFO: `/v3/projects/a4ba1ac504404cd394e7043b3a15314f/users/f1084ec6362b41f088d44ef2170b5625/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.129652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ba1ac504404cd394e7043b3a15314f, user_id=f1084ec6362b41f088d44ef2170b5625, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.132474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2084b7-f951-4ede-b53e-62f14afd09b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.174701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2213/4423] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:15 2021] PUT /identity/v3/projects/a4ba1ac504404cd394e7043b3a15314f/users/f1084ec6362b41f088d44ef2170b5625/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:15.176992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.177741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.178022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.205711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2211/4424] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:15.211088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.213146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] MFA Rules not processed for user `f1084ec6362b41f088d44ef2170b5625`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:15.214869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:15.225840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ee37e-0d1b-4f00-9629-5cf24b9aabcb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.314211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.314920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.315206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.315743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.316996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.318148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2214/4425] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:15.319174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.319588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.321883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:15.366466 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2212/4426] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:15.370301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.417440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d33edc-93ab-40fa-a79f-0ad373b5ecda None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.454333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ea3c-239d-4335-81c1-a693dc41fc0c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.460994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.461827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.462109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.462390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.463109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.466860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.509687 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2213/4427] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:15.510945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.511298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.512065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.512344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.512793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.522579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7ec5-ca1a-4e1c-8c05-c7eb4599c898 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.529682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.530598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.531129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.531619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.532990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.535315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.554276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2214/4428] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:15.557161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.581433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4efd8-b2ee-43a7-b869-6c1d80d9ab4b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.588670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.589661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.589996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.590380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] PATH_INFO: `/v3/projects/f6d3311705fe444fb278f5cffad8ed71/users/d41e993edbab4ebdad51553043d8dbef/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.606692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.608389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.608771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d3311705fe444fb278f5cffad8ed71, user_id=d41e993edbab4ebdad51553043d8dbef, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.613096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.633901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2215/4430] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:15 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:15.634506 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2215/4430] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:15 2021] PUT /identity/v3/projects/f6d3311705fe444fb278f5cffad8ed71/users/d41e993edbab4ebdad51553043d8dbef/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:15.635646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.661355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a42f7-e1a1-4e8d-ac43-bdd52eac9005 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.740999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.741709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.741996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.742273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.743009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.750253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f0d75-29d1-46cc-b135-bf820c96c7ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.763916 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2216/4431] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:15.768062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.779034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3031a0-1e92-40cb-a65e-e6ba5d9a38b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.785940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.786875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.787086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.787357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] PATH_INFO: `/v3/projects/f6d3311705fe444fb278f5cffad8ed71/users/d41e993edbab4ebdad51553043d8dbef/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.789431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d3311705fe444fb278f5cffad8ed71, user_id=d41e993edbab4ebdad51553043d8dbef, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:15.794299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:15.818312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:15.818312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:15.818470 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2216/4432] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:15 2021] PUT /identity/v3/projects/f6d3311705fe444fb278f5cffad8ed71/users/d41e993edbab4ebdad51553043d8dbef/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:15.818546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:15.876791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] MFA Rules not processed for user `d41e993edbab4ebdad51553043d8dbef`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:15.880316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:15.976738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2217/4433] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:15.982066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:15.993820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4f6-9c53-4208-baad-b0fde1bc8976 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:15.998785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:15.999901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.000185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.000458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.001389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.002963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.030314 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2217/4434] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:15 2021] POST /identity/v3/domains => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:16.031302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.040938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873f906-7a84-4451-ab78-fb36a228d82c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.145392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.146303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.146586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.146865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.149196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=822862c8298444a59e78bca326c3e544)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.150251 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:16.150251 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:16.150251 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:16.151135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.233218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2218/4435] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:09:16 2021] PUT /identity/v3/domains/822862c8298444a59e78bca326c3e544/config => generated 138 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:16.235049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.250465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bf283-5599-42c9-ae7e-be748c19329d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.264642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.268697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.269199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.269669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.273024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=822862c8298444a59e78bca326c3e544, group=identity)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.274208 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:16.274208 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:09:16.274208 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:09:16.275750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.298594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.298835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2218/4436] 10.222.0.13 () {58 vars in 1274 bytes} [Wed Nov 10 04:09:16 2021] GET /identity/v3/domains/822862c8298444a59e78bca326c3e544/config/identity => generated 45 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:16.311351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04727a-f62e-40ce-a718-299efb3b2b8b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.316740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.317993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.318124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.318379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config/identity/driver` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.319837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=822862c8298444a59e78bca326c3e544, group=identity, option=driver)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.321052 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:16.321052 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:16.321052 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:16.322007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.329773 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2219/4437] 10.222.0.13 () {58 vars in 1295 bytes} [Wed Nov 10 04:09:16 2021] GET /identity/v3/domains/822862c8298444a59e78bca326c3e544/config/identity/driver => generated 31 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:16.333505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.347769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83efe29-6362-4c92-b1b7-b969f44a289b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.358523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.359383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.359666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.359998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.361276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=822862c8298444a59e78bca326c3e544, group=ldap)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.363049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.374353 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2219/4438] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:09:16 2021] GET /identity/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap => generated 106 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:16.375989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.386881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44975dd6-e1a5-42b1-ad19-ddf4997dbf5b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.392162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.393086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.393366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.393640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap/url` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.395047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=822862c8298444a59e78bca326c3e544, group=ldap, option=url)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.396731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.403363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2220/4439] 10.222.0.13 () {58 vars in 1274 bytes} [Wed Nov 10 04:09:16 2021] GET /identity/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap/url => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:16.408508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.423736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7207-8fde-40ae-97c4-28d3f3b7271b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.431973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.433345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.433848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.434337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap/user_tree_dn` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.436275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=822862c8298444a59e78bca326c3e544, group=ldap, option=user_tree_dn)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.438928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ff6f4-8213-498a-beb2-74ac956f6f79 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.452255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.452723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2220/4440] 10.222.0.13 () {58 vars in 1301 bytes} [Wed Nov 10 04:09:16 2021] GET /identity/v3/domains/822862c8298444a59e78bca326c3e544/config/ldap/user_tree_dn => generated 63 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:16.464400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ecb5-1a70-488c-80c5-bf5099636f91 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.470312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.471155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.472366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.472366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.473070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=822862c8298444a59e78bca326c3e544)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.474085 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:16.474085 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:16.474085 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:16.475020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.509737 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2221/4441] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:16 2021] DELETE /identity/v3/domains/822862c8298444a59e78bca326c3e544/config => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:16.512701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.512999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.513278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.514605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.536288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:16.537555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:16.539807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273d3de-c40f-4469-9fcf-3208b6668c6c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.546520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.547382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.547659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.547961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.549855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=822862c8298444a59e78bca326c3e544)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.551507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.574867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.575646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.603870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.605174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.605708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2221/4442] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:16 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:16.607063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.608624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:16.609574 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2222/4443] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:16 2021] PATCH /identity/v3/domains/822862c8298444a59e78bca326c3e544 => generated 276 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:16.613040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.614616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:16.717902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3e4a-35bf-443f-af63-f9fa3e7d7577 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.727019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a095-9444-4e2e-9bee-c2d02cd57e42 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:16.732595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.733578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.733933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.734275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.748543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=822862c8298444a59e78bca326c3e544)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.750680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.778699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.785347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '822862c8298444a59e78bca326c3e544'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.788581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:16.789481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.789764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.790052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] PATH_INFO: `/v3/users/f1084ec6362b41f088d44ef2170b5625` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:16.791288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1084ec6362b41f088d44ef2170b5625)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:16.793797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:16.854800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.862617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.870394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.895794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] The token cache is being invalidate because project 822862c8298444a59e78bca326c3e544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:16.896139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.897401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.907279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1084ec6362b41f088d44ef2170b5625'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.907793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.912140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.913077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '822862c8298444a59e78bca326c3e544', 'request_id': 'req-de88121d-f4a6-4f24-b031-ba37af38ce8c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.921802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2223/4444] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:16 2021] DELETE /identity/v3/domains/822862c8298444a59e78bca326c3e544 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:16.928376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:16.929828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1084ec6362b41f088d44ef2170b5625'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.930705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:16.931180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1084ec6362b41f088d44ef2170b5625'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.933042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1084ec6362b41f088d44ef2170b5625'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.946620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e56a27c8-4758-429b-be33-d9be06d4d99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1084ec6362b41f088d44ef2170b5625'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:16.977025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2222/4445] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:16 2021] DELETE /identity/v3/users/f1084ec6362b41f088d44ef2170b5625 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:16.983519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:16.986769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:16.987571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.010217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:17.010768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88121d-f4a6-4f24-b031-ba37af38ce8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.011874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:17.092762 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2223/4446] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:17.099282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.101549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.102160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.102727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.103658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.105476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.116314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.119876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:17.130596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2224/4447] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:16 2021] POST /identity/v3/domains => generated 276 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:17.135419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.138836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:17.225812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2286-f97c-4b5f-90cf-4982dbb6b585 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.287982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0bf3c-4a9e-4447-9f73-e0312344484d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.293906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.294908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.295285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.295941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.296856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.298635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.353590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.354354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.354637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.355096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.360250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2225/4448] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:09:17 2021] PUT /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 138 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:17.361202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.375902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be596-a0b4-48aa-97ef-9f29ff001034 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.388263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.389162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.389437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.389712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.390502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.391627 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:17.391627 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:17.391627 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:17.392523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.425894 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2226/4449] 10.222.0.13 () {60 vars in 1270 bytes} [Wed Nov 10 04:09:17 2021] PATCH /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 142 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:17.426824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.438469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bcdb7-f278-49de-a769-e7d2103d355a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.444058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.445564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.445860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.446135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.447776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.449584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.456600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2227/4450] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:17 2021] GET /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 142 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:17.460924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.462489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.463447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.482640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029fcb-7491-46ef-82fc-de9dbadd53a5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.487233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2224/4451] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:09:17.492052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.493021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.493378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.493722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.494470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.496428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.511301 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2228/4452] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:17 2021] DELETE /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:17.515601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.528825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcce9a-7db3-408b-a8f8-6d0818cb5575 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.533478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.534405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.534756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.535167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.536439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.538124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.553579 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find any options in domain configuration for domain 03033ed9075f40728ab4faa0860e3554.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 03033ed9075f40728ab4faa0860e3554. Nov 10 04:09:17.555670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2225/4453] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:17 2021] GET /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 151 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:17.559632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.571217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba11f-5b98-49d5-937e-5c86a820622d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.578132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.579325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.579666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.580006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.580775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.582464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.593020 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2229/4454] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:17 2021] DELETE /identity/v3/domains/03033ed9075f40728ab4faa0860e3554/config => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:17.594410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.606395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec558-2e1e-4b26-af6e-8bcbffd3ee9a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.613016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.614251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.614251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.614548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.616717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.619890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.646710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.647648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.676092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.676883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.682987 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2226/4455] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:17 2021] PATCH /identity/v3/domains/03033ed9075f40728ab4faa0860e3554 => generated 277 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:17.685369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.686386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:17.701212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d565a4-50f6-45d3-8ff7-2c5d98fd5b01 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:17.762412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:17.763276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:17.763943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:17.763943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:17.776645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03033ed9075f40728ab4faa0860e3554)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:17.778536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:17.802070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.805537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03033ed9075f40728ab4faa0860e3554'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.895863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.902803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.912557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.932473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] The token cache is being invalidate because project 03033ed9075f40728ab4faa0860e3554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:17.932791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.933444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.947416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.951614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.952397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5106e0e-f367-41e2-a630-d1658de19fb4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03033ed9075f40728ab4faa0860e3554', 'request_id': 'req-c5106e0e-f367-41e2-a630-d1658de19fb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:17.959397 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2230/4456] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:17 2021] DELETE /identity/v3/domains/03033ed9075f40728ab4faa0860e3554 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:17.964528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:17.975139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dff7ab-b1ee-42d6-9c27-9d3200842c8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.023374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e126-8168-4aaf-a63e-6ab2c6cc01d6 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.023673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e126-8168-4aaf-a63e-6ab2c6cc01d6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.023951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e126-8168-4aaf-a63e-6ab2c6cc01d6 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.026104 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2231/4457] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:09:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:09:18.041109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.041478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.041757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.080058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.080881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.081267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.081649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.082518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.084871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.107422 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2227/4458] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:17 2021] POST /identity/v3/domains => generated 276 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:18.107422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.110450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.130648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:18.131898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.248511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d069515-a7eb-4987-9375-3b95aaef26c0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.253375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.254436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.256063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.256063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] PATH_INFO: `/v3/projects/a4ba1ac504404cd394e7043b3a15314f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.256360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ba1ac504404cd394e7043b3a15314f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.259005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.329585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ba1ac504404cd394e7043b3a15314f', 'request_id': 'req-22944510-fbc9-4390-a004-49d5771b951d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:18.338670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ba1ac504404cd394e7043b3a15314f', 'request_id': 'req-22944510-fbc9-4390-a004-49d5771b951d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:18.350513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ba1ac504404cd394e7043b3a15314f', 'request_id': 'req-22944510-fbc9-4390-a004-49d5771b951d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:18.370517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] The token cache is being invalidate because project a4ba1ac504404cd394e7043b3a15314f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:18.370823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:18.371656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22944510-fbc9-4390-a004-49d5771b951d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:18.375664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2232/4459] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:18.376544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.378568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2228/4460] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:18 2021] DELETE /identity/v3/projects/a4ba1ac504404cd394e7043b3a15314f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:18.385396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.386281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.387889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.389835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.431742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:18.433066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.504563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d6c2-bccd-40dc-889c-7c2c4eb11b6b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.537625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2229/4461] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:18.538712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.543415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.617999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.619143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.619517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.620326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.621726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.623655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d9cc1-a7d8-43ac-aeb3-0cf2d3ac7f98 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.651493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847031e2-7ed1-4a9a-a051-f5a45e7b4a96 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.657535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.658309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.658677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.658984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.669160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.677909 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2233/4462] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:09:18 2021] PUT /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config => generated 138 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:18.680189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.682177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.682318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.691320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.693624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.713922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2230/4463] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:18.715320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:18.716538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.728163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.728364 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2234/4464] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:18.733115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.733934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.751206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183eb7f-e22f-4458-b88c-8fe225610536 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.768679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.769355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.769632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.769899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.770634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:18.771036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.772830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7518-f152-41ac-97a9-19b6b756b878 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.800815 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2235/4465] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:18.803922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.806832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.807292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.808397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d6a8-affb-4866-b5d8-740da4e3772f service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.826064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.827159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.827575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.827873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.829017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.830675 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:18.830675 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:09:18.830675 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:09:18.831003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.845113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:18.846727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:18.884556 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2231/4466] 10.222.0.13 () {60 vars in 1296 bytes} [Wed Nov 10 04:09:18 2021] PATCH /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity => generated 176 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:18.886036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.900008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39767a-a1b6-4343-9b87-5691017c6d06 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.905415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.906170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.906516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.906961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.907848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.909725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.919616 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2236/4467] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:18.920516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.938215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a520e37-5060-47bd-940b-29c76e86d880 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:18.949054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:18.950203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:18.950487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:18.950764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:18.951530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity, option=driver)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:18.955861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:18.956112 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2232/4468] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:18.957149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:18.988299 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2237/4469] 10.222.0.13 () {60 vars in 1317 bytes} [Wed Nov 10 04:09:18 2021] PATCH /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver => generated 176 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:18.992726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.007813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e533c-b659-4289-a77e-c08a1c9570a3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.062755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6514d-0070-4a60-8fa0-fc14dfea40fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.067762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.068437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.068748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.069026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.070633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.073269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.085911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.087596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.087596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.087596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.088019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity, option=driver)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.089906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.106266 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2233/4470] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:18 2021] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:19.113294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.126845 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2238/4471] 10.222.0.13 () {58 vars in 1298 bytes} [Wed Nov 10 04:09:18 2021] DELETE /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:19.128052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.130892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2108-68e1-495c-8eb4-e3b9064243aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.141337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.142021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.142306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.142591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.143625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.145272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.150749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b370f-36e4-4b30-bba2-c18460a581f3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.157685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.159085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.159375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.159649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.161028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity, option=driver)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.162683 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2234/4472] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:19.162823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.167270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.180863 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find option driver in group identity in domain configuration for domain e8a5b01cb1e34a74bde403e685482edb.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e8a5b01cb1e34a74bde403e685482edb. Nov 10 04:09:19.182387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2239/4473] 10.222.0.13 () {58 vars in 1295 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity/driver => generated 171 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:19.186692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.190893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b05a0-59fd-4ca0-b124-ad7564a720fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.199453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f5f8-46de-480b-acc6-6dddea803168 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.204177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.205151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.205287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.205844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.206029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.206306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.206579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.207074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.207260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.208439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.210741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.214814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.229955 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2235/4474] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:19.234410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.248325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2240/4475] 10.222.0.13 () {58 vars in 1277 bytes} [Wed Nov 10 04:09:19 2021] DELETE /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:19.253037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.254175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab293f-01ad-4167-b45a-cd739c053bfa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.259802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.261153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.261579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.262004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] PATH_INFO: `/v3/projects/f25c728ad07c4dc2bb923467e99a31c3/users/46f9a30a693c4239aa8bbbf94f68df66/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.271520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3b9f-625f-4b85-8780-9856e318ac28 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.280407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25c728ad07c4dc2bb923467e99a31c3, user_id=46f9a30a693c4239aa8bbbf94f68df66, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.281269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.282707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.283035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5c02c-8c1c-4449-8d69-51f1f3d46167 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.283434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.284596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.287231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb, group=identity)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.291287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.301481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2236/4476] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:19 2021] PUT /identity/v3/projects/f25c728ad07c4dc2bb923467e99a31c3/users/46f9a30a693c4239aa8bbbf94f68df66/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:19.302861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.303141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.303460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.312312 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find group identity in domain configuration for domain e8a5b01cb1e34a74bde403e685482edb.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e8a5b01cb1e34a74bde403e685482edb. Nov 10 04:09:19.315168 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2241/4477] 10.222.0.13 () {58 vars in 1274 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config/identity => generated 154 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:09:19.318836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.331487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c361d7-9c77-4ed0-a0c7-53c2a1fedab5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.340860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:19.342522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:19.401826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.402631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.402913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.403193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.403857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e8a5b01cb1e34a74bde403e685482edb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.405622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.421580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2242/4478] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:19 2021] DELETE /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb/config => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:19.422876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.427685 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2237/4479] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:19.442452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a16348-9d8d-4645-bf06-0b09b3b2012f tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.455110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.456561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.457167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.457644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.458232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.458773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:19.459972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e8a5b01cb1e34a74bde403e685482edb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.462207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.513235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.514462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.559167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.560169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.566013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2243/4480] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:19 2021] PATCH /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb => generated 277 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:19.567408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.570234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:19.582422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ea31-d342-461e-a245-f964c013603b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.708905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096565-b7c6-47ab-9e5e-16da6e743685 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:19.715831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.716750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.717032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.717455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.730548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e8a5b01cb1e34a74bde403e685482edb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.733045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.768342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.778441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.778653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:19.779322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:19.779601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:19.779874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:19.792555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:19.843249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.848968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.857192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.875428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] The token cache is being invalidate because project e8a5b01cb1e34a74bde403e685482edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:19.875842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.876741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.886501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.893053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.894993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e8a5b01cb1e34a74bde403e685482edb', 'request_id': 'req-d4473425-0750-4246-836e-b396756284c2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:19.904035 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2244/4481] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:19 2021] DELETE /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:19.911858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:19.914689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:19.923145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:19.924796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:19.946877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2238/4482] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:20.031595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473425-0750-4246-836e-b396756284c2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.045983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.047012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.047715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.048168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.048975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.050463 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config_default failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:20.050463 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:20.050463 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:20.051373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.060585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2245/4483] 10.222.0.13 () {58 vars in 1172 bytes} [Wed Nov 10 04:09:19 2021] GET /identity/v3/domains/config/default => generated 1527 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:20.062082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.081746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7ed6-806b-4640-9b79-10002dd17b04 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.097755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.098541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.098818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.099087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.100264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.102540 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config_default failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:20.102540 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:09:20.102540 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:09:20.104041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.110062 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2239/4484] 10.222.0.13 () {58 vars in 1199 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:20.110884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.126389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c848ef-4b97-44d5-aa6b-4133b055c00c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.145566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.146709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.147616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.148305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.149435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.151698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.153238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2246/4485] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.158128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.176518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101c301-c402-4049-bda4-cb1a1780c9ac tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.183156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.184631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.185125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.185408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.186345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.188432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.189843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2240/4486] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.194262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.210889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf1854-dab5-4fdd-b2c8-ef311e989b8c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.219314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.220739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.221073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.222151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.224564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.225365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.246635 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2247/4487] 10.222.0.13 () {58 vars in 1187 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:20.251229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.269276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43b03-bfe8-4be2-8a44-c1a072321fa2 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.276435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.277151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.277428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.277700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.278490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.283025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.285720 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2241/4488] 10.222.0.13 () {58 vars in 1199 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.291732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.306961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55275-f773-4c21-8456-79c5b4b77f46 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.315056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.316248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.316665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.317031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.318129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.321537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.325281 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2248/4489] 10.222.0.13 () {58 vars in 1202 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.329588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.349573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac94681-1ed1-4b84-be72-0c124f4e52d4 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.361518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.361925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.362250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.362727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.363489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.365434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.369410 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2242/4490] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.371745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.388094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f862f2-9106-4892-bfa8-452a97ef854d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.401707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.402317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.402595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.402869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.404064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.405616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.417156 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2249/4491] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.419002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.435337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83c0c-dbd3-4689-88ba-8d0b8a31850e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.442190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.444296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.460666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.462084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.464883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.469980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.475619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.477087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2243/4492] 10.222.0.13 () {58 vars in 1217 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.489384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f0b2-9ab4-4f3d-bb12-43aa26dda08a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.507321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.508365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.508695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.508969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.509635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.517515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.520030 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2250/4493] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.524641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.536996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ec2-d044-4522-be33-71dc70f31b82 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.547935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.548893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.549277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.549661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.550574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.553063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.559153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2244/4494] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.559710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.587331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185409-004b-4842-80df-1a4108945bd6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.603988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.604823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.605104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.605380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.606057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.607857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.609067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2251/4495] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:20.614260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.635161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c4cc5-5efc-49d9-a769-e82e8aa5a102 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.646072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.647653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.648834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.649984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.652105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.654282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.659097 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2245/4496] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.664164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.674746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb37f-a5e6-444a-9af1-692ad430cd48 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.684523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.685379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.685668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.686740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.686740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.688202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.693256 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2252/4497] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.695119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.708077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7405-090a-4d75-b5e3-85a000916b55 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.714905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.715946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.716241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.716524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.717862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.719607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.724852 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2246/4498] 10.222.0.13 () {58 vars in 1238 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.725603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.738869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c40d9-2c9c-4ac7-80d8-9018e4830eef tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.747464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.749779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.750268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.751059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.752787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.759128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.764422 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2253/4499] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:20.768474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.783323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ccfa-0ead-4056-8d6f-ed87ea258bf1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.793634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.794490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.794798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.795900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.798161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.800955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.807329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.821130 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2247/4500] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.841257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc5cd-a325-431e-a0cd-2836b986a822 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.854987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.855803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.856379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.856914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.858369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.860134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.865799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.876335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2254/4501] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.881789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b282-c753-497a-880a-493de871d818 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.889199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.890662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.891021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.891376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.892198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.894800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.901076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.915220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2248/4502] 10.222.0.13 () {58 vars in 1268 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.916056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bfa0f-e9b5-44c9-9a8d-97f7e37984da tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.921713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.922639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.923035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.923385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.924139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.926040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.932772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.943404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2255/4503] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.948216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091afb-d4f3-49cc-9a73-53c48bd5811c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.955354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.956378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.956800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.957151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.957915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.960693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.969261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:20.986331 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2249/4504] 10.222.0.13 () {58 vars in 1256 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:20.986659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5ab94-8c6f-4afa-9e1f-8737ded36482 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:20.993072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:20.994148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:20.994542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:20.994889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:20.995640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:20.997506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:20.999045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2256/4505] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:09:20 2021] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.003512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.014536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e6362-ba20-4dd8-9854-ab186357b71a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.021316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.022034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.022452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.023601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.024645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.026464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.031593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2250/4506] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.032438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.046351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e395-2ecc-4771-9ca0-fded167b51c9 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.054773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.056431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.056924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.057265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.058032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.060319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.066863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.080655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2257/4507] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:21.088826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcb84-0135-47e4-a435-bf2a27a14b6e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.095503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.098058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.098421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.098780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.099594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.102579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.104642 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2251/4508] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.109626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.129527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc882d1-324c-417e-8ae2-fcab2093ea9e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.148756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.150205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.150490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.150765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.151441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.153099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.154208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2258/4509] 10.222.0.13 () {58 vars in 1289 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.160924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.184434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e713-0564-4d22-9d11-c8fe4e5a3500 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.196572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.198024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.199042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.200184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.202152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.206723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae552c-9055-4f8d-8a91-44b0f91789bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.216640 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2252/4510] 10.222.0.13 () {58 vars in 1256 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.216792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.234783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898449c1-d25d-4ea3-83af-09eb339a811e tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.244011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.244889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.249040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.249359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.250939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.259922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.260859 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2259/4511] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.263791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.265789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.274075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.274429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.286359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924372-cf8c-4ded-b93a-2a1eda07b03b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.301152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.302631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.303082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.303361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.307470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.309118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.312522 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2260/4512] 10.222.0.13 () {58 vars in 1307 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.314270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.341463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2964-e9d9-42c0-959d-0787648cc5d5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.353700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] MFA Rules not processed for user `46f9a30a693c4239aa8bbbf94f68df66`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:21.356979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:21.358414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.359242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.359516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.359787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.360488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.363976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.366815 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2261/4513] 10.222.0.13 () {58 vars in 1289 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.372049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.398723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8309ed0-fc4c-4e9b-b67d-a84b44e72f37 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.413721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.414503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.414816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.415131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.416092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.417716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.421951 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2262/4514] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.423263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.447482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19806-754a-47be-8fbd-adc0de75e608 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.462301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.463100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.463378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.463652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.464325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.466478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.471143 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2263/4515] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.472026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.493871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710fd-461e-4414-b6d7-a463d9c59708 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.506734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.508085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.508367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.508665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.509426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.512357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.519665 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2264/4516] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.519665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.525129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:21.540682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2253/4517] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:21 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:21.541974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.557122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208082ef-8b0a-402c-ae56-fe4d02400554 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.562326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.563274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.563561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.563836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.565210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.567037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.568848 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2254/4518] 10.222.0.13 () {58 vars in 1244 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.570308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.574246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:21.644702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764fda7-7476-4e06-b60d-c0d0ce73a4c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.651777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.655314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.655314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.655314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] PATH_INFO: `/v3/users/de14696cbebe4b6fa15502526d41d82c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.656371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de14696cbebe4b6fa15502526d41d82c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.659319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.683710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8fb1-6ffc-49af-b5e1-b7d26580ff7c tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.693215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.695336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.695667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.696333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.708888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.711328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.723756 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2255/4519] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:21.724725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.739768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368f99-20b1-4f35-8137-fea604aba527 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.742368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de14696cbebe4b6fa15502526d41d82c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:21.745664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.746824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.747185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.748288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.749064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.751192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.751578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de14696cbebe4b6fa15502526d41d82c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:21.752884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de14696cbebe4b6fa15502526d41d82c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:21.767495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2256/4520] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.768027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de14696cbebe4b6fa15502526d41d82c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:21.768785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.779299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de14696cbebe4b6fa15502526d41d82c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:21.794210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d942-5a74-48aa-b17d-f788a78c3660 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.795184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2265/4521] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:21 2021] DELETE /identity/v3/users/de14696cbebe4b6fa15502526d41d82c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:21.895763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.896574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.897029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.897309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.898020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.899659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.901047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2257/4522] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.906465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.908983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:21.930009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6a2a8-2602-4ba5-b7ef-9283bd0ebf80 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.935147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.935924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.936303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.936689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.937442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.939160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.940549 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2266/4523] 10.222.0.13 () {58 vars in 1256 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.945471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:21.956853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c3de-f968-4f3e-8b95-2c9f3d4d94ee tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:21.965130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:21.966393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:21.966953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:21.967767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:21.969344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:21.971250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:21.974111 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2258/4524] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:21.978935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.004244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe04c-78b5-46f7-b3c9-c6b81eb3a0fb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.008994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.009779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.010059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.010321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.011017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.012565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.013876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2267/4525] 10.222.0.13 () {58 vars in 1256 bytes} [Wed Nov 10 04:09:21 2021] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:22.017729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.028710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c93-0c7f-431e-ab73-627289debeb3 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.033700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.034509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.034789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.035063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.035739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.037499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.042660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2259/4526] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:22.043903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.054090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ace53-35f2-434a-8523-b8793c355662 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.058982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.059790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.060069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.060349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.061308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.062979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.064109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2268/4527] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.068292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.081672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d943d39-5a54-42e4-9266-740de4e136bb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.087967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.088807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.089088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.089365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.090038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.091871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.093269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2260/4528] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.097138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.110756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e9cc-8828-42ca-b82e-b56da06377c6 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.125002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.126247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.126432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.126829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.127568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.136652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.137995 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2269/4529] 10.222.0.13 () {58 vars in 1211 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:22.142045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.156517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7c3c-ed48-42ff-a274-3f53caa09e9b tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.161552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.162323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.162662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.162938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.163644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.165317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.169512 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2261/4530] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.170833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.183565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5876-4b83-47b2-a831-e5c08dbbceb1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.189390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.190181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.190448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.190858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.191406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.193187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.195398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2270/4531] 10.222.0.13 () {58 vars in 1214 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.199175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.215303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f96764-f1c3-4572-a1b2-de59f869ad57 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.220521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.221337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.221609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.221887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.222582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.224862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.228766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2262/4532] 10.222.0.13 () {58 vars in 1217 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.230631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.242156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deb7c1-c106-4fba-bd7f-04c6cac778fd tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.249628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.249865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.250269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.250612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.250901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.251638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.252351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:22.253432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.256666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2271/4533] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:22.259422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.269648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaee7-88a5-4322-81e1-2a4e0e4ec5f1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.275844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.276673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.276958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.277233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.278354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.279751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.280884 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2272/4534] 10.222.0.13 () {58 vars in 1238 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.284644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.295943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ac0a4-3dad-4eb8-893f-ef388db715c7 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.300843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.301626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.302010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.302466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.303260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.305359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.308962 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2273/4535] 10.222.0.13 () {58 vars in 1259 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.326465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.337163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c61e17-dbf2-44f1-8388-87c9d9194f85 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.342854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ed7c-596f-4f2c-9bd2-c1113bd73de5 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.343456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.344532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.345005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.345462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] PATH_INFO: `/v3/projects/c3aa5eb57eed4a08886f209520775cc9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.347566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3aa5eb57eed4a08886f209520775cc9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.349371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.350204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.352201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.352201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.352201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.352827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.354878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.355764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2274/4536] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:09:22.359498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.370638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4a32b-3b56-4eb4-b3d2-ea29fe84b1c1 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.377466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.378323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.378585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.378870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.379605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.381256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.383297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2275/4537] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.386920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.398305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0920-41de-4bef-9ec5-fe0769c2fa22 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.404272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.405105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.405389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.405685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.406385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.407960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.409130 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2276/4538] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.412959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.420800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3aa5eb57eed4a08886f209520775cc9', 'request_id': 'req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.428371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840093c-abb2-48bd-8cef-0078b77cd05d tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.428654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3aa5eb57eed4a08886f209520775cc9', 'request_id': 'req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.436471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3aa5eb57eed4a08886f209520775cc9', 'request_id': 'req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.452499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] The token cache is being invalidate because project c3aa5eb57eed4a08886f209520775cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:22.453174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.454146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fc9f3647-ccaf-4ebe-8557-40453c0b30f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.456219 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2263/4539] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:22 2021] DELETE /identity/v3/projects/c3aa5eb57eed4a08886f209520775cc9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:22.463613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ef9c-3005-436e-840b-7eecc81d4a89 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.464103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ef9c-3005-436e-840b-7eecc81d4a89 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.464544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ef9c-3005-436e-840b-7eecc81d4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.502527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.503267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.503547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.503877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.504559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.506489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.508928 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2277/4540] 10.222.0.13 () {58 vars in 1277 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 10 04:09:22.512645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-29f6ef9c-3005-436e-840b-7eecc81d4a89 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:22.514396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-29f6ef9c-3005-436e-840b-7eecc81d4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:22.516488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.518619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:22.533839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0a-2b49-4fe5-ae34-c2a3ec42664a tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.539844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.540821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.541142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.541482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/e8a5b01cb1e34a74bde403e685482edb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.552622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:09:22.564334 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find domain: e8a5b01cb1e34a74bde403e685482edb.: keystone.exception.DomainNotFound: Could not find domain: e8a5b01cb1e34a74bde403e685482edb. Nov 10 04:09:22.566172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2278/4541] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:22 2021] PATCH /identity/v3/domains/e8a5b01cb1e34a74bde403e685482edb => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:22.571326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.599121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee84a9-30e4-4019-bd11-184dfa62adfb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.608727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.609748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.610032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.610305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/03033ed9075f40728ab4faa0860e3554` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.636961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:09:22.648711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2264/4542] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:22.656250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.656847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.657319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.660933 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find domain: 03033ed9075f40728ab4faa0860e3554.: keystone.exception.DomainNotFound: Could not find domain: 03033ed9075f40728ab4faa0860e3554. Nov 10 04:09:22.668576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2279/4543] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:22 2021] PATCH /identity/v3/domains/03033ed9075f40728ab4faa0860e3554 => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:22.670759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.690198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e8ecc-5aea-444f-96dd-05ad08e5bbdb tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.695554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:22.695989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41e993edbab4ebdad51553043d8dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6d3311705fe444fb278f5cffad8ed71', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.696896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:22.697014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.697279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.697692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] PATH_INFO: `/v3/domains/822862c8298444a59e78bca326c3e544` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.707138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:09:22.708219 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2265/4544] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:22.712097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.717670 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Could not find domain: 822862c8298444a59e78bca326c3e544.: keystone.exception.DomainNotFound: Could not find domain: 822862c8298444a59e78bca326c3e544. Nov 10 04:09:22.719449 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2280/4545] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:22 2021] PATCH /identity/v3/domains/822862c8298444a59e78bca326c3e544 => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:22.723116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.727815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ee8bb-382c-41b4-8ae0-0bade943a7b1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.728837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:22.740105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.742410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.742696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.742968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.745463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:22.747013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.749584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.750803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5993c-4d25-488e-b99f-00c9c66b56b0 tempest-DomainConfigurationTestJSON-1888134172 tempest-DomainConfigurationTestJSON-1888134172-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.758161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.759341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.759857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.760330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] PATH_INFO: `/v3/users/c377329baa4c4be5a98ee2fa5341ec89` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.762366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c377329baa4c4be5a98ee2fa5341ec89)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.766583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.771402 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2266/4546] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:22.773250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.784692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031431-4870-44f8-a614-b4bf482cfb25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.790366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:22.791077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.791359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.792103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.792480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:22.794613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:22.839802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2267/4547] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:22 2021] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:22.845361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:22.856372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c377329baa4c4be5a98ee2fa5341ec89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.865359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c377329baa4c4be5a98ee2fa5341ec89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.866094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c377329baa4c4be5a98ee2fa5341ec89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.883401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c377329baa4c4be5a98ee2fa5341ec89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.896054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b8fb508-2b27-45a2-885e-22a9ea80d71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c377329baa4c4be5a98ee2fa5341ec89'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:22.905692 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2281/4548] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:22 2021] DELETE /identity/v3/users/c377329baa4c4be5a98ee2fa5341ec89 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:22.909798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:22.910377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:22.910377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:22.940553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707b8d-ad49-4517-bfec-015a4335ede5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:22.949202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:22.951159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:23.026917 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2282/4549] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:23.039088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.040726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:23.042025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.043070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.043560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.043934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.044784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.047027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.085024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2268/4550] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:22 2021] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:23.088402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.090994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:23.113370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67254aad-c9c7-442d-9626-5e2a15eb407c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.118310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.118988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.119274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.119595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.120297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.121955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.142700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae48322-f26c-46ad-8e51-947f96123d54 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.148400 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2269/4551] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:23 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:23.149407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.150077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.150324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.150459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.150621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.169630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc693c-0b09-4b0f-99e7-6088290da287 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.173196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.174709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.182988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.184306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.185183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.186029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.195775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.197489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823eee9-4c29-4b12-aa6f-5a0333966e02 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.207801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2283/4552] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:23.214774 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2270/4553] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:23 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:23.216481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.231216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebd6ce-9094-4a9c-a029-608dfdc58caa service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.237654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.238554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.238836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.239110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] PATH_INFO: `/v3/projects/c85b5e83c6fc491b9880ca7481937aee/users/0f5c8838662b4cfcafe4ddb79e088046/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.260885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85b5e83c6fc491b9880ca7481937aee, user_id=0f5c8838662b4cfcafe4ddb79e088046, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.265309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.282381 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2284/4554] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:23 2021] PUT /identity/v3/projects/c85b5e83c6fc491b9880ca7481937aee/users/0f5c8838662b4cfcafe4ddb79e088046/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:23.288097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea056bc-594f-435e-9419-29582b378721 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.288680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea056bc-594f-435e-9419-29582b378721 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.288968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea056bc-594f-435e-9419-29582b378721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.313353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cea056bc-594f-435e-9419-29582b378721 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:23.314597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cea056bc-594f-435e-9419-29582b378721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:23.400090 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2271/4555] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:23.419036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.513356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae351-6842-4499-8276-f3b0a1a04838 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.525665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.526646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.526920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.527449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.546845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.549232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.564109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2285/4556] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:23.685051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea056bc-594f-435e-9419-29582b378721 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.687793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cea056bc-594f-435e-9419-29582b378721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:23.719918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea056bc-594f-435e-9419-29582b378721 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.729316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.730710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.731086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.731338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] PATH_INFO: `/v3/projects/388f0d276c1f49a2a0c7562092f336ff` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.732969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388f0d276c1f49a2a0c7562092f336ff)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.736350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:23.806943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388f0d276c1f49a2a0c7562092f336ff', 'request_id': 'req-90f79ac2-c5ba-4853-a497-81ea8b437b88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:23.853423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388f0d276c1f49a2a0c7562092f336ff', 'request_id': 'req-90f79ac2-c5ba-4853-a497-81ea8b437b88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:23.862288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388f0d276c1f49a2a0c7562092f336ff', 'request_id': 'req-90f79ac2-c5ba-4853-a497-81ea8b437b88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:23.883261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] The token cache is being invalidate because project 388f0d276c1f49a2a0c7562092f336ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:23.883553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:23.884946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:23.887765 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2272/4557] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:23 2021] DELETE /identity/v3/projects/388f0d276c1f49a2a0c7562092f336ff => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:23.892477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:23.903954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359ad08-4a47-49b6-bcd2-36e1304674cb service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:23.977892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:23.979046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:23.979327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:23.979599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] PATH_INFO: `/v3/users/d41e993edbab4ebdad51553043d8dbef` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:23.980865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41e993edbab4ebdad51553043d8dbef)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:23.982826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:24.041278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41e993edbab4ebdad51553043d8dbef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.050135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41e993edbab4ebdad51553043d8dbef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.051112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41e993edbab4ebdad51553043d8dbef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.071281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41e993edbab4ebdad51553043d8dbef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.094973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1924aed-707a-40d9-a4d7-e112b5f79f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41e993edbab4ebdad51553043d8dbef'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.103719 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2286/4558] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:23 2021] DELETE /identity/v3/users/d41e993edbab4ebdad51553043d8dbef => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:24.480907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:24.482673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:24.498780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79ac2-c5ba-4853-a497-81ea8b437b88 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:24.588961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:24.590031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:24.590307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:24.590578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] PATH_INFO: `/v3/projects/f6d3311705fe444fb278f5cffad8ed71` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:24.591937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d3311705fe444fb278f5cffad8ed71)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:24.593985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:24.653393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d3311705fe444fb278f5cffad8ed71', 'request_id': 'req-ad36a97c-942b-4b58-a83b-6338bc376b53'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.660479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d3311705fe444fb278f5cffad8ed71', 'request_id': 'req-ad36a97c-942b-4b58-a83b-6338bc376b53'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.669102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d3311705fe444fb278f5cffad8ed71', 'request_id': 'req-ad36a97c-942b-4b58-a83b-6338bc376b53'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.689487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] The token cache is being invalidate because project f6d3311705fe444fb278f5cffad8ed71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:24.689916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.691557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ad36a97c-942b-4b58-a83b-6338bc376b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:24.693539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2273/4559] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:24 2021] DELETE /identity/v3/projects/f6d3311705fe444fb278f5cffad8ed71 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:24.700562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:24.700562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:24.700834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:24.721917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:24.723111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:24.792907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2287/4560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:24.800849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:24.801313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:24.801813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:24.853206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:24.858413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:24.881631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2274/4561] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:24.883604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:24.900026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc475e-b237-4ca9-93fd-f158e52485e2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:24.912892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:24.913884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:24.914312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:24.914733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:24.915619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:24.916081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:24.918266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:24.935682 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2288/4562] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:24.936530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:24.947067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510b073-b2da-4f83-bbdd-c9ed73246d75 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:24.954260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:24.955064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:24.955508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:24.955959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:24.956882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:24.959021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:24.999956 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2275/4563] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:24 2021] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:25.004126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.020517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa137dd-2d82-4c13-8c55-21cda81828c1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.085004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.085924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.086242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.086566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.087346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.089981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.110810 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2289/4564] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:25 2021] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:25.115340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.131273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd5a4-083c-42ff-999b-fff77df02a34 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.139103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.139962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.140247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.140522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.141348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.143306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.157920 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2276/4565] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:25 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:25.161923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.173492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793486-7e67-4ed7-84e1-bbfce74a3124 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.178363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.179610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.179889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.180371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.181337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.183061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa930cf0-0c32-424c-a361-b4a26b5ffd29 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.194990 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2290/4566] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:25 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:25.198850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.209700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cdfdd-2c34-463c-a81a-22489e0dbb4a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.219683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.220584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.220909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.221369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] PATH_INFO: `/v3/projects/b21bd9b6efde4c36b484cd295e6d0166/users/f0722c663f774258bc160beeecbc825d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.244856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21bd9b6efde4c36b484cd295e6d0166, user_id=f0722c663f774258bc160beeecbc825d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.247716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.264401 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2277/4567] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:25 2021] PUT /identity/v3/projects/b21bd9b6efde4c36b484cd295e6d0166/users/f0722c663f774258bc160beeecbc825d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:25.274840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.275127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.275402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.304958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] MFA Rules not processed for user `f0722c663f774258bc160beeecbc825d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:25.306438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:25.374888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2291/4568] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:25 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:25.379481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.457453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda8f70-47eb-4354-af84-3521dd19aab4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.463599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.464510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.466032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.466324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.467052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.468971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.503706 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2278/4569] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:25 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:25.504896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.516395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b28f-8ad9-41ab-ad95-bcab26a75162 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.583581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.584309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.584596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.585763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.586185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.588171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.613648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2292/4570] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:25 2021] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:25.615063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.626132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b825d2-79fb-4438-84fc-95004a097fac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.631645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.632299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.632634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.633483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.633929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.635579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.656133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.657118 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2279/4571] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:25.671768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b3a6-bbb3-4600-8c36-8a1d0580b4b9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.684314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.685334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.685549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.685979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] PATH_INFO: `/v3/projects/a1f4f6efd0124c4483ee567882410338/users/5156a2497bc54585bf3f574551fa1b36/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.704821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f4f6efd0124c4483ee567882410338, user_id=5156a2497bc54585bf3f574551fa1b36, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.707438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.728822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2293/4572] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:25 2021] PUT /identity/v3/projects/a1f4f6efd0124c4483ee567882410338/users/5156a2497bc54585bf3f574551fa1b36/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:25.732289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.743425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e23c-7fd1-4279-8e2c-bebe52ea39f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.826532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.827991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.828589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.829370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.830292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.832561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0056f5-a303-42f6-8694-936de176e886 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.892415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2280/4573] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:25 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:25.909241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:25.926163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db7bb-dd6c-4af7-a541-80492fe0b1c9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:25.937358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:25.938432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.938944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.939479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] PATH_INFO: `/v3/projects/a1f4f6efd0124c4483ee567882410338/users/5156a2497bc54585bf3f574551fa1b36/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:25.942710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f4f6efd0124c4483ee567882410338, user_id=5156a2497bc54585bf3f574551fa1b36, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:25.946728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:25.971910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2294/4574] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:25 2021] PUT /identity/v3/projects/a1f4f6efd0124c4483ee567882410338/users/5156a2497bc54585bf3f574551fa1b36/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:25.982312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:25.982593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:25.982863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.023979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] MFA Rules not processed for user `5156a2497bc54585bf3f574551fa1b36`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:26.025541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:26.126327 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2281/4575] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:25 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:26.131168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.144199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11f959-43ca-4d47-8c7e-8966a4bbe995 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.149692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.150562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.151655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.152100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.152899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.154818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.186231 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invalid input for field 'name': '' is too short Nov 10 04:09:26.186231 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'minLength' in schema['properties']['name']: Nov 10 04:09:26.186231 ncdv-817176-1 devstack@keystone.service[96285]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 10 04:09:26.186231 ncdv-817176-1 devstack@keystone.service[96285]: On instance['name']: Nov 10 04:09:26.186231 ncdv-817176-1 devstack@keystone.service[96285]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 10 04:09:26.189527 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2295/4576] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:26 2021] POST /identity/v3/domains => generated 283 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 10 04:09:26.193166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.203426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203d89-4af3-45a1-9bc4-847a2b8d751f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.209994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.211909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.212045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.212325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.213358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.215427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.222682 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 10 04:09:26.222682 ncdv-817176-1 devstack@keystone.service[96284]: Failed validating 'maxLength' in schema['properties']['name']: Nov 10 04:09:26.222682 ncdv-817176-1 devstack@keystone.service[96284]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 10 04:09:26.222682 ncdv-817176-1 devstack@keystone.service[96284]: On instance['name']: Nov 10 04:09:26.222682 ncdv-817176-1 devstack@keystone.service[96284]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 10 04:09:26.224555 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2282/4577] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:26 2021] POST /identity/v3/domains => generated 412 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 04:09:26.229868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.242006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e513855-f315-4c69-aada-d4d1461ad2cc tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.247317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.248134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.248451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.248909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.250165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.252090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.281356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2296/4578] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:26 2021] POST /identity/v3/domains => generated 276 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:26.285558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.295643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1e6eb-eb55-4d07-b5a1-c93435acca93 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.352065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.352966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.353251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.353527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.364375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b4a3056a0ff043fda9d8480e6e2852e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.366014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.387080 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Nov 10 04:09:26.391265 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2283/4579] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:26 2021] DELETE /identity/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2 => generated 120 bytes in 104 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:26.392723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.404976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070628-cf32-4504-9969-c6ec0807c089 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.411310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.412425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.412822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.413190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.414579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b4a3056a0ff043fda9d8480e6e2852e2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.416170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.439001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.440082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.473366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.474915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.480821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2297/4580] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:26 2021] PATCH /identity/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2 => generated 277 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:26.483635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.486309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:26.525030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac492-d207-46a4-ab56-62450daa29ad tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.615430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.616703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.616925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.617201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.630625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b4a3056a0ff043fda9d8480e6e2852e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.633393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:26.661729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.673508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.731196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.738458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.749216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.766721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] The token cache is being invalidate because project b4a3056a0ff043fda9d8480e6e2852e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:26.767022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.767774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.779400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.784124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.785153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b4a3056a0ff043fda9d8480e6e2852e2', 'request_id': 'req-b94fbbd5-6543-46c4-b32f-bf4b646660aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:26.792340 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2284/4581] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:26 2021] DELETE /identity/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:26.798657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.831778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481637-9040-41f6-bd5d-e6f042a78578 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.921949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.923734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.924086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.924429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/a2cffff4ea1a4f208951d18cccc1d89e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.933898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:09:26.945204 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Could not find domain: a2cffff4ea1a4f208951d18cccc1d89e.: keystone.exception.DomainNotFound: Could not find domain: a2cffff4ea1a4f208951d18cccc1d89e. Nov 10 04:09:26.946976 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2298/4582] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:26 2021] DELETE /identity/v3/domains/a2cffff4ea1a4f208951d18cccc1d89e => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:26.952900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:26.954460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:26.974286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fbbd5-6543-46c4-b32f-bf4b646660aa tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:26.979376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:26.980813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:26.981093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:26.981373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:26.982116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:26.983692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:27.017298 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2285/4583] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:26 2021] POST /identity/v3/domains => generated 252 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:27.018420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:27.032589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c98ab-a456-44d5-816e-e881f4f467ec tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:27.149675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:27.151044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:27.151480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:27.151904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:27.154567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:27.158290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:27.180470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.sql.core [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-148520830' for key 'project.ixu_project_name_domain_id'") Nov 10 04:09:27.180470 ncdv-817176-1 devstack@keystone.service[96285]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 10 04:09:27.180470 ncdv-817176-1 devstack@keystone.service[96285]: [parameters: {'id': 'cd22b6f269a94a39b268981a73c408b5', 'name': 'tempest-domain-dup-148520830', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 10 04:09:27.180470 ncdv-817176-1 devstack@keystone.service[96285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 04:09:27.186912 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-148520830.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-148520830. Nov 10 04:09:27.191238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2299/4584] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:27 2021] POST /identity/v3/domains => generated 211 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 04:09:27.192543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:27.210357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966cf8d-3e66-4208-86f9-72cb22717450 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:27.215978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:27.217136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:27.217488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:27.217832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/0e07d1c72fe94d7f9888f74ecbdf687e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:27.247216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e07d1c72fe94d7f9888f74ecbdf687e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:27.248863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:27.307724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.310103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.368014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.369232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.372523 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2286/4585] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:27 2021] PATCH /identity/v3/domains/0e07d1c72fe94d7f9888f74ecbdf687e => generated 253 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:27.376903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:27.379299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:27.398280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace80a-1b48-4d8a-b3de-35ef660659cb tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:27.543728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:27.544755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:27.545046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:27.545325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/0e07d1c72fe94d7f9888f74ecbdf687e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:27.562231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e07d1c72fe94d7f9888f74ecbdf687e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:27.565237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:27.592576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.596165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.661626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.671218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.682406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.707525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] The token cache is being invalidate because project 0e07d1c72fe94d7f9888f74ecbdf687e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:27.707908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.709109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.722518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.727221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.728357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e07d1c72fe94d7f9888f74ecbdf687e', 'request_id': 'req-55f7254f-e76f-4e3b-84a0-cee0b41c769c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:27.759585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2300/4586] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:27 2021] DELETE /identity/v3/domains/0e07d1c72fe94d7f9888f74ecbdf687e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:27.765011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:27.778347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4397-4a5b-403c-979a-e35e8b8d9e66 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:27.892782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5156a2497bc54585bf3f574551fa1b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1f4f6efd0124c4483ee567882410338', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:27.894903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:27.894903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:27.894903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] PATH_INFO: `/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:27.902722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:09:27.911923 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-75b7bf4b-13f7-4bd0-ab36-20fe2da35582 tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Could not find domain: b4a3056a0ff043fda9d8480e6e2852e2.: keystone.exception.DomainNotFound: Could not find domain: b4a3056a0ff043fda9d8480e6e2852e2. Nov 10 04:09:27.913538 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2287/4587] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:27 2021] PATCH /identity/v3/domains/b4a3056a0ff043fda9d8480e6e2852e2 => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:27.917386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:27.919023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:28.001228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7254f-e76f-4e3b-84a0-cee0b41c769c tempest-DomainsNegativeTestJSON-2039277922 tempest-DomainsNegativeTestJSON-2039277922-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:28.007984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:28.009279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:28.009717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:28.010145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] PATH_INFO: `/v3/users/f0722c663f774258bc160beeecbc825d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:28.011765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0722c663f774258bc160beeecbc825d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:28.013865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:28.085649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0722c663f774258bc160beeecbc825d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.094622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0722c663f774258bc160beeecbc825d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.095377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0722c663f774258bc160beeecbc825d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.109829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0722c663f774258bc160beeecbc825d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.121455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0722c663f774258bc160beeecbc825d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.130809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2301/4588] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:27 2021] DELETE /identity/v3/users/f0722c663f774258bc160beeecbc825d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:28.136083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:28.136665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:28.136791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:28.156008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:28.157349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:28.233945 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2288/4589] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:28.243796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:28.245933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:28.323862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91904-d93d-46f0-ba08-55cfb957e6ae admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:28.332482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:28.333173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:28.333464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:28.333721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:28.344230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:28.345486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:28.356642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2302/4590] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:28.805960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:28.807385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:28.837123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64b59c-409d-4fec-baf7-504fac8f5c85 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:28.845206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:28.846262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:28.846680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:28.847114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] PATH_INFO: `/v3/projects/b21bd9b6efde4c36b484cd295e6d0166` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:28.849274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21bd9b6efde4c36b484cd295e6d0166)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:28.852050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:28.924049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21bd9b6efde4c36b484cd295e6d0166', 'request_id': 'req-73ce59a0-7b91-421f-85a1-f1c59388ab39'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.942890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21bd9b6efde4c36b484cd295e6d0166', 'request_id': 'req-73ce59a0-7b91-421f-85a1-f1c59388ab39'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.951784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21bd9b6efde4c36b484cd295e6d0166', 'request_id': 'req-73ce59a0-7b91-421f-85a1-f1c59388ab39'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.975013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] The token cache is being invalidate because project b21bd9b6efde4c36b484cd295e6d0166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:28.975359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.976292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:28.981372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2289/4591] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:28 2021] DELETE /identity/v3/projects/b21bd9b6efde4c36b484cd295e6d0166 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:28.982865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:28.994620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e13ae1-469d-4f79-bc42-b03569b2314b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:29.082736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:29.083769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:29.084297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:29.084853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] PATH_INFO: `/v3/users/5156a2497bc54585bf3f574551fa1b36` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:29.086897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5156a2497bc54585bf3f574551fa1b36)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:29.090459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:29.173907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5156a2497bc54585bf3f574551fa1b36'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:29.183535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5156a2497bc54585bf3f574551fa1b36'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:29.184676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5156a2497bc54585bf3f574551fa1b36'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:29.224179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5156a2497bc54585bf3f574551fa1b36'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:29.245135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0491eacd-ec77-4b73-9a79-745c8afe0afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5156a2497bc54585bf3f574551fa1b36'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:29.267055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2303/4592] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:28 2021] DELETE /identity/v3/users/5156a2497bc54585bf3f574551fa1b36 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:30.017726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.019877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:30.038805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce59a0-7b91-421f-85a1-f1c59388ab39 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.167289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.169637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.170022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.170395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] PATH_INFO: `/v3/projects/a1f4f6efd0124c4483ee567882410338` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.172329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f4f6efd0124c4483ee567882410338)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.190852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.285591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f4f6efd0124c4483ee567882410338', 'request_id': 'req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:30.293170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f4f6efd0124c4483ee567882410338', 'request_id': 'req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:30.300699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f4f6efd0124c4483ee567882410338', 'request_id': 'req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:30.323390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] The token cache is being invalidate because project a1f4f6efd0124c4483ee567882410338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:30.323697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:30.324465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c59687f1-2301-4c68-9fd7-b275fa3a2cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:30.326345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2290/4593] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:30 2021] DELETE /identity/v3/projects/a1f4f6efd0124c4483ee567882410338 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:30.332062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.332531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.332828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.367471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:30.373750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:30.467816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2304/4594] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:30.468384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.469512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.469804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.514916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:30.516139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:30.536725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2291/4595] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:30.541592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.559915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536420d-2c11-4e59-9800-c4fbde5553f0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.565793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.566614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.566996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.567390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.568491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:30.568914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.570633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.599980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2305/4596] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:30.605071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.623364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c476a-9afd-413c-aa9e-b3a276fe4dc5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.629554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.630412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.630699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.631831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.632908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.635228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.673152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2292/4597] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:30 2021] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:30.675006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.693210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104638-b81a-4b61-903f-28ca5b717eb9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.814859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.815920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.816285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.817544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.818851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.821406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.867727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2306/4598] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:30 2021] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:30.871612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.887840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bb-b8f4-4d0e-ae40-084a41ef24ce admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.894128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.895050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.895335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.895609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.896512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.898696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.910640 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2293/4599] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:30.915259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.928553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1518-cab7-41bf-abd1-ac3dcbf9ef50 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.934700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.935602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.935889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.936176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:30.937166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:30.939081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315ecc-933d-4a96-9d9c-a2a1bd414a9c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:30.955645 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2307/4600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:30.959180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:30.975343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d602-5b46-4a8f-b83c-12e443734f79 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:30.982184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:30.983233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:30.983651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:30.983995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] PATH_INFO: `/v3/projects/f8ba86336279471c97e96a0be0580d9f/users/9a3fb076247a4c0cb7a815017c1d0b97/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.002884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.003177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.003478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.014687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ba86336279471c97e96a0be0580d9f, user_id=9a3fb076247a4c0cb7a815017c1d0b97, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.017470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ae62f-6d49-45c1-a7a4-d46bfe73fd13 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.042189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] MFA Rules not processed for user `0f5c8838662b4cfcafe4ddb79e088046`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:31.043692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:31.053275 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2294/4601] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:30 2021] PUT /identity/v3/projects/f8ba86336279471c97e96a0be0580d9f/users/9a3fb076247a4c0cb7a815017c1d0b97/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:31.058215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.058620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.058993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.099146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] MFA Rules not processed for user `9a3fb076247a4c0cb7a815017c1d0b97`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:31.100548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:31.177533 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2308/4602] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:31 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:31.186586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2295/4603] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:31.191637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.258616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377b104-1611-4d35-9434-300cbb1d6eb7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.264183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.265175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.265620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.266639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.267523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.269576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.270256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.271583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:31.311391 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2309/4604] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:31 2021] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:31.315296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.413466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30a40-88b8-4419-ac95-e6aa16f3c9e0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.431932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38f7f-f64e-4da7-aa01-cdd1eddb0b6a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.440420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.441154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.441436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.441709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.442653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.450356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.490301 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2310/4605] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:31 2021] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:31.491189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.502555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.503579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.503715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.503945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.513007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91db92-1fb5-4631-be2a-8184c34e66b2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.519080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.519808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.520032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.520305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.521082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.523453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.537568 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2311/4606] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:31.538673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.550492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff7f8-f965-44aa-a883-c4bf99c57999 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.562763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.564315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.566541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.567372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] PATH_INFO: `/v3/projects/cfcd344a22cc414f82ebb954b325ec6a/users/32eb8f62678444b9a1022217dda2dd23/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.591297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcd344a22cc414f82ebb954b325ec6a, user_id=32eb8f62678444b9a1022217dda2dd23, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.594020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.606014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.608171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.614997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2312/4607] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:31 2021] PUT /identity/v3/projects/cfcd344a22cc414f82ebb954b325ec6a/users/32eb8f62678444b9a1022217dda2dd23/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:31.619808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.624913 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2296/4608] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:31 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:31.706766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0942-ada1-4172-af87-a6c66675158f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.721894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.722583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.722868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.723139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.723880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.725744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0944c-49f0-4109-8651-e8e421c3295d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.755521 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2313/4609] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:31.756793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:31.769870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d8612-6e58-43a7-8fd0-5564ee0227eb service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:31.784934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:31.786098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.786554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.787003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] PATH_INFO: `/v3/projects/cfcd344a22cc414f82ebb954b325ec6a/users/32eb8f62678444b9a1022217dda2dd23/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.790140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcd344a22cc414f82ebb954b325ec6a, user_id=32eb8f62678444b9a1022217dda2dd23, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:31.794052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:31.828640 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2297/4610] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:31 2021] PUT /identity/v3/projects/cfcd344a22cc414f82ebb954b325ec6a/users/32eb8f62678444b9a1022217dda2dd23/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:31.830732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:31.830849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:31.831035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:31.901673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] MFA Rules not processed for user `32eb8f62678444b9a1022217dda2dd23`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:31.902910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:32.007970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2314/4611] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:31 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:32.012629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.029705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f8160-a64b-4df1-9047-64131cfda3cd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.037807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.039490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.039899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.040280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.041376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.044041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.064583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2298/4612] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/services => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.068526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.086864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c3ac-56b3-465a-b33d-3fcfcac9c138 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.103930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.105016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.105249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.105580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.107284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.108311 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.108311 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.108311 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.109384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.128175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.130684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2315/4613] 10.222.0.13 () {60 vars in 1212 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.131283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:32.131605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.148743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835efc8-0e85-483f-8d3a-03a0b863084b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.154966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.155639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.155915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.156279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.157153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.158739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.187063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2316/4614] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/services => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.190720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.221640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2071f10-3e7f-4aa3-bd63-a3ad84ae0ca0 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.229874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc1d1-d66f-4f8d-a024-062a363978bc tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.239647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.240526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.242367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.242719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.242929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.243690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.244178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.244681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.245107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] PATH_INFO: `/v3/users/46f9a30a693c4239aa8bbbf94f68df66` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.246588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f9a30a693c4239aa8bbbf94f68df66)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.246758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.248951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.261090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2317/4615] 10.222.0.13 () {60 vars in 1212 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.264746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.278846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e02a6-42e2-4458-9853-de98355dc06c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.285776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.287000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.287250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.287697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.289902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.290627 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoint_groups failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.290627 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.290627 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.292588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.303760 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2318/4616] 10.222.0.13 () {58 vars in 1190 bytes} [Wed Nov 10 04:09:32 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:32.304757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.318429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae532af-f99b-45a0-a3c3-eef17ba88b96 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.327502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.329699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.330029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.330303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.331020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=bf1601137ef34c44b98e331ef492222d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.332066 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.332066 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.332066 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.333719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.340504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f9a30a693c4239aa8bbbf94f68df66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.340972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2319/4617] 10.222.0.13 () {58 vars in 1289 bytes} [Wed Nov 10 04:09:32 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d => generated 333 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:32.344918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.351592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f9a30a693c4239aa8bbbf94f68df66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.353821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f9a30a693c4239aa8bbbf94f68df66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.354861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f9a30a693c4239aa8bbbf94f68df66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.357662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1acaad-1068-4bd1-a05d-f342edb5ceb8 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.363682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.364600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.365063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.365388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.366549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=bf1601137ef34c44b98e331ef492222d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.367904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f9a30a693c4239aa8bbbf94f68df66'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.368581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.374962 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2320/4618] 10.222.0.13 () {58 vars in 1290 bytes} [Wed Nov 10 04:09:32 2021] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d => generated 0 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 10 04:09:32.378662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.381424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:32.396472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e005ee-afb5-4dc7-b6d6-a224d07b5319 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.403324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.404281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.405306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.405651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.406446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bf1601137ef34c44b98e331ef492222d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.407135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2299/4619] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/users/46f9a30a693c4239aa8bbbf94f68df66 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:32.407680 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.407680 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.407680 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.408601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.428689 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2321/4620] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:32.429844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.505306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58b73e-717d-43db-a5c8-cc4f4da12f16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.513091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.513821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.514174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.514522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.515427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.516448 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoint_groups failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.516448 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:09:32.516448 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:09:32.517496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.526025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2300/4621] 10.222.0.13 () {58 vars in 1190 bytes} [Wed Nov 10 04:09:32 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:32.529819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.544772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19998-5b38-4a42-8562-090deec96c5f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.556188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.557023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.557378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.557578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.567926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bf1601137ef34c44b98e331ef492222d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.570779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.592186 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Could not find Endpoint Group: bf1601137ef34c44b98e331ef492222d.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: bf1601137ef34c44b98e331ef492222d. Nov 10 04:09:32.593635 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2322/4622] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bf1601137ef34c44b98e331ef492222d => generated 120 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:09:32.597382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.610586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf583-7c50-4b68-9a09-016923849158 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.616552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.617604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.617966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.618336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services/4927438a54a24c4186cb7b3fc1f2f077` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.619063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4927438a54a24c4186cb7b3fc1f2f077)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.620477 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.620477 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:09:32.620477 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:09:32.621705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.656729 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2301/4623] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/services/4927438a54a24c4186cb7b3fc1f2f077 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:32.662072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.675028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75ca5-6844-4516-8cd5-46e5a95b885f tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.703176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.704026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.704374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.704747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.706019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.711578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.714328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.716589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:32.733511 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2323/4624] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/services => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.736764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.762958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fcfb6-621c-4613-9823-2e25c3d22ff7 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.769746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.770441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.770867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.771146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.771968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.774185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.786546 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2324/4625] 10.222.0.13 () {60 vars in 1212 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:32.790712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.803373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947dd77-b81d-4d14-a937-3ef5635f9c06 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.808641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.809809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.810216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.810592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.811590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.813342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.840805 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2325/4626] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:32 2021] POST /identity/v3/services => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:32.844205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.868966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d72f-f2bf-4245-bedf-f792f57718a9 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.875422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.876791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.877174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.877589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c48fdd7bea9448bbbc72750b7cc0379a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.878694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=c48fdd7bea9448bbbc72750b7cc0379a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.880352 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.880352 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.880352 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.885575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91012f-9036-4586-9cf2-5a5f0549605a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.886829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.902840 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2326/4627] 10.222.0.13 () {60 vars in 1312 bytes} [Wed Nov 10 04:09:32 2021] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/c48fdd7bea9448bbbc72750b7cc0379a => generated 335 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:32.907949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:32.912186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.913251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.913532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.913807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] PATH_INFO: `/v3/projects/f25c728ad07c4dc2bb923467e99a31c3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.915078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25c728ad07c4dc2bb923467e99a31c3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.917330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.929997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9b19-10b5-4be8-8314-0329f6fd1def tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:32.935151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:32.936265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:32.936734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:32.937389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services/1836bd10b092462bacee963e46e11006` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:32.938206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1836bd10b092462bacee963e46e11006)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:32.951802 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:09:32.951802 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:09:32.951802 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:09:32.954161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:32.996962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25c728ad07c4dc2bb923467e99a31c3', 'request_id': 'req-d094f8c4-2247-4da0-b725-657b7db9e922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:32.997914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2327/4628] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/services/1836bd10b092462bacee963e46e11006 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:33.002635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.013294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25c728ad07c4dc2bb923467e99a31c3', 'request_id': 'req-d094f8c4-2247-4da0-b725-657b7db9e922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.031263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25c728ad07c4dc2bb923467e99a31c3', 'request_id': 'req-d094f8c4-2247-4da0-b725-657b7db9e922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.033843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe285-a902-44e7-ad52-e8a92602ef9a tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.058481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] The token cache is being invalidate because project f25c728ad07c4dc2bb923467e99a31c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:33.060081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.061361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d094f8c4-2247-4da0-b725-657b7db9e922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.064832 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2302/4629] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:32 2021] DELETE /identity/v3/projects/f25c728ad07c4dc2bb923467e99a31c3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:33.077186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761156-59a0-4d85-81c8-3ffe535724c1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.078174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761156-59a0-4d85-81c8-3ffe535724c1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.078704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761156-59a0-4d85-81c8-3ffe535724c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.125586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8d761156-59a0-4d85-81c8-3ffe535724c1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:33.129342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8d761156-59a0-4d85-81c8-3ffe535724c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:33.158733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.159908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.160265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.160643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c48fdd7bea9448bbbc72750b7cc0379a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.162101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c48fdd7bea9448bbbc72750b7cc0379a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.165009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.182982 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2328/4630] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:09:33 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c48fdd7bea9448bbbc72750b7cc0379a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:33.186920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.192057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:33.212658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083621-5444-4170-8193-81cb7f90795e tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.232131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.233763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.234191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.234568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services/04397728817041099a6bc2750459b941` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.235412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_service(service_id=04397728817041099a6bc2750459b941)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.238536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.241659 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2303/4631] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/auth/tokens => generated 3495 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:33.243110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.243399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.243858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.279359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:33.281302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:33.295351 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2304/4632] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/auth/tokens => generated 3495 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:33.300325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.300715 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2329/4633] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:33 2021] DELETE /identity/v3/services/04397728817041099a6bc2750459b941 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:33.305358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.317104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b972c-7390-4c0f-99c3-53036142999a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.348149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602486c-dd64-4663-9eb9-9ffee854751c tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.359519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.363394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.364108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.364402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.367186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:33.367531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.368057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.375019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.376183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.376486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.376791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6648f4f4c0de408b9fe277dc4d013434` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.377593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6648f4f4c0de408b9fe277dc4d013434)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.379278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.404248 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2305/4634] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:33.408913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.417684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2330/4635] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:09:33 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6648f4f4c0de408b9fe277dc4d013434 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:33.418744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.438671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7645-6666-4a39-83ca-e3f873729a4c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.439295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e066-2f37-42cd-9954-e205408f1b30 tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.452942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.453166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb8f62678444b9a1022217dda2dd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcd344a22cc414f82ebb954b325ec6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.454078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.454572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.454948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.455249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.455694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.455957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.456417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] PATH_INFO: `/v3/services/b50eeddc9157436797bc2866f3290370` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.457790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b50eeddc9157436797bc2866f3290370)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.460506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.461877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.516063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2331/4636] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:33 2021] DELETE /identity/v3/services/b50eeddc9157436797bc2866f3290370 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:33.520055 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2306/4637] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:33.520596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.526153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:33.526723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.586729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39f69-96f4-4cdc-8e29-e8a15e687f1b tempest-EndPointGroupsTest-211965784 tempest-EndPointGroupsTest-211965784-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.666298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1ba74-34fb-493b-901a-396165239344 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.683047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.684221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.684505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.684809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.685969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.687885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.725266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.726239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.727101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.727245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] PATH_INFO: `/v3/users/9a3fb076247a4c0cb7a815017c1d0b97` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.731293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3fb076247a4c0cb7a815017c1d0b97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.733245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.738975 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2307/4638] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:33.739884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.762906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809c41-d16a-498a-a72c-1e16a49b8ed2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.775353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.776888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.777180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.777444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.778204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.782692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.816597 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2308/4639] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:33 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:33.826010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.857756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9fc1-364a-4266-ad89-4efdf50045c2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.862515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3fb076247a4c0cb7a815017c1d0b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.872298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.875739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.876116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.876463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.876906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3fb076247a4c0cb7a815017c1d0b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.878267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.878888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3fb076247a4c0cb7a815017c1d0b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.883992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.902473 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2309/4640] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:33 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:33.902799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:33.909420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3fb076247a4c0cb7a815017c1d0b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.915383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e69e-f5dc-4166-95a4-f5ed463a80b0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:33.920946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:33.922451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.922854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.923138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] PATH_INFO: `/v3/projects/7831ef525ec34d88ae73dc994fe9ba51/users/d5f53454610e48adacc0d8a9438b546a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.925748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-beb6e9e3-aeab-4266-bce4-401c21fbc924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3fb076247a4c0cb7a815017c1d0b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:33.939845 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2332/4641] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:33 2021] DELETE /identity/v3/users/9a3fb076247a4c0cb7a815017c1d0b97 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:33.941634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.942110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.942564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.946732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7831ef525ec34d88ae73dc994fe9ba51, user_id=d5f53454610e48adacc0d8a9438b546a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:33.949455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3c3e-0ec1-496c-82c3-8f48bb300bce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:33.977596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2310/4642] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:33 2021] PUT /identity/v3/projects/7831ef525ec34d88ae73dc994fe9ba51/users/d5f53454610e48adacc0d8a9438b546a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:33.979867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:33.980160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:33.980484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:33.994342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:33.995989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.002466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:34.004520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.098293 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2333/4643] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:34.110202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:34.111619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.114066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2311/4644] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:34.127941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:34.131519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.218578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324a1aa-310e-41b3-9e5e-4f2dfbe083ef None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:34.224357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:34.224540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669da2f-57a9-426c-9e2c-e1e8eeb97d1b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:34.225043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:34.225318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:34.226134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:34.229656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:34.230523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:34.230904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:34.231282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:34.237729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:34.239674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad722035-2fa8-476e-af31-4547cbe88927 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:34.244549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:34.246327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:34.253740 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2334/4645] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:09:34.259874 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2312/4646] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:34.403399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:34.403767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:34.404099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:34.424787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] MFA Rules not processed for user `0f5c8838662b4cfcafe4ddb79e088046`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:34.425686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.575373 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2335/4647] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:34 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:34.791448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:34.793324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:34.810164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f68-6c2e-459b-a4fb-21b412632161 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:34.815418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:34.816463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:34.816845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:34.817183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] PATH_INFO: `/v3/projects/f8ba86336279471c97e96a0be0580d9f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:34.818553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ba86336279471c97e96a0be0580d9f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:34.821603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:34.897690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ba86336279471c97e96a0be0580d9f', 'request_id': 'req-386399c0-258a-44a1-8b17-fca944f73800'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:34.904266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ba86336279471c97e96a0be0580d9f', 'request_id': 'req-386399c0-258a-44a1-8b17-fca944f73800'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:34.912359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ba86336279471c97e96a0be0580d9f', 'request_id': 'req-386399c0-258a-44a1-8b17-fca944f73800'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:34.930577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] The token cache is being invalidate because project f8ba86336279471c97e96a0be0580d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:34.930879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:34.931494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-386399c0-258a-44a1-8b17-fca944f73800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:34.934032 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2313/4648] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:34 2021] DELETE /identity/v3/projects/f8ba86336279471c97e96a0be0580d9f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:34.937551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:34.970646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945932c0-6b49-469d-a1a7-65c0cb0257e9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:35.131919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:35.133134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:35.133529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:35.134300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] PATH_INFO: `/v3/users/32eb8f62678444b9a1022217dda2dd23` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:35.135591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32eb8f62678444b9a1022217dda2dd23)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:35.137771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:35.213733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32eb8f62678444b9a1022217dda2dd23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:35.229729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32eb8f62678444b9a1022217dda2dd23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:35.230722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32eb8f62678444b9a1022217dda2dd23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:35.248754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32eb8f62678444b9a1022217dda2dd23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:35.261236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32eb8f62678444b9a1022217dda2dd23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:35.269864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2336/4649] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:34 2021] DELETE /identity/v3/users/32eb8f62678444b9a1022217dda2dd23 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:36.074560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c8d-7ee5-4c99-a812-3dfeed1cfb24 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.075647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c8d-7ee5-4c99-a812-3dfeed1cfb24 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.076007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c8d-7ee5-4c99-a812-3dfeed1cfb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.142344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d24f1c8d-7ee5-4c99-a812-3dfeed1cfb24 None None] MFA Rules not processed for user `d5f53454610e48adacc0d8a9438b546a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:36.143715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d24f1c8d-7ee5-4c99-a812-3dfeed1cfb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.153845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:36.155557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.289150 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2314/4650] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:36.300100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8c96e-e691-4990-93d2-2811c68d4a50 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:36.300965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.301673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.302167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.307289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:36.309032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.319482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.320367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] PATH_INFO: `/v3/projects/cfcd344a22cc414f82ebb954b325ec6a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.326350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcd344a22cc414f82ebb954b325ec6a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:36.332466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:36.338026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] MFA Rules not processed for user `d5f53454610e48adacc0d8a9438b546a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:36.339553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.348392 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2315/4651] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:36.362646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:36.365111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.425097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcd344a22cc414f82ebb954b325ec6a', 'request_id': 'req-b27de2b5-0875-4526-8bf0-f60022047e4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:36.437652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcd344a22cc414f82ebb954b325ec6a', 'request_id': 'req-b27de2b5-0875-4526-8bf0-f60022047e4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:36.453722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcd344a22cc414f82ebb954b325ec6a', 'request_id': 'req-b27de2b5-0875-4526-8bf0-f60022047e4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:36.477267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] The token cache is being invalidate because project cfcd344a22cc414f82ebb954b325ec6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:36.477836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:36.479529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b27de2b5-0875-4526-8bf0-f60022047e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:36.489756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2337/4652] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:36 2021] DELETE /identity/v3/projects/cfcd344a22cc414f82ebb954b325ec6a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:36.492933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015715-cee9-40a5-8bec-63b24620ca61 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.493368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015715-cee9-40a5-8bec-63b24620ca61 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.493660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015715-cee9-40a5-8bec-63b24620ca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.524103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4e015715-cee9-40a5-8bec-63b24620ca61 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:36.525383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e015715-cee9-40a5-8bec-63b24620ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.536004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e036ff-f06c-4a80-920c-b2575063e17a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:36.610193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2338/4653] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:36.618260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.618638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.619550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.648876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:36.649536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.649817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.650292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.652381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.660266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:36.671712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:36.700819 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2339/4654] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:36.705444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:36.725920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19920-fbc5-4ce7-9c4b-146446cf9b5c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:36.732518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:36.734739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.735098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.736167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.737183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:36.737530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:36.740230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:36.754140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:36.755800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:36.771948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2340/4655] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:36.779169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:36.787300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2316/4656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:36 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:36.795488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b6df-30c2-4dc3-abba-64cf062cce03 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:36.802902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:36.802902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.802902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.803259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.804593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:36.807064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:36.851708 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2341/4657] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:36.855838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:36.874312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a04b0-a563-4270-82a1-af46c9517ac5 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:36.996330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:36.997043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:36.997323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:36.997593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:36.998410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.000292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.027207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2317/4658] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:36 2021] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:37.029182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.041010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c50c-3da6-40fb-9b40-54d491cd0438 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.045768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.046421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.046696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.047057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.047896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.049521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.064629 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2342/4659] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:09:37.065875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.077476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94a8cc-cc30-47ee-8fcc-1f84fb6d6446 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.082916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.083796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.084142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.084507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.085402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.087587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258554a-eba1-4bd5-8b70-dfa84735faf4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.097708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2318/4660] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:37.101925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.111803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8797b8c-6100-4262-bd3c-64cf5f9d54e5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.120582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.122423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.123144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.123889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] PATH_INFO: `/v3/projects/9a9f5a67d01c4cbb9358a0441f05cc15/users/ac6bd7d630dc41b58019b3904e84ec26/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.142991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9f5a67d01c4cbb9358a0441f05cc15, user_id=ac6bd7d630dc41b58019b3904e84ec26, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.157964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.188762 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2343/4661] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:37 2021] PUT /identity/v3/projects/9a9f5a67d01c4cbb9358a0441f05cc15/users/ac6bd7d630dc41b58019b3904e84ec26/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:37.200424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e99a3-3ae5-4a16-8cb0-03e3172c40e0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.200735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e99a3-3ae5-4a16-8cb0-03e3172c40e0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.201014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e99a3-3ae5-4a16-8cb0-03e3172c40e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.232512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-968e99a3-3ae5-4a16-8cb0-03e3172c40e0 None None] MFA Rules not processed for user `ac6bd7d630dc41b58019b3904e84ec26`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:37.233779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-968e99a3-3ae5-4a16-8cb0-03e3172c40e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:37.307136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2319/4662] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:37.311425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.343406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.343697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.343977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.362147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:37.363500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:37.385495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a199-21b2-4f62-b3f6-9110d10e401a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.390193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.390845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.391132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.391405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.392117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.394169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.428806 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2344/4663] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:37 2021] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:37.430377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.433790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2320/4664] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:37 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:37.498600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf11e9c-c499-4f30-9b1f-fcc54825a2d9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.503588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.504218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.504501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.504798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.505503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.508259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.537432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2345/4665] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:37 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:37.541463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.555262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366b5b-918a-4a31-9b3f-71c2caef5097 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.562137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.562895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.563293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.563633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.564494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.567493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.589236 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2321/4666] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:37.592081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.603602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2942b-7213-493f-9d4d-7d56aabcfa0c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.608788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.609806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.610085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.610357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] PATH_INFO: `/v3/projects/abb4228e7fe9408b9de54f6895ee3328/users/36032016a43242769518a0563767f723/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.631478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb4228e7fe9408b9de54f6895ee3328, user_id=36032016a43242769518a0563767f723, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.640929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.683241 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2346/4667] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:37 2021] PUT /identity/v3/projects/abb4228e7fe9408b9de54f6895ee3328/users/36032016a43242769518a0563767f723/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:37.687908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.702949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ca8a-ea1e-4eb4-af86-888ac6f9921b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.788708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.789482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.789973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.804754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.804754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.804754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eb6ac-0537-47ea-93b1-473c958968e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.844929 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2322/4668] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:37.847252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:37.861678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458eeed-0dc1-4ff7-819f-00fada423826 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:37.871424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:37.872379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.872686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.872964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] PATH_INFO: `/v3/projects/abb4228e7fe9408b9de54f6895ee3328/users/36032016a43242769518a0563767f723/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.876634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb4228e7fe9408b9de54f6895ee3328, user_id=36032016a43242769518a0563767f723, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:37.879263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:37.893431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2347/4669] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:37 2021] PUT /identity/v3/projects/abb4228e7fe9408b9de54f6895ee3328/users/36032016a43242769518a0563767f723/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:37.904815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:37.905134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:37.905399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:37.938332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] MFA Rules not processed for user `36032016a43242769518a0563767f723`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:37.939566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:38.039527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2323/4670] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:37 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:38.043908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.056902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2a9e2-8a1c-48ae-b9da-f2343829ef1f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.063321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.064645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.065218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.065589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.066354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.068000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.091955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2348/4671] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:09:38 2021] POST /identity/v3/domains => generated 276 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:38.096031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.116992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472f5f-3102-4ac3-a2b3-ca36bc498881 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.198937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.199733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.200402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.200854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.201749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.203883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.267903 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2324/4672] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:38 2021] POST /identity/v3/projects => generated 401 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:38.272049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.301005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b46a8-2a4b-41a9-aa70-cb418b52aa35 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.463446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.464345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.469435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.469937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.470712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.472962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.507439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2349/4673] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:09:38 2021] POST /identity/v3/groups => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:38.509311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.523489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b780-eea7-445c-a58f-935d2ba61f9d tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.529707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.530685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.530971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.531365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.532211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.535187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.570956 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2325/4674] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:38 2021] POST /identity/v3/users => generated 445 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:38.575502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.589705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d152-cc23-470b-a816-ad9306ace3b9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.596778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.597741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.598241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.598755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.599723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.602348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.641058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2350/4675] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:38 2021] POST /identity/v3/roles => generated 238 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:38.645464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.661526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e638-da38-4196-be9e-9e37d54dfcd5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.677008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.678467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.679339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.679787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.693127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(project_id=590e203263e2491285df8d124c0212a5, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=685303c06359405b8f246389344d444c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.696921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.714563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2326/4676] 10.222.0.13 () {60 vars in 1584 bytes} [Wed Nov 10 04:09:38 2021] PUT /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:38.718786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.729227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8501-7ebd-4421-b5b9-aa0551d6a6fd tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.793760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.794548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.794839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.795731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.798629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:check_grant(project_id=590e203263e2491285df8d124c0212a5, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=685303c06359405b8f246389344d444c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.811893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.821664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2351/4677] 10.222.0.13 () {58 vars in 1566 bytes} [Wed Nov 10 04:09:38 2021] HEAD /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:38.826279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.839755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc09c8-36b2-401b-a8b5-cb39b0c11d8c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.846283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.847124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.847407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.847702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.850464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=590e203263e2491285df8d124c0212a5, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=685303c06359405b8f246389344d444c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.853441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:38.861032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 685303c06359405b8f246389344d444c was removed from group f7eac11d950b4e97994923db4e0084b4 on project 590e203263e2491285df8d124c0212a5. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:38.861315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:38.862184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:38.880540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2327/4678] 10.222.0.13 () {58 vars in 1568 bytes} [Wed Nov 10 04:09:38 2021] DELETE /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/groups/f7eac11d950b4e97994923db4e0084b4/roles/685303c06359405b8f246389344d444c/inherited_to_projects => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:38.885348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:38.889388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:38.905782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3eb7-32d7-43be-9b81-6abffcaf9040 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:38.979879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:38.980844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:38.981194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:38.981465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/685303c06359405b8f246389344d444c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:38.983422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=685303c06359405b8f246389344d444c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:38.985229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.028838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 685303c06359405b8f246389344d444c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:39.029224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.029827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.031919 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2352/4679] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:38 2021] DELETE /identity/v3/roles/685303c06359405b8f246389344d444c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:39.039720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.057939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4b11-0e3b-4cf1-bad0-e679750e43be tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.138450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.139554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.139820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.140400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.141217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.143319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.164679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2328/4680] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:39 2021] POST /identity/v3/roles => generated 239 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:39.165932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.167373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:39.180794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa590-50d9-4729-9aa2-edfe5efafaa4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.188773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.190241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.190751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.191330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.210250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(project_id=590e203263e2491285df8d124c0212a5, user_id=a0b193e3e4384f18bbb591432301734b, role_id=46354c8eaa36434dbc15c7e120aea89d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.214078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.230164 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2353/4681] 10.222.0.13 () {60 vars in 1581 bytes} [Wed Nov 10 04:09:39 2021] PUT /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:39.234131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.246103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad11b8-cc77-4617-9fe9-52725d503b26 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.373181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.374266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.374586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.375098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.377774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:check_grant(project_id=590e203263e2491285df8d124c0212a5, user_id=a0b193e3e4384f18bbb591432301734b, role_id=46354c8eaa36434dbc15c7e120aea89d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.386110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.399220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2329/4682] 10.222.0.13 () {58 vars in 1563 bytes} [Wed Nov 10 04:09:39 2021] HEAD /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:39.404002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.416523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5169-1f09-4ffb-a4a3-c1ef38962749 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.423465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.424694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.425207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.432090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.435026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=590e203263e2491285df8d124c0212a5, user_id=a0b193e3e4384f18bbb591432301734b, role_id=46354c8eaa36434dbc15c7e120aea89d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.438021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.447811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 46354c8eaa36434dbc15c7e120aea89d was removed from user a0b193e3e4384f18bbb591432301734b on project 590e203263e2491285df8d124c0212a5. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:39.448175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.449127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.475325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2354/4683] 10.222.0.13 () {58 vars in 1565 bytes} [Wed Nov 10 04:09:39 2021] DELETE /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/46354c8eaa36434dbc15c7e120aea89d/inherited_to_projects => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:39.479291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.481367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:39.498882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37382-d008-4f2d-9a3d-cefcc40eddc1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.622283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.623612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.623997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.624339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/46354c8eaa36434dbc15c7e120aea89d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.626104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=46354c8eaa36434dbc15c7e120aea89d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.629282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.705079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 46354c8eaa36434dbc15c7e120aea89d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:39.705515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.706356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:39.708577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2330/4684] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:39 2021] DELETE /identity/v3/roles/46354c8eaa36434dbc15c7e120aea89d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:39.714046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.724970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d3b9-d653-4912-98b1-fbf7ec1fede9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.780681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.781419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.781699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.781975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.782724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.784314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.799207 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2355/4685] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:39 2021] POST /identity/v3/roles => generated 239 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:39.804173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.812848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:39.831033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6853477-7dee-4717-bc76-1e3f094bf99b tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.838240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.839084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.839400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.839675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.841968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=1bb69f1c075f4d068612283ce7c52656)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.844591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.857586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2331/4686] 10.222.0.13 () {60 vars in 1581 bytes} [Wed Nov 10 04:09:39 2021] PUT /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:39.862081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.872588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06dbb-2417-4fa0-a0ee-d3182e670ae4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.933089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.933905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.934184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.934464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.936776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=b8aa2391760d4127a302dbbc92fa24b2, group_id=f7eac11d950b4e97994923db4e0084b4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:39.939448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:39.958063 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2356/4687] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 04:09:39 2021] GET /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/inherited_to_projects => generated 447 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:39.962779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:39.974729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb72d7-9991-413f-a6e0-a8b15bf2d096 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:39.988399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:39.989398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:39.990446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:39.992131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:39.996245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=1bb69f1c075f4d068612283ce7c52656)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.000066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.009004 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2332/4688] 10.222.0.13 () {58 vars in 1563 bytes} [Wed Nov 10 04:09:39 2021] HEAD /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.014224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.024831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaef99-3854-4c35-878c-68bd68ba9e4e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.032297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.033236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.033519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.033799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.036117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, group_id=f7eac11d950b4e97994923db4e0084b4, role_id=1bb69f1c075f4d068612283ce7c52656)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.038897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.044146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 1bb69f1c075f4d068612283ce7c52656 was removed from group f7eac11d950b4e97994923db4e0084b4 on domain b8aa2391760d4127a302dbbc92fa24b2. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:40.044433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.045156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.058838 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2357/4689] 10.222.0.13 () {58 vars in 1565 bytes} [Wed Nov 10 04:09:40 2021] DELETE /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/groups/f7eac11d950b4e97994923db4e0084b4/roles/1bb69f1c075f4d068612283ce7c52656/inherited_to_projects => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.063094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.065463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:40.078814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d19f5-8b65-4f45-9f55-cf080e20434c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.140231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.141134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.141422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.141701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/1bb69f1c075f4d068612283ce7c52656` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.143202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1bb69f1c075f4d068612283ce7c52656)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.144815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.186308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 1bb69f1c075f4d068612283ce7c52656 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:40.186600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.187274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.193606 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2333/4690] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:40 2021] DELETE /identity/v3/roles/1bb69f1c075f4d068612283ce7c52656 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:40.195428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.206748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379296b1-10af-477a-baf3-6cb49e566a30 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.292376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.293559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.293933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.294286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.295089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.296738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.321725 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2358/4691] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:40 2021] POST /identity/v3/roles => generated 240 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:40.326233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.328165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:40.342645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cec30a-22cf-432d-a084-afed211bc6e8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.348159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.349377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.350084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.350913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.355918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b, role_id=013c8aab29cd4b9891c45d6d769b4956)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.358806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.385983 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2334/4692] 10.222.0.13 () {60 vars in 1578 bytes} [Wed Nov 10 04:09:40 2021] PUT /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.390652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.405260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780a28-faf1-4ace-ac18-98f80b21fb71 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.518839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.519747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.520489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.520489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.523048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.525697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.539616 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2359/4693] 10.222.0.13 () {58 vars in 1460 bytes} [Wed Nov 10 04:09:40 2021] GET /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/inherited_to_projects => generated 447 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:40.543626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.557328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437ee74-a615-4727-95f3-3ba71fc48863 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.568251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.570076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.570416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.571187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.573127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b, role_id=013c8aab29cd4b9891c45d6d769b4956)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.576120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.582957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2335/4694] 10.222.0.13 () {58 vars in 1560 bytes} [Wed Nov 10 04:09:40 2021] HEAD /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.587275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.597600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcac59-9d12-4743-94e7-6957cfed38a1 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.603024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.603833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.604109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.604380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.606767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b, role_id=013c8aab29cd4b9891c45d6d769b4956)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.609433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.614785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 013c8aab29cd4b9891c45d6d769b4956 was removed from user a0b193e3e4384f18bbb591432301734b on domain b8aa2391760d4127a302dbbc92fa24b2. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:40.615070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.616338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.636405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2360/4695] 10.222.0.13 () {58 vars in 1562 bytes} [Wed Nov 10 04:09:40 2021] DELETE /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/013c8aab29cd4b9891c45d6d769b4956/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.637602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.639511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:40.653789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ecb0-0cf7-4b73-b693-e7abf7bf25ff tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.712808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.713661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.713946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.714223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/013c8aab29cd4b9891c45d6d769b4956` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.715719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=013c8aab29cd4b9891c45d6d769b4956)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.717352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.751822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 013c8aab29cd4b9891c45d6d769b4956 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:40.752107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.752813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:40.754728 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2336/4696] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:40 2021] DELETE /identity/v3/roles/013c8aab29cd4b9891c45d6d769b4956 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:40.761001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.772974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88469-d239-4270-bc68-d6928a1504a5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.834772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.835481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.835784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.836061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.836861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.838447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.856438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2361/4697] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:40 2021] POST /identity/v3/roles => generated 240 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:40.857528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.859326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:40.872134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400a874-91f8-4d96-bc89-f1ef019e86a4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.876840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.877498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.877781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.878059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.878785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.880679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:40.918603 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2337/4698] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:40 2021] POST /identity/v3/projects => generated 408 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:40.919957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:40.930324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d854-d991-4d35-b42a-2fc6818c71e7 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:40.985934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:40.986788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:40.987066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:40.987339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/597d0350b1c94086bc856c52a80e3583/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:40.989650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b, role_id=597d0350b1c94086bc856c52a80e3583)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:40.992980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.005555 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2362/4699] 10.222.0.13 () {60 vars in 1578 bytes} [Wed Nov 10 04:09:40 2021] PUT /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/597d0350b1c94086bc856c52a80e3583/inherited_to_projects => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:41.010060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.021776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ee542-b44e-47b2-8535-8192f52486e9 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.096112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.097067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.097517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.097774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.098686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=590e203263e2491285df8d124c0212a5, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:41.099476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.101872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.158142 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2338/4700] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:41 2021] GET /identity/v3/role_assignments?scope.project.id=590e203263e2491285df8d124c0212a5&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 648 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:41.162585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.174863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb1ca-d587-4d25-9e91-dee61d8840eb tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.181505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.183778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.184080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.184351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.186303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=e857d5ccc04a43b29ca8e71f638d8251, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:41.186694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.191174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.266181 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2363/4701] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:41 2021] GET /identity/v3/role_assignments?scope.project.id=e857d5ccc04a43b29ca8e71f638d8251&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 648 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:41.268205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.280060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ddff-a5ed-4167-979f-aa24919482ba tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.285853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.288805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.289256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.289656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/597d0350b1c94086bc856c52a80e3583/inherited_to_projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.294752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b8aa2391760d4127a302dbbc92fa24b2, user_id=a0b193e3e4384f18bbb591432301734b, role_id=597d0350b1c94086bc856c52a80e3583)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.297966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.303607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 597d0350b1c94086bc856c52a80e3583 was removed from user a0b193e3e4384f18bbb591432301734b on domain b8aa2391760d4127a302dbbc92fa24b2. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:41.304160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.305126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.319984 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2339/4702] 10.222.0.13 () {58 vars in 1562 bytes} [Wed Nov 10 04:09:41 2021] DELETE /identity/v3/OS-INHERIT/domains/b8aa2391760d4127a302dbbc92fa24b2/users/a0b193e3e4384f18bbb591432301734b/roles/597d0350b1c94086bc856c52a80e3583/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:41.323980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.326421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:41.340724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bbf8-da99-4027-914f-fc42b0c89189 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.417016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.417769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.418017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.418389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.419611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=590e203263e2491285df8d124c0212a5, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:41.419920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.421803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.478925 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2364/4703] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:41 2021] GET /identity/v3/role_assignments?scope.project.id=590e203263e2491285df8d124c0212a5&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 228 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:41.482854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.505533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390564ed-9f33-4373-b328-b11f81441a58 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.510921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.511654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.512059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.512373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.513276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=e857d5ccc04a43b29ca8e71f638d8251, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:41.513582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.515407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.573699 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2340/4704] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:41 2021] GET /identity/v3/role_assignments?scope.project.id=e857d5ccc04a43b29ca8e71f638d8251&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 228 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:41.575182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.587169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bbe9-5d03-4e59-a74f-7b562a2f79f5 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.592662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.593638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.593820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.594125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects/e857d5ccc04a43b29ca8e71f638d8251` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.595341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e857d5ccc04a43b29ca8e71f638d8251)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.597354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.655045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e857d5ccc04a43b29ca8e71f638d8251', 'request_id': 'req-9e0084ee-325d-4fdd-ab89-636e8f4bc126'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.663119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e857d5ccc04a43b29ca8e71f638d8251', 'request_id': 'req-9e0084ee-325d-4fdd-ab89-636e8f4bc126'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.671439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e857d5ccc04a43b29ca8e71f638d8251', 'request_id': 'req-9e0084ee-325d-4fdd-ab89-636e8f4bc126'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.691153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] The token cache is being invalidate because project e857d5ccc04a43b29ca8e71f638d8251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:41.691536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.692319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.695139 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2365/4705] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:41 2021] DELETE /identity/v3/projects/e857d5ccc04a43b29ca8e71f638d8251 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:41.699096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.701507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:41.719554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6735-f269-466e-9e63-82f2bd767503 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.786177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.787207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.787591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.788024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/597d0350b1c94086bc856c52a80e3583` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.789654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=597d0350b1c94086bc856c52a80e3583)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.797720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.859548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 597d0350b1c94086bc856c52a80e3583 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:41.859863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.860591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:41.863116 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2341/4706] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:41 2021] DELETE /identity/v3/roles/597d0350b1c94086bc856c52a80e3583 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:41.868889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.878873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0084ee-325d-4fdd-ab89-636e8f4bc126 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.941777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.942346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.942622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.942894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.943810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.945982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:41.960849 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2366/4707] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:09:41 2021] POST /identity/v3/roles => generated 240 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:41.964914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:41.966329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:41.978819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c104d-366f-4e97-8ca0-a52d5744207c tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:41.983807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:41.984478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:41.984799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:41.985079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:41.985816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:41.987719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.023947 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2342/4708] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:41 2021] POST /identity/v3/projects => generated 408 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:42.028211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.038551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dc68-7ce5-4423-8aa8-8a5c30f38aa3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.096200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.097085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.097363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.097637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.100005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:create_grant(project_id=590e203263e2491285df8d124c0212a5, user_id=a0b193e3e4384f18bbb591432301734b, role_id=4ef8bd1fbe9c47cf88f5448f55a1a4a8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.102708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.115086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2367/4709] 10.222.0.13 () {60 vars in 1581 bytes} [Wed Nov 10 04:09:42 2021] PUT /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8/inherited_to_projects => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:42.119856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.130561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfc694-3c47-4a73-8a61-30649d8874f6 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.188833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.189532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.189796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.190028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.190856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=c10a1d38b1234c6a9597ddaa2571c005, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:42.191160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.193089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.253688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2343/4710] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:42 2021] GET /identity/v3/role_assignments?scope.project.id=c10a1d38b1234c6a9597ddaa2571c005&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 649 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:09:42.254982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.273963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fec58-12c7-4e12-9dff-fe107200bd57 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.281432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.282466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.282988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.283374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8/inherited_to_projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.286847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=590e203263e2491285df8d124c0212a5, user_id=a0b193e3e4384f18bbb591432301734b, role_id=4ef8bd1fbe9c47cf88f5448f55a1a4a8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.289790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.296327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 4ef8bd1fbe9c47cf88f5448f55a1a4a8 was removed from user a0b193e3e4384f18bbb591432301734b on project 590e203263e2491285df8d124c0212a5. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:42.296768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.297573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.316211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2368/4711] 10.222.0.13 () {58 vars in 1565 bytes} [Wed Nov 10 04:09:42 2021] DELETE /identity/v3/OS-INHERIT/projects/590e203263e2491285df8d124c0212a5/users/a0b193e3e4384f18bbb591432301734b/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8/inherited_to_projects => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:42.317720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.320119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:42.333118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63b67-8253-4173-bd50-a38dfadb349e tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.391175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.391831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.392110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.392385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.393244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Adding query filter params (scope.project.id=c10a1d38b1234c6a9597ddaa2571c005, user.id=a0b193e3e4384f18bbb591432301734b) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:42.393725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.395713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.447697 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2344/4712] 10.222.0.13 () {58 vars in 1355 bytes} [Wed Nov 10 04:09:42 2021] GET /identity/v3/role_assignments?scope.project.id=c10a1d38b1234c6a9597ddaa2571c005&user.id=a0b193e3e4384f18bbb591432301734b&effective => generated 228 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:42.451943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.462127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ed7f-8836-42b6-93de-d01f5e247b44 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.466812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.467768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.468051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.468322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects/c10a1d38b1234c6a9597ddaa2571c005` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.469549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c10a1d38b1234c6a9597ddaa2571c005)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.471484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.522805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10a1d38b1234c6a9597ddaa2571c005', 'request_id': 'req-f4b9da20-216c-4c3d-9de7-0f142319aeb3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.528553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10a1d38b1234c6a9597ddaa2571c005', 'request_id': 'req-f4b9da20-216c-4c3d-9de7-0f142319aeb3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.537513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10a1d38b1234c6a9597ddaa2571c005', 'request_id': 'req-f4b9da20-216c-4c3d-9de7-0f142319aeb3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.556393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] The token cache is being invalidate because project c10a1d38b1234c6a9597ddaa2571c005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:42.556710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.557371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.558942 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2369/4713] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:42 2021] DELETE /identity/v3/projects/c10a1d38b1234c6a9597ddaa2571c005 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:42.563201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.564909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:42.579800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8fa8-8684-48cc-848f-21f87df6c9f4 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.640832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.641690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.641975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.642254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.643891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4ef8bd1fbe9c47cf88f5448f55a1a4a8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.645528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.686850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invalidating the token cache because role 4ef8bd1fbe9c47cf88f5448f55a1a4a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:42.687542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.688401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.691784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2345/4714] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:42 2021] DELETE /identity/v3/roles/4ef8bd1fbe9c47cf88f5448f55a1a4a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:42.697833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.711439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9da20-216c-4c3d-9de7-0f142319aeb3 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.788722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.789638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.789915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.790183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/users/a0b193e3e4384f18bbb591432301734b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.791398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a0b193e3e4384f18bbb591432301734b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.793348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:42.843371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b193e3e4384f18bbb591432301734b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.851204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b193e3e4384f18bbb591432301734b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.852001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b193e3e4384f18bbb591432301734b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.864838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b193e3e4384f18bbb591432301734b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.874105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b193e3e4384f18bbb591432301734b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:42.882132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2370/4715] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:42 2021] DELETE /identity/v3/users/a0b193e3e4384f18bbb591432301734b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:42.886695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:42.889050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:42.903216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a71a4-9741-4732-b84d-dffb45c1a9fe tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:42.966079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:42.967617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:42.967929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:42.968212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/groups/f7eac11d950b4e97994923db4e0084b4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:42.970109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f7eac11d950b4e97994923db4e0084b4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:42.974358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:43.035763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:43.036303 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2346/4716] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:09:42 2021] DELETE /identity/v3/groups/f7eac11d950b4e97994923db4e0084b4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:43.037518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:43.052122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296bf0f-77c1-4814-8893-e2e2492e599f tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:43.110357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:43.111235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:43.111517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:43.111790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/projects/590e203263e2491285df8d124c0212a5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:43.113059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=590e203263e2491285df8d124c0212a5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:43.115521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:43.165557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590e203263e2491285df8d124c0212a5', 'request_id': 'req-fc3c4465-ab96-4700-9ba6-9abdd977eef8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.171807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590e203263e2491285df8d124c0212a5', 'request_id': 'req-fc3c4465-ab96-4700-9ba6-9abdd977eef8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.178112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590e203263e2491285df8d124c0212a5', 'request_id': 'req-fc3c4465-ab96-4700-9ba6-9abdd977eef8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.191575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] The token cache is being invalidate because project 590e203263e2491285df8d124c0212a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:43.191858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.192711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.194456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2371/4717] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:43 2021] DELETE /identity/v3/projects/590e203263e2491285df8d124c0212a5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:43.198386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:43.201119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:43.222035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372b42-adb7-476b-8a9e-7a3044933710 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:43.279285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:43.281731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:43.282440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:43.282440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/domains/b8aa2391760d4127a302dbbc92fa24b2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:43.284170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b8aa2391760d4127a302dbbc92fa24b2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:43.285803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:43.307956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.308725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.335969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.340656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.345196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2347/4718] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:09:43 2021] PATCH /identity/v3/domains/b8aa2391760d4127a302dbbc92fa24b2 => generated 277 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:43.349031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:43.360749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4465-ab96-4700-9ba6-9abdd977eef8 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:43.420561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36032016a43242769518a0563767f723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb4228e7fe9408b9de54f6895ee3328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:43.421603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:43.421954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:43.422295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] PATH_INFO: `/v3/domains/b8aa2391760d4127a302dbbc92fa24b2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:43.438097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b8aa2391760d4127a302dbbc92fa24b2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:43.438097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:43.462033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.465518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.519480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.526462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.533826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.550740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] The token cache is being invalidate because project b8aa2391760d4127a302dbbc92fa24b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:43.550927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.551900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.583143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.588160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.589185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b8aa2391760d4127a302dbbc92fa24b2', 'request_id': 'req-56da310c-9aaf-4b03-b7fd-7f35e03b35a0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.611325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2372/4719] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:09:43 2021] DELETE /identity/v3/domains/b8aa2391760d4127a302dbbc92fa24b2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:43.612558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:43.614301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:43.722938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20818bb2-93ab-4394-821d-1902a6432657 tempest-InheritsV3TestJSON-1715982029 tempest-InheritsV3TestJSON-1715982029-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:43.789697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:43.790723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:43.791113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:43.791448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] PATH_INFO: `/v3/users/ac6bd7d630dc41b58019b3904e84ec26` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:43.793101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6bd7d630dc41b58019b3904e84ec26)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:43.795078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:43.852984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6bd7d630dc41b58019b3904e84ec26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.860058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6bd7d630dc41b58019b3904e84ec26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.861060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6bd7d630dc41b58019b3904e84ec26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.861626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6bd7d630dc41b58019b3904e84ec26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.870049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6bd7d630dc41b58019b3904e84ec26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:43.889652 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2348/4720] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:43 2021] DELETE /identity/v3/users/ac6bd7d630dc41b58019b3904e84ec26 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:43.900770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:43.900770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:43.900770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:43.915589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:43.916915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:43.974714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2373/4721] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:43.984685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:43.986089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:44.043881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d378-5c71-4c16-a34c-b106fc4d3564 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:44.048496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:44.048929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:44.049208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:44.049482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:44.061201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:44.062819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:44.075378 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2349/4722] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:09:44.487544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:44.489961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:44.505387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69001-b0c9-4523-a1a0-84116b5a6e73 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:44.512977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:44.513842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:44.514122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:44.514813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] PATH_INFO: `/v3/projects/9a9f5a67d01c4cbb9358a0441f05cc15` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:44.515667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9f5a67d01c4cbb9358a0441f05cc15)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:44.517599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:44.565777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9f5a67d01c4cbb9358a0441f05cc15', 'request_id': 'req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.571777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9f5a67d01c4cbb9358a0441f05cc15', 'request_id': 'req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.578240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9f5a67d01c4cbb9358a0441f05cc15', 'request_id': 'req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.591499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] The token cache is being invalidate because project 9a9f5a67d01c4cbb9358a0441f05cc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:44.591821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.592446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.594209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2374/4723] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:44 2021] DELETE /identity/v3/projects/9a9f5a67d01c4cbb9358a0441f05cc15 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:44.598135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:44.609020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453126d-1233-484d-a147-401b637f6605 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:44.667180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:44.668062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:44.668348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:44.668648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] PATH_INFO: `/v3/users/36032016a43242769518a0563767f723` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:44.669869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36032016a43242769518a0563767f723)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:44.671805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:44.729083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36032016a43242769518a0563767f723'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.739610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36032016a43242769518a0563767f723'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.741963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36032016a43242769518a0563767f723'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.742797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36032016a43242769518a0563767f723'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.757930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db300d16-0347-4e39-b2f0-2fed43f21ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36032016a43242769518a0563767f723'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:44.781284 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2350/4724] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:44 2021] DELETE /identity/v3/users/36032016a43242769518a0563767f723 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:09:45.169240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.170822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:45.186228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbf2f-9dc8-4e22-976a-2b6e17e48ed4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.251516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.252275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.252580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.252882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] PATH_INFO: `/v3/projects/abb4228e7fe9408b9de54f6895ee3328` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.254072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb4228e7fe9408b9de54f6895ee3328)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.255997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.301862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb4228e7fe9408b9de54f6895ee3328', 'request_id': 'req-011166c8-3800-4adc-88f4-46c546c5109f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:45.307100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb4228e7fe9408b9de54f6895ee3328', 'request_id': 'req-011166c8-3800-4adc-88f4-46c546c5109f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:45.313042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb4228e7fe9408b9de54f6895ee3328', 'request_id': 'req-011166c8-3800-4adc-88f4-46c546c5109f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:45.324680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] The token cache is being invalidate because project abb4228e7fe9408b9de54f6895ee3328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:45.325228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:45.325849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011166c8-3800-4adc-88f4-46c546c5109f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:45.327363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2375/4725] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:45 2021] DELETE /identity/v3/projects/abb4228e7fe9408b9de54f6895ee3328 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:45.337987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.338276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.338553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.356511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:45.357735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:45.413930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2351/4726] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:45.421982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.422267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.422542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.441719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:45.443081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:45.452579 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2376/4727] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:45.457368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.467339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2484-9ae0-45e7-b88f-50c1730b0bc7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.471782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.472435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.472752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.473023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.473752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:45.474048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.476551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.488015 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2352/4728] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:45.492985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.501954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d689d3d-db21-4f18-9ec2-4d49ab64ad6b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.506720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.507361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.507638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.507904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.508597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.510490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.543041 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2377/4729] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:45 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:45.543735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.555345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7542-2d4c-481e-9dc2-5726c45c932c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.617772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.618439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.618750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.619024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.619739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.621700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.643376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2353/4730] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:45 2021] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:45.648427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.658956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c9059-eeb4-40db-8d92-98a23f5c8c5e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.665454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.666110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.666388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.666681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.667554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.669189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.680638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2378/4731] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:45.684992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.695885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7427cd-26cd-4618-8759-71d332703fd7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.703426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.704094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.704368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.704656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.705392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.707023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1d245-26eb-4b91-b3f6-e74b2810c340 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.717709 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2354/4732] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:45.722003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.732301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a327c-399e-47e9-a81c-0278820d9075 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.736975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.737841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.738117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.738388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] PATH_INFO: `/v3/projects/cd31ddd29f4348dca5f39bb33408561c/users/ea5f55d2b8d144af91e847c47016aef4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.753772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd31ddd29f4348dca5f39bb33408561c, user_id=ea5f55d2b8d144af91e847c47016aef4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.756520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.770152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2379/4733] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:45 2021] PUT /identity/v3/projects/cd31ddd29f4348dca5f39bb33408561c/users/ea5f55d2b8d144af91e847c47016aef4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:45.780771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.781084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.781380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.812060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] MFA Rules not processed for user `ea5f55d2b8d144af91e847c47016aef4`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:45.813326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:45.884577 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2355/4734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:45 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:45.896354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:45.898604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:45.966743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bdd46-2c26-40d4-b8fb-0121e96aeb13 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:45.970462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:45.971085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:45.971363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:45.971633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:45.981699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:45.983127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4a27-cde0-41b9-9acf-132f0620472c service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:45.992368 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2380/4735] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:45 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:09:46.122031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:46.214364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35e30-030c-4a59-955e-1f02740b73fa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:46.220410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:46.221410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:46.221781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:46.222135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] PATH_INFO: `/v3/users/ea5f55d2b8d144af91e847c47016aef4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:46.223480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5f55d2b8d144af91e847c47016aef4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:46.227268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:46.293733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5f55d2b8d144af91e847c47016aef4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:46.300834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5f55d2b8d144af91e847c47016aef4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:46.301542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5f55d2b8d144af91e847c47016aef4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:46.302145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5f55d2b8d144af91e847c47016aef4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:46.309754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5f55d2b8d144af91e847c47016aef4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:46.333977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2356/4736] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:09:46 2021] DELETE /identity/v3/users/ea5f55d2b8d144af91e847c47016aef4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:46.338868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:46.339195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:46.341054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:46.367239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:46.368443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:46.426074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2381/4737] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:46.436338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:46.437774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:46.496742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5c49-ab67-4da2-9d69-13220d654801 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:46.500513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:46.501215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:46.501494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:46.501768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:46.512129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:46.513507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be5669-3ef6-4185-bae8-64c42ed8057e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:46.524382 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2357/4738] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:46.999470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.001298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:47.025059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75e59-0dd9-47e5-a5cb-796f79b595bf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.038537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.039411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.039740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.039952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] PATH_INFO: `/v3/projects/cd31ddd29f4348dca5f39bb33408561c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.043097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd31ddd29f4348dca5f39bb33408561c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.045235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.101195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd31ddd29f4348dca5f39bb33408561c', 'request_id': 'req-c5567314-4a20-4de0-a0c5-ce58fb4798e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:47.111691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd31ddd29f4348dca5f39bb33408561c', 'request_id': 'req-c5567314-4a20-4de0-a0c5-ce58fb4798e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:47.124017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd31ddd29f4348dca5f39bb33408561c', 'request_id': 'req-c5567314-4a20-4de0-a0c5-ce58fb4798e2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:47.140371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] The token cache is being invalidate because project cd31ddd29f4348dca5f39bb33408561c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:09:47.140914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:47.141551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5567314-4a20-4de0-a0c5-ce58fb4798e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:09:47.143685 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2382/4739] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:09:46 2021] DELETE /identity/v3/projects/cd31ddd29f4348dca5f39bb33408561c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:47.150182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.150748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.150748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.174490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:47.176769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:47.243774 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2358/4740] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:47.252757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.253109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.253389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.272548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:47.273825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:47.283482 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2383/4741] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:47.287949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.297575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd153-e5cc-4ded-ad6f-a2b333a72b79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.302170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.302821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.303607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.303893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.304638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:09:47.304943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.306506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.317857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2359/4742] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:09:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:09:47.322740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.332208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdb050-c5f3-4856-92c0-8a92d0730d70 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.336966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.337749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.338098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.338441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.339226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.341130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.370785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2384/4743] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:09:47 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:09:47.371709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.384726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4909-1536-4f93-aa5c-2e2fde210fdd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.446389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.447063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.447346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.447619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.448362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.450566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.471282 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2360/4744] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:09:47 2021] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:09:47.475171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.485166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7111e3e-7ab3-4282-9862-94b2136f98db admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.490307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.491501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.491973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.492370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.493278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.494884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.505380 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2385/4745] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:47.509939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.519818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db6d1-f6a3-4b01-a448-a6963fc915dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.524714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.525419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.525639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.525907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.526637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.528213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7e142-fd17-4294-8218-3918a3d7776b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.538210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2361/4746] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:09:47.542201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.552036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26919b-38f9-4783-8de5-139b4ce9c6df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.557158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.558018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.558297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.558572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] PATH_INFO: `/v3/projects/3d6e1e1cae7c42779501a0a6926cd0d2/users/99276f6ff47b4a0fab1f5e527dd8b058/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.572736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e1e1cae7c42779501a0a6926cd0d2, user_id=99276f6ff47b4a0fab1f5e527dd8b058, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.575578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.587902 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2386/4747] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:09:47 2021] PUT /identity/v3/projects/3d6e1e1cae7c42779501a0a6926cd0d2/users/99276f6ff47b4a0fab1f5e527dd8b058/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:09:47.598460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd394ef-9207-4d14-9475-7f76878a9886 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.598743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd394ef-9207-4d14-9475-7f76878a9886 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.599015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd394ef-9207-4d14-9475-7f76878a9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.624459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4cd394ef-9207-4d14-9475-7f76878a9886 None None] MFA Rules not processed for user `99276f6ff47b4a0fab1f5e527dd8b058`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:47.625683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4cd394ef-9207-4d14-9475-7f76878a9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:47.688530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2362/4748] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:47 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:09:47.699309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:47.701283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:47.756654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c75-b4b3-4f91-90fd-87cc2daf5105 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:47.760310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:47.760976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:47.761265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:47.761541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:47.770695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:47.772106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcf17-4ed1-4623-abff-19f904625103 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:47.780968 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2387/4749] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:47 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:09:53.354533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:53.355098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:53.355338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:53.375473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] MFA Rules not processed for user `885977f4f57f46a2a938d8cd81bdb3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:53.376587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:53.507323 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2363/4750] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:56.644128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:56.644713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:56.644713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:56.666345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:09:56.667597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:56.732418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2388/4751] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:09:56 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:09:59.060883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:09:59.063269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:59.215039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419692ef-883c-4f2b-a635-7781c82d22d0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:09:59.223982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:09:59.225421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:09:59.225862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:09:59.226319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:09:59.228499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:09:59.245285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:09:59.247138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:09:59.263391 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2364/4752] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:09:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:00.863194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:00.864895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:00.901546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e27c04-dd0d-4a1d-a5a8-0259758c5df2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:00.910182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:00.911421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:00.912153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:00.912907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:00.915878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:00.933442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:00.935161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:00.954370 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2389/4753] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:09.073089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:09.074518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:09.225372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2309f5e-ee3d-4d06-8ad6-8a03cb99cddf service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:09.230940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:09.232460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:09.233155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:09.233685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] PATH_INFO: `/v3/users/67e3e93293b94c1f9be1b7c501073c70` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:09.237652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e3e93293b94c1f9be1b7c501073c70)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:09.241246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:09.303704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e3e93293b94c1f9be1b7c501073c70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.327038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e3e93293b94c1f9be1b7c501073c70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.329043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e3e93293b94c1f9be1b7c501073c70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.330505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e3e93293b94c1f9be1b7c501073c70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.363167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-90c0fa1b-bda2-4d5a-a941-f0de0b3d6304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e3e93293b94c1f9be1b7c501073c70'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.394433 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2365/4754] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:09 2021] DELETE /identity/v3/users/67e3e93293b94c1f9be1b7c501073c70 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:09.704735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:09.717226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695adee-04c0-4e7f-9fe8-5864506bdd12 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:09.790272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:09.791169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:09.791623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:09.791899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] PATH_INFO: `/v3/projects/e047b3c23a5c4dbea0f8b67221c1a5eb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:09.793351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e047b3c23a5c4dbea0f8b67221c1a5eb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:09.795309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:09.858971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e047b3c23a5c4dbea0f8b67221c1a5eb', 'request_id': 'req-9203d729-24cc-4f66-83ff-387d061531f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.864663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e047b3c23a5c4dbea0f8b67221c1a5eb', 'request_id': 'req-9203d729-24cc-4f66-83ff-387d061531f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.875565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e047b3c23a5c4dbea0f8b67221c1a5eb', 'request_id': 'req-9203d729-24cc-4f66-83ff-387d061531f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.892845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] The token cache is being invalidate because project e047b3c23a5c4dbea0f8b67221c1a5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:09.894020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.894851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9203d729-24cc-4f66-83ff-387d061531f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:09.896409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2390/4755] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:09 2021] DELETE /identity/v3/projects/e047b3c23a5c4dbea0f8b67221c1a5eb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:09.902210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:09.902688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:09.902959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:09.923177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:09.924378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:09.989878 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2366/4756] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:09.999194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:09.999608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:09.999750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.018763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:10.019950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:10.029548 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2391/4757] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:10.033704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.045984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee39a-b46d-4397-b9e8-4ba8aa5221bf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.054610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.055285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.055558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.055876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.056573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:10.057143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.058998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.087699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.087885 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2367/4758] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:10.099415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b7b3-eb21-4cac-850a-d8641092a232 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.106335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.107890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.107890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.107890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.108408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.110793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.160020 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2392/4759] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:10 2021] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:10.161251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.175910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48473a-d4a0-4511-b0bf-a6f398a4fd14 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.241568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.242751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.243189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.243465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.244390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.246455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.269542 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2368/4760] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:10 2021] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:10:10.273396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.285302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33184e1-804d-4311-bda5-39ea1674346f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.310027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.310945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.313606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.314063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.315405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.321630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.334209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2393/4761] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:10 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:10.338263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.353944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6349b7a-abc1-4bc8-bdef-d7e32056e6c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.359866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.361393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.361900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.362404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.363362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.365789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae4e3-7f5d-4ed6-a704-a83677404701 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.382784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2369/4762] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:10 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:10.385383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.402463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484241-5cec-431b-9f1f-1d76eedafe17 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.409224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.417812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.417812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.417812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] PATH_INFO: `/v3/projects/34c4792d78da485d8086b19b7e599153/users/78f213344bf24a6283f161b240f87af2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.437944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c4792d78da485d8086b19b7e599153, user_id=78f213344bf24a6283f161b240f87af2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.440850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.461303 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2394/4763] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:10 2021] PUT /identity/v3/projects/34c4792d78da485d8086b19b7e599153/users/78f213344bf24a6283f161b240f87af2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:10.462790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681b88-6655-456f-80ce-6a4e609d39b0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.462989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681b88-6655-456f-80ce-6a4e609d39b0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.463334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681b88-6655-456f-80ce-6a4e609d39b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.505390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cd681b88-6655-456f-80ce-6a4e609d39b0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:10.508202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd681b88-6655-456f-80ce-6a4e609d39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:10.589889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2370/4764] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:10.601586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:10.603386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:10.687382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687dcdf-09d9-4486-899c-4775870f052c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:10.693063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:10.695207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:10.695640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:10.696104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:10.717252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:10.719144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825de58d-ca00-4a7f-b302-1ed6211883c4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:10.730374 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2395/4765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:11.049674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f654f4-3ac6-4468-8014-55569eb77f3a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:11.050215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f654f4-3ac6-4468-8014-55569eb77f3a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:11.050806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f654f4-3ac6-4468-8014-55569eb77f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:11.074310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-16f654f4-3ac6-4468-8014-55569eb77f3a None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:11.076037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-16f654f4-3ac6-4468-8014-55569eb77f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:11.137204 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2371/4766] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:11 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:11.975675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:11.976565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:11.977229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:12.011185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] MFA Rules not processed for user `78f213344bf24a6283f161b240f87af2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:12.012810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:12.132760 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2396/4767] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:11 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:12.140993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:12.144958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:12.145777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:12.176086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] MFA Rules not processed for user `78f213344bf24a6283f161b240f87af2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:12.178173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:12.203916 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2372/4768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:12 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:12.263536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:12.265104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:12.366925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f5d2-3f5e-4d91-8d65-a755207b2b66 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:12.374487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:12.375343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:12.375685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:12.376195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:12.387527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:12.389399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:12.400288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2397/4769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:12 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:18.236479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:18.238863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:18.272148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01c22-2b98-4b2f-87fe-40aac338dd62 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:18.277736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:18.278769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:18.279224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:18.279646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] PATH_INFO: `/v3/users/885977f4f57f46a2a938d8cd81bdb3fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:18.281395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885977f4f57f46a2a938d8cd81bdb3fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:18.283775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:18.341741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885977f4f57f46a2a938d8cd81bdb3fc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.350669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885977f4f57f46a2a938d8cd81bdb3fc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.351497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885977f4f57f46a2a938d8cd81bdb3fc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.352210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885977f4f57f46a2a938d8cd81bdb3fc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.360127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d6550bb-d492-467b-bd6e-b378a1dfc1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885977f4f57f46a2a938d8cd81bdb3fc'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.378322 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2373/4770] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:18 2021] DELETE /identity/v3/users/885977f4f57f46a2a938d8cd81bdb3fc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:18.606655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:18.619523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3688de-ca68-4d1c-a9e9-685355dd51be service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:18.700788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:18.701593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:18.701874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:18.702149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] PATH_INFO: `/v3/projects/b05c03f4e9dc4e1d9e8f759b8f0c7c06` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:18.703451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05c03f4e9dc4e1d9e8f759b8f0c7c06)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:18.705470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:18.786641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05c03f4e9dc4e1d9e8f759b8f0c7c06', 'request_id': 'req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.804416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05c03f4e9dc4e1d9e8f759b8f0c7c06', 'request_id': 'req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.814345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05c03f4e9dc4e1d9e8f759b8f0c7c06', 'request_id': 'req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.832417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] The token cache is being invalidate because project b05c03f4e9dc4e1d9e8f759b8f0c7c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:18.832982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.834708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2480819-9aa5-4ba4-8c11-7ebc0d31ac1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:18.837316 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2398/4771] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:18 2021] DELETE /identity/v3/projects/b05c03f4e9dc4e1d9e8f759b8f0c7c06 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:18.843391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:18.844040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:18.849230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:18.883164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:18.884379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:18.956289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2374/4772] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:18.964343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:18.964649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:18.964931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:18.986183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:18.987759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.001424 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2399/4773] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:19.002583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.014345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8b03b-8be6-4e47-bb6b-5797826b0ec2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.019942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.021686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.022195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.022693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.023938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:19.024512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.026346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.042104 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2375/4774] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:19.047505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.063769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a320-ad25-4172-842a-a2e54212b18e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.068501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.069209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.069488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.069763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.070469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.072397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.102672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2400/4775] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:19 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:19.106802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.117043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c90f-312c-409a-9809-eb95f6a51190 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.201658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.203003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.203290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.203564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.204328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.206519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.229694 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2376/4776] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:19 2021] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:19.230936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.242530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7a0b5-3fa9-490b-b8b9-6040f436cd58 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.249098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.249772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.250054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.250327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.251070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.252686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.265328 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2401/4777] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:19 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:19.269476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.281861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdf3b-10dc-46ec-99a9-6600f76a66ae admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.286570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.287216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.287498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.287774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.288508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.290224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.300122 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2377/4778] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:10:19.304513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.322736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.325848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.327655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03252b42-1d21-449a-851b-3e1cacb549d0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.341004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.341913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.342193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.342465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] PATH_INFO: `/v3/projects/64eb45bb7ada4f77b0924905b8c533bc/users/8e24bd170fa140f1b078b0eb93a9df80/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.345879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7f4f-2d84-4a60-a2e3-235ed8bfb829 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.352443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.353408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.353628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.353902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] PATH_INFO: `/v3/users/99276f6ff47b4a0fab1f5e527dd8b058` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.356044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=99276f6ff47b4a0fab1f5e527dd8b058)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.358019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.363435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64eb45bb7ada4f77b0924905b8c533bc, user_id=8e24bd170fa140f1b078b0eb93a9df80, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.366816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd43d1-ca72-4a28-be3d-93c561109362 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.390702 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2402/4779] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:19 2021] PUT /identity/v3/projects/64eb45bb7ada4f77b0924905b8c533bc/users/8e24bd170fa140f1b078b0eb93a9df80/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:19.398035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.398425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.398713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.426379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99276f6ff47b4a0fab1f5e527dd8b058'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.430682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:19.432067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.433968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99276f6ff47b4a0fab1f5e527dd8b058'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.434665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99276f6ff47b4a0fab1f5e527dd8b058'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.435333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99276f6ff47b4a0fab1f5e527dd8b058'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.444688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4f4f7daf-9396-4ea8-9750-9c0cff3e5cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99276f6ff47b4a0fab1f5e527dd8b058'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.469311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2378/4780] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:19 2021] DELETE /identity/v3/users/99276f6ff47b4a0fab1f5e527dd8b058 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:19.473729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.474715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.475057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.493958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:19.495414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.497529 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2403/4781] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:19.508326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.509729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.571721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430d5bf-36ba-4b87-9896-710a36fa3374 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.583399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2379/4782] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:19.593190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.618620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.619184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.619461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.619733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.628621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.630058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.639835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2404/4783] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:10:19.645194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d96932-3c84-4e69-9412-4fca6efc3169 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.648896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.649523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.649805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.650071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.659184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.661073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e0dba-aae1-4969-bef5-9ef60f923fbb service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.671604 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2380/4784] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:10:19.877298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:19.878768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:19.895631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019bba2-390f-4786-8484-f488a3a62446 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:19.901577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:19.902750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:19.903883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:19.904338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] PATH_INFO: `/v3/projects/3d6e1e1cae7c42779501a0a6926cd0d2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:19.905811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6e1e1cae7c42779501a0a6926cd0d2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:19.907854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:19.964450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6e1e1cae7c42779501a0a6926cd0d2', 'request_id': 'req-3efdfa95-aa1a-42e6-a772-0473ddf5d100'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.970002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6e1e1cae7c42779501a0a6926cd0d2', 'request_id': 'req-3efdfa95-aa1a-42e6-a772-0473ddf5d100'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.977719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6e1e1cae7c42779501a0a6926cd0d2', 'request_id': 'req-3efdfa95-aa1a-42e6-a772-0473ddf5d100'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.995827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] The token cache is being invalidate because project 3d6e1e1cae7c42779501a0a6926cd0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:19.996119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.996822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3efdfa95-aa1a-42e6-a772-0473ddf5d100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:19.998379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2405/4785] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:19 2021] DELETE /identity/v3/projects/3d6e1e1cae7c42779501a0a6926cd0d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:20.003992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.004374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.004684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.024270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:20.025734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.123125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2381/4786] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:20.130954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.131260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.131557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.151216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:20.152424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.161054 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2406/4787] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:20.165792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.175185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702fb6b-8c0d-4f90-b7b7-f2bd0d04064c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.180356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.181040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.181318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.181588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.182310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:20.182607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.184165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.196232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2382/4788] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:20.201118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.226159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f2a3b-4d02-46cd-8127-18de7dd19565 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.235482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.236570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.237209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.237687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.238669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.241999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.277177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2407/4789] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:20.278872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.289542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b13d6a-cc31-4f39-a9df-6821d931c2da admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.345949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.346704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.347260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.347470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.348258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.351100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.378973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.379194 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2383/4790] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:20.395011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29e23-c480-439f-aceb-9a0e434f55d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.401530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.402919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.403190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.403540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.404307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.406292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c249eb-cfad-400f-926a-c97a0a346b44 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.421351 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2408/4791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:20.425260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.445634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e487-6152-4a25-88d7-349ebfe45c44 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.452064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.453080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.453360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.462015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.462944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.463990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3737-7c04-4763-9446-357011b41478 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.464541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3737-7c04-4763-9446-357011b41478 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.464773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.465286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3737-7c04-4763-9446-357011b41478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.476450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2384/4792] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:20.480512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.493372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78533-80b1-42b6-a732-b35aac005191 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.495297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dbfb3737-7c04-4763-9446-357011b41478 None None] MFA Rules not processed for user `8e24bd170fa140f1b078b0eb93a9df80`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:20.496725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbfb3737-7c04-4763-9446-357011b41478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.498491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.499362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.499798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.500260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] PATH_INFO: `/v3/projects/7948418a27894a9385a8de69906a34f5/users/235faa77cd5547aead0799af021bac1b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.519676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948418a27894a9385a8de69906a34f5, user_id=235faa77cd5547aead0799af021bac1b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.523000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc367c36-07c2-41b9-914e-77dd5e6df871 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.541665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2385/4793] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:20 2021] PUT /identity/v3/projects/7948418a27894a9385a8de69906a34f5/users/235faa77cd5547aead0799af021bac1b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:10:20.551051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.551342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.551636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.568858 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2409/4794] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:20.580584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.581371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.581872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.592542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] MFA Rules not processed for user `235faa77cd5547aead0799af021bac1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:20.593824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.606331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] MFA Rules not processed for user `8e24bd170fa140f1b078b0eb93a9df80`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:20.607677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.680535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2386/4795] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:20.690201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.691213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2410/4796] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:20.694281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.707559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:20.710419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:20.773579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de212e6-ca2f-491a-9b8d-19424004cde9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.778598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.779912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.780484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.781190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.790719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.792141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70488-5f45-47de-a777-4d6ee4d16b27 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.799562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049256d-6346-465c-a3f8-2b417a63e3a6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:20.802328 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2387/4797] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:20 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:20.812977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:20.813648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:20.813904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:20.814197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:20.829825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:20.831762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:20.845798 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2411/4798] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:20 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:29.983526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc787-fc1e-4e37-a40a-cad507b8baec None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:29.984876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc787-fc1e-4e37-a40a-cad507b8baec None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:29.985296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc787-fc1e-4e37-a40a-cad507b8baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:30.003381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-97abc787-fc1e-4e37-a40a-cad507b8baec None None] MFA Rules not processed for user `d5f53454610e48adacc0d8a9438b546a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:30.004599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-97abc787-fc1e-4e37-a40a-cad507b8baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:30.093281 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2388/4799] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:29 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:36.261402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:36.263079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:36.352968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72412-ebc8-487f-9795-9e12b7178c74 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:36.358900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:36.360159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:36.360866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:36.361359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] PATH_INFO: `/v3/users/78f213344bf24a6283f161b240f87af2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:36.363144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f213344bf24a6283f161b240f87af2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:36.366058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:36.421500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f213344bf24a6283f161b240f87af2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:36.429174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f213344bf24a6283f161b240f87af2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:36.429944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f213344bf24a6283f161b240f87af2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:36.442406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f213344bf24a6283f161b240f87af2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:36.450059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f213344bf24a6283f161b240f87af2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:36.456737 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2412/4800] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:36 2021] DELETE /identity/v3/users/78f213344bf24a6283f161b240f87af2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:36.560499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11c32f-fd5b-4c1c-97a5-77eec8eda897 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:36.561078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11c32f-fd5b-4c1c-97a5-77eec8eda897 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:36.561078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11c32f-fd5b-4c1c-97a5-77eec8eda897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:36.580056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ce11c32f-fd5b-4c1c-97a5-77eec8eda897 None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:36.581464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ce11c32f-fd5b-4c1c-97a5-77eec8eda897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:36.638965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2389/4801] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:36 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:37.028702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.030180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:37.112125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062335-d746-40c7-8789-f224f95c0366 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.117377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.118227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.118504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.118775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] PATH_INFO: `/v3/projects/34c4792d78da485d8086b19b7e599153` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.119963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c4792d78da485d8086b19b7e599153)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.121882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.169914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c4792d78da485d8086b19b7e599153', 'request_id': 'req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:37.175409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c4792d78da485d8086b19b7e599153', 'request_id': 'req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:37.182486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c4792d78da485d8086b19b7e599153', 'request_id': 'req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:37.194400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] The token cache is being invalidate because project 34c4792d78da485d8086b19b7e599153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:37.194682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:37.195326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-211c8d6c-cb62-4ac9-a17a-e8201eac6af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:37.197112 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2413/4802] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:37 2021] DELETE /identity/v3/projects/34c4792d78da485d8086b19b7e599153 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:37.203195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.203485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.203761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.243407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:37.244836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:37.312388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2390/4803] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:37.321211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.321802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.322016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.341673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:37.342883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:37.351742 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2414/4804] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:37.355999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.365967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7087-3323-4ddb-aa0e-c97213816249 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.370492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.371185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.371450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.371715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.372436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:37.372816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.374383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.389391 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2391/4805] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:37.391074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.402008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a698a2-f606-4793-9c57-4a86a62623fc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.406890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.407739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.408123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.408468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.409331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.412107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.445876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2415/4806] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:37 2021] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:37.447079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.459211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01160b-7dd6-4b1f-88b6-8c421e765ab2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.539136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.540044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.540747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.541042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.541986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.545051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.579994 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2392/4807] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:37 2021] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:37.583742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.595937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85280acc-6071-4536-98e8-14100bffc30e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.601224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.602160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.602658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.603115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.604297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.606363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.634148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2416/4808] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:37 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:37.637805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.658632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51b74-e493-4d9c-856d-fe5f6f24304b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.672078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.673096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.673606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.674582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.675512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.678901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1212-e1a5-4702-b075-50f809c6855c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.691505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2393/4809] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:37 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:37.696582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.711468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4ca1-c2db-4d67-9122-e2e346c49658 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:37.721141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:37.723411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.723662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.723946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] PATH_INFO: `/v3/projects/e0514fff6fa34fbd85663d2eabb964cf/users/1434b8121c944d368cd1786999dd81fc/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.742398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0514fff6fa34fbd85663d2eabb964cf, user_id=1434b8121c944d368cd1786999dd81fc, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:37.745420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:37.786093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2417/4810] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:37 2021] PUT /identity/v3/projects/e0514fff6fa34fbd85663d2eabb964cf/users/1434b8121c944d368cd1786999dd81fc/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:37.787657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ec07-606b-4f25-a97b-aada67242094 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:37.787905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ec07-606b-4f25-a97b-aada67242094 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:37.788188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ec07-606b-4f25-a97b-aada67242094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:37.813780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e444ec07-606b-4f25-a97b-aada67242094 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:37.815291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e444ec07-606b-4f25-a97b-aada67242094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:37.909254 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2394/4811] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:37.921878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:37.924487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:37.998270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bdc9-4040-4353-9e1d-0a8e3087347b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:38.002348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:38.003186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:38.003643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:38.004096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:38.017923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:38.021782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5e256-f945-4f6a-9191-d26b204edb77 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:38.037234 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2418/4812] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:39.618756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:39.619267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:39.619380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:39.671622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] MFA Rules not processed for user `1434b8121c944d368cd1786999dd81fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:39.673201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:39.746941 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2395/4813] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:39.758713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:39.759226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:39.759309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:39.782592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] MFA Rules not processed for user `1434b8121c944d368cd1786999dd81fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:39.784588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:39.795535 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2419/4814] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:39.808758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:39.811627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:39.973374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98adf5-c3d2-4cfb-8f81-1f3e70ea57cc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:39.988049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:39.989714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:39.990840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:39.991533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:40.004957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:40.018216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5624-c78f-4c1d-8eaf-f60fc1280ff0 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:40.046745 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2396/4815] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:43.813704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:43.815243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:43.853491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5c85-1faf-4318-9140-a8f609900ea2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:43.862738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:43.863707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:43.864580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:43.864937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] PATH_INFO: `/v3/users/235faa77cd5547aead0799af021bac1b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:43.870781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235faa77cd5547aead0799af021bac1b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:43.872814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:43.956989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235faa77cd5547aead0799af021bac1b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:43.965019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235faa77cd5547aead0799af021bac1b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:43.965938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235faa77cd5547aead0799af021bac1b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:43.983863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235faa77cd5547aead0799af021bac1b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.007470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235faa77cd5547aead0799af021bac1b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.017071 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2420/4816] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:43 2021] DELETE /identity/v3/users/235faa77cd5547aead0799af021bac1b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:44.021920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.022422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.022538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.057788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:44.059852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.148348 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2397/4817] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:44.187048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:44.188595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.264231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9e06-b5d0-45c8-ac72-84b6806d9098 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:44.268816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:44.269483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.276762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.277090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.288098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:44.289586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:44.302159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2421/4818] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:44.373678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:44.377422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.400651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c37695-7380-42e9-a661-7ed35d6c673f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:44.408986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:44.410525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.411066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.411578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] PATH_INFO: `/v3/users/8e24bd170fa140f1b078b0eb93a9df80` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.413732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e24bd170fa140f1b078b0eb93a9df80)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:44.416878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:44.491908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e24bd170fa140f1b078b0eb93a9df80'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.499593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e24bd170fa140f1b078b0eb93a9df80'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.501182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e24bd170fa140f1b078b0eb93a9df80'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.502455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e24bd170fa140f1b078b0eb93a9df80'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.522657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e24bd170fa140f1b078b0eb93a9df80'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.552663 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2398/4819] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:44 2021] DELETE /identity/v3/users/8e24bd170fa140f1b078b0eb93a9df80 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:44.598101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:44.600027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.618993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b336f-dad6-4c4c-9a23-cff9cde56020 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:44.690794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:44.691828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.691925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.692256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] PATH_INFO: `/v3/projects/7948418a27894a9385a8de69906a34f5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.694609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7948418a27894a9385a8de69906a34f5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:44.696970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:44.763059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7948418a27894a9385a8de69906a34f5', 'request_id': 'req-4abc4014-f9db-450c-8183-d0691ed7b6cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.771302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7948418a27894a9385a8de69906a34f5', 'request_id': 'req-4abc4014-f9db-450c-8183-d0691ed7b6cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.778704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7948418a27894a9385a8de69906a34f5', 'request_id': 'req-4abc4014-f9db-450c-8183-d0691ed7b6cd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.783654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:44.785473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.795367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] The token cache is being invalidate because project 7948418a27894a9385a8de69906a34f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:44.795745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.796749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4abc4014-f9db-450c-8183-d0691ed7b6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.799733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2422/4820] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:44 2021] DELETE /identity/v3/projects/7948418a27894a9385a8de69906a34f5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:44.805664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668585be-a231-4b71-b6bd-b72cbdbfd9de admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:44.807612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec9cd-ca63-45f0-8d83-cc0b5bb03051 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.807612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec9cd-ca63-45f0-8d83-cc0b5bb03051 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.808039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec9cd-ca63-45f0-8d83-cc0b5bb03051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.853446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-125ec9cd-ca63-45f0-8d83-cc0b5bb03051 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:44.856047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-125ec9cd-ca63-45f0-8d83-cc0b5bb03051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:44.899320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:44.900504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:44.901013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:44.901502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] PATH_INFO: `/v3/projects/64eb45bb7ada4f77b0924905b8c533bc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:44.904454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64eb45bb7ada4f77b0924905b8c533bc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:44.907448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:44.980141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64eb45bb7ada4f77b0924905b8c533bc', 'request_id': 'req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:44.996359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64eb45bb7ada4f77b0924905b8c533bc', 'request_id': 'req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:45.001186 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2423/4821] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:45.009428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.009919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.010363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.015256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64eb45bb7ada4f77b0924905b8c533bc', 'request_id': 'req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:45.038373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] The token cache is being invalidate because project 64eb45bb7ada4f77b0924905b8c533bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:45.041775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:45.043724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eabaafd7-2653-453f-bc45-8fd3b15cbc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:45.046701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2399/4822] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:44 2021] DELETE /identity/v3/projects/64eb45bb7ada4f77b0924905b8c533bc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:45.054162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f06b3-40cb-4dc0-bacf-04e874d4bfb4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.054456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f06b3-40cb-4dc0-bacf-04e874d4bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.054719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f06b3-40cb-4dc0-bacf-04e874d4bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.059408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:45.061551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:45.086464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b65f06b3-40cb-4dc0-bacf-04e874d4bfb4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:45.087624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b65f06b3-40cb-4dc0-bacf-04e874d4bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:45.192811 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2424/4823] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:45.194333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.203643 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2400/4824] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:45.213639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.213639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.213956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.220033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a53d-a064-454c-8c46-d2f977492439 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.230505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.231464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.231922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.232743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.233793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:45.234289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.236646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:45.237466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.237880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:45.249424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2401/4825] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:45.253377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.263933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2425/4826] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:45.266573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde7114-99ed-4ac0-b557-f4c581a0a8d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.268853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.273432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.274378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.275025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.275489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.276931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:45.277590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.280719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.283768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e79c8-dc00-4337-ad12-526c96fbcdbd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.296891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2402/4827] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:10:45.299075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.299848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.300272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.301207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.301403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.302513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.305363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.317825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c498-8bae-407d-a7dc-559925b0b102 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.324950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.326725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.327828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.328268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.330258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.332547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.391190 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2403/4828] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:45.396512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.397193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2426/4829] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:45.398152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.506305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e40e-4947-4909-afd7-5f132c14a0a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.540185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53722-9362-4e12-bd5e-3aa85ec54432 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.549530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.552324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.553495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.554771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.555880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.559796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.598448 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2427/4830] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:45.602711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.614431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8749c-8bf6-4663-8c17-573159a98fbb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.643694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.644535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.644845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.645190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.646504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.651762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.654096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.655854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.656296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.656575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.657976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.659958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.692996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2428/4831] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:45.693886 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2404/4832] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:45.695695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.698595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.715818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cafcf-e38a-4b24-a0ce-2088633163f9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.726768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f214ac-589d-4032-b6a4-045349398cd4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.733759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.733946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.734473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.734599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.735078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.735204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.735287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.735378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.737453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.739718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.745544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.748601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.753253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2429/4833] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:45.758450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.766195 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2405/4834] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:45.768658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.771968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce96253-bf6f-4e3e-abff-d63539247314 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.778699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.779700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.780128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.780491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] PATH_INFO: `/v3/projects/3632801027274d8e83a1f4b60bdef085/users/f24be74cf8e048d1b45f89e7eddc9639/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.793897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaf6af-66f1-4abc-8b93-c3b46178b376 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.804465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3632801027274d8e83a1f4b60bdef085, user_id=f24be74cf8e048d1b45f89e7eddc9639, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.805289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.806372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.806818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.807248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.808145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9edd-1aa6-4976-a27d-01a42eb9724d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.808882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.813234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:45.829141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2406/4835] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:45.834025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:45.840728 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2430/4836] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:45 2021] PUT /identity/v3/projects/3632801027274d8e83a1f4b60bdef085/users/f24be74cf8e048d1b45f89e7eddc9639/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:45.849368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3535d-b371-4be4-b0b2-20a905122e7f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.849876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3535d-b371-4be4-b0b2-20a905122e7f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.850310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3535d-b371-4be4-b0b2-20a905122e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.852309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df12d6-2c72-403b-9e2f-440e16eb103f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:45.900116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92d3535d-b371-4be4-b0b2-20a905122e7f None None] MFA Rules not processed for user `f24be74cf8e048d1b45f89e7eddc9639`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:45.901800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92d3535d-b371-4be4-b0b2-20a905122e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:45.954319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:45.955284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:45.955635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:45.955996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] PATH_INFO: `/v3/projects/805d7a00cdff46bf93787cb1abccceba/users/7726a2bc4958475680e70966d92fc50f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:45.976305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805d7a00cdff46bf93787cb1abccceba, user_id=7726a2bc4958475680e70966d92fc50f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:45.979803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:46.007980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2431/4837] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:46.008390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2407/4838] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:45 2021] PUT /identity/v3/projects/805d7a00cdff46bf93787cb1abccceba/users/7726a2bc4958475680e70966d92fc50f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:46.012880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:46.013304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:46.013633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:46.020931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:46.023689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:46.032256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:46.033508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:46.110180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515ebd-15bc-4db5-97c3-274e57c6de26 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:46.115313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:46.115961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:46.116322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:46.116600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:46.130775 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2432/4839] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:46.144844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:46.144844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:46.159572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94880fb0-f961-4449-a9ef-2e6f0eabf61a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:46.164887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:46.165700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:46.165981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:46.166396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:46.177810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:46.179086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:46.179361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7433b2-80e4-44bd-8745-56a6878c7c2d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:46.180886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:46.189889 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2433/4840] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:10:46.190101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2408/4841] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:10:53.282456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:53.283015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:53.283303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:53.319086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:53.320291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:53.392713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2434/4842] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:53.404391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:53.405941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:53.519643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825c2f9-1372-4fd9-b78b-aa17b65d7ef1 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:53.526966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:53.527687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:53.527962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:53.528239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:53.540945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:53.543883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5394-6749-47fc-a63e-b5963879435e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:53.556771 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2409/4843] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:53 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:54.779790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:54.797924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a403f6-62cf-45e2-a738-ad1a0bf36a43 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:54.818431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:54.819317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:54.819593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:54.819865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] PATH_INFO: `/v3/users/f24be74cf8e048d1b45f89e7eddc9639` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:54.821337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24be74cf8e048d1b45f89e7eddc9639)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:54.825768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:54.826316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:54.826777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:54.827238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:54.854032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] MFA Rules not processed for user `51992c976c3248d9bce6335688cd3884`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:54.856969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:54.904988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24be74cf8e048d1b45f89e7eddc9639'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:54.920464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24be74cf8e048d1b45f89e7eddc9639'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:54.922159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24be74cf8e048d1b45f89e7eddc9639'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:54.951629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24be74cf8e048d1b45f89e7eddc9639'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:54.975183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e26ed67-ac8c-4bb3-9d4b-56362d450d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24be74cf8e048d1b45f89e7eddc9639'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:54.982365 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2435/4844] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:54 2021] DELETE /identity/v3/users/f24be74cf8e048d1b45f89e7eddc9639 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:54.987028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:54.988005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:54.989555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:55.002361 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2410/4845] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:54 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:55.023025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:55.027294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:55.122757 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2436/4846] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:55.135441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:55.136958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:55.158140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7ce2-f11a-4a9d-8c19-537232a30d0b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:55.249059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:55.250819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:55.251108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:55.251213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:55.281793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:55.283256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7a61-2230-44fc-9dd7-ea87e560f3a2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:55.305334 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2411/4847] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:55.811927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:55.813972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:55.834371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a943-7a2f-40f8-9c94-88afe1f465db None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:55.843366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:55.844588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:55.845501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:55.846030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] PATH_INFO: `/v3/projects/3632801027274d8e83a1f4b60bdef085` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:55.847583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3632801027274d8e83a1f4b60bdef085)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:55.851327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:55.953094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3632801027274d8e83a1f4b60bdef085', 'request_id': 'req-4db45930-af25-4826-98b0-dbede886de13'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:55.960208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3632801027274d8e83a1f4b60bdef085', 'request_id': 'req-4db45930-af25-4826-98b0-dbede886de13'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:55.968506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3632801027274d8e83a1f4b60bdef085', 'request_id': 'req-4db45930-af25-4826-98b0-dbede886de13'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:55.985665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] The token cache is being invalidate because project 3632801027274d8e83a1f4b60bdef085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:55.986360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:55.987611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4db45930-af25-4826-98b0-dbede886de13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:55.990819 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2437/4848] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:55 2021] DELETE /identity/v3/projects/3632801027274d8e83a1f4b60bdef085 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:55.999189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.000135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.000645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.048303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:56.050350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:56.152203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2412/4849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:56.153282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.153588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.154228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.191204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:56.193551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:56.217430 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2438/4850] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:56.218136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.239985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5583943-74c4-456a-bdf6-ca203bb7ee31 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.248980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.251471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.251971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.253103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.254294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:10:56.254905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.258713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.281022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.281217 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2413/4851] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:10:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:10:56.291978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532438-2623-43b9-93a6-994cec1668c8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.297990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.298681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.298961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.299237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.299950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.301939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.348652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2439/4852] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:56.351317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.382383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1579d18-944e-4a1c-a78c-4999dd4160d3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.477190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.477871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.478168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.478473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.479391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.481941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.511040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2414/4853] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:10:56.514820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.532877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40127-715c-4b78-adf1-1800970a5f24 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.549697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.549697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.549697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.550035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.553596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.555339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.571878 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2440/4854] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:56 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:56.572943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.589086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096f97-8a15-4730-92fc-4d8a2bfc677b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.594034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.594807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.595156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.595651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.596450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.598716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58899fa-cacf-4aa1-a412-c50a1ae80301 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.612873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2415/4855] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:56.616634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.628059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b26b0-3b2d-4018-8549-6e8dc1f80d1e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.634103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.635008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.635438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.635722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] PATH_INFO: `/v3/projects/b58c13aa584845e6bc9001749c8ca7ee/users/172eb359aaa340f08acbfbed0ded5ae3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.659762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58c13aa584845e6bc9001749c8ca7ee, user_id=172eb359aaa340f08acbfbed0ded5ae3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.662799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e5c6-a564-4354-a21f-b924852d6ffb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:56.680707 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2441/4856] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:56 2021] PUT /identity/v3/projects/b58c13aa584845e6bc9001749c8ca7ee/users/172eb359aaa340f08acbfbed0ded5ae3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:56.691168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.692590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.693138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.742455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d144-38b3-4693-baff-3f998142995b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.742807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d144-38b3-4693-baff-3f998142995b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.743046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d144-38b3-4693-baff-3f998142995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.756563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] MFA Rules not processed for user `172eb359aaa340f08acbfbed0ded5ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:56.762582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:56.782604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3433d144-38b3-4693-baff-3f998142995b None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:56.783952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3433d144-38b3-4693-baff-3f998142995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:56.865621 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2416/4857] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:56.870517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:56.933688 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2442/4858] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:56.980146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d154c-de38-44c4-ab1d-b15dc91e4f4d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:56.988593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:56.990695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:56.992162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:56.992552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:56.993422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:56.997894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.061522 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2417/4859] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:10:56 2021] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:10:57.065398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433d144-38b3-4693-baff-3f998142995b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.077870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433d144-38b3-4693-baff-3f998142995b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.185753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.186636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.187201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.187624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.188505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.191489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb17b9-a2d2-46a5-a0df-a79d3e4ae3c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.237025 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2443/4860] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:10:57 2021] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:10:57.241069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.257452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bfa3-ff85-403b-a88d-488926b0d6c9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.276949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.277630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.277909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.278183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.278924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.281420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3b80b-f11f-4432-9c85-a5d375778b6c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.290271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9c1e-6f13-43ee-bf08-90a1f3494591 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.290698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9c1e-6f13-43ee-bf08-90a1f3494591 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.291571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9c1e-6f13-43ee-bf08-90a1f3494591 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.294792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2444/4861] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:10:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:10:57.295727 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2418/4862] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:57.300523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9c1e-6f13-43ee-bf08-90a1f3494591 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.303659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.304207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.304681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.319249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9c1e-6f13-43ee-bf08-90a1f3494591 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.326531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.327577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.327962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.329087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] PATH_INFO: `/v3/projects/0d74c7ff7a504a74b4629422824cd446/users/671c1d0a85ee48b2ba6fae965c88c2da/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.351528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d74c7ff7a504a74b4629422824cd446, user_id=671c1d0a85ee48b2ba6fae965c88c2da, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.355338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.366420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:57.368041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:57.374641 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2445/4863] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:57 2021] PUT /identity/v3/projects/0d74c7ff7a504a74b4629422824cd446/users/671c1d0a85ee48b2ba6fae965c88c2da/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:57.380457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.467563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2419/4864] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:10:57 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:10:57.487313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.488893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:57.508070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41f3b9-f283-492a-beb6-f55d82910b9a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.517199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.518099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.519543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.521025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.535618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.538186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dce67-4a4e-4e97-8581-773855f11d60 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.540549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.553612 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2420/4865] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:10:57.555352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.556031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.556321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.556585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.557360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.558973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c376ca-40d1-4d34-a638-5795423ba653 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.575774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.578589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2446/4866] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:10:57.594854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909f43-98a3-4ce5-956f-c9c014778688 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.616674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.617794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.618317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.618765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] PATH_INFO: `/v3/projects/0d74c7ff7a504a74b4629422824cd446/users/671c1d0a85ee48b2ba6fae965c88c2da/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.621415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d74c7ff7a504a74b4629422824cd446, user_id=671c1d0a85ee48b2ba6fae965c88c2da, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.625235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:57.647047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2421/4867] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:10:57 2021] PUT /identity/v3/projects/0d74c7ff7a504a74b4629422824cd446/users/671c1d0a85ee48b2ba6fae965c88c2da/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:10:57.660502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32782b3-5066-47c5-a5a5-a33769bf526d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.660502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32782b3-5066-47c5-a5a5-a33769bf526d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.660502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32782b3-5066-47c5-a5a5-a33769bf526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.701637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e32782b3-5066-47c5-a5a5-a33769bf526d None None] MFA Rules not processed for user `671c1d0a85ee48b2ba6fae965c88c2da`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:57.703532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e32782b3-5066-47c5-a5a5-a33769bf526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:57.847151 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2447/4868] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:57 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:57.849284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:57.933840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15a48-e8ef-4b12-b69d-cac10b074bee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:57.938551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:57.939421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:57.939698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:57.939970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] PATH_INFO: `/v3/users/172eb359aaa340f08acbfbed0ded5ae3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:57.941213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=172eb359aaa340f08acbfbed0ded5ae3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:57.943978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:58.028197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172eb359aaa340f08acbfbed0ded5ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.036478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172eb359aaa340f08acbfbed0ded5ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.037613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172eb359aaa340f08acbfbed0ded5ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.038378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172eb359aaa340f08acbfbed0ded5ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.061801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172eb359aaa340f08acbfbed0ded5ae3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.085922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2422/4869] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:57 2021] DELETE /identity/v3/users/172eb359aaa340f08acbfbed0ded5ae3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:10:58.091275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:58.094250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:58.094698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:58.127502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:10:58.132217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:58.250271 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2448/4870] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:10:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:10:58.262930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:58.265156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:58.332380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd5ecd-6ee5-4610-84e9-6d7166f78b5d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:58.336018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:58.336579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:58.336890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:58.337163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:58.346714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:58.349035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:58.358723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2423/4871] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:10:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:10:58.896544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:58.898068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:58.919863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b450f6-e8af-4d0b-aa4d-4b35cd629508 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:58.924976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:58.925848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:58.926176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:58.926441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] PATH_INFO: `/v3/projects/b58c13aa584845e6bc9001749c8ca7ee` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:58.927971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58c13aa584845e6bc9001749c8ca7ee)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:58.929917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:58.983254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58c13aa584845e6bc9001749c8ca7ee', 'request_id': 'req-b04783cc-70a9-4245-836b-d97668d70aed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:58.993780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58c13aa584845e6bc9001749c8ca7ee', 'request_id': 'req-b04783cc-70a9-4245-836b-d97668d70aed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.000325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58c13aa584845e6bc9001749c8ca7ee', 'request_id': 'req-b04783cc-70a9-4245-836b-d97668d70aed'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.015508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] The token cache is being invalidate because project b58c13aa584845e6bc9001749c8ca7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:10:59.015886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.016553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.022965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2449/4872] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:58 2021] DELETE /identity/v3/projects/b58c13aa584845e6bc9001749c8ca7ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:10:59.023476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:59.046157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d4c7-e43c-4be7-9c9a-cb84c075dacc service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:10:59.185911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:10:59.187625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:10:59.188243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:10:59.188544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] PATH_INFO: `/v3/users/671c1d0a85ee48b2ba6fae965c88c2da` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:10:59.190289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671c1d0a85ee48b2ba6fae965c88c2da)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:10:59.192827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:10:59.270836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671c1d0a85ee48b2ba6fae965c88c2da'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.292971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671c1d0a85ee48b2ba6fae965c88c2da'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.294625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671c1d0a85ee48b2ba6fae965c88c2da'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.295433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671c1d0a85ee48b2ba6fae965c88c2da'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.306839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6252ab00-41f3-4f4b-a57a-c1df2edb85e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671c1d0a85ee48b2ba6fae965c88c2da'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:10:59.338795 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2424/4873] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:10:59 2021] DELETE /identity/v3/users/671c1d0a85ee48b2ba6fae965c88c2da => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:10:59.955291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:10:59.956953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:10:59.979582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04783cc-70a9-4245-836b-d97668d70aed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.077268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.078540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.079055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.079397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] PATH_INFO: `/v3/projects/0d74c7ff7a504a74b4629422824cd446` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.080795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d74c7ff7a504a74b4629422824cd446)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.082808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.142530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d74c7ff7a504a74b4629422824cd446', 'request_id': 'req-db184a69-a934-4e68-89a0-00b052210ea8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.148246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d74c7ff7a504a74b4629422824cd446', 'request_id': 'req-db184a69-a934-4e68-89a0-00b052210ea8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.154841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d74c7ff7a504a74b4629422824cd446', 'request_id': 'req-db184a69-a934-4e68-89a0-00b052210ea8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.169374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] The token cache is being invalidate because project 0d74c7ff7a504a74b4629422824cd446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:00.170455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.171251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-db184a69-a934-4e68-89a0-00b052210ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.173013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2450/4874] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:10:59 2021] DELETE /identity/v3/projects/0d74c7ff7a504a74b4629422824cd446 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:00.179289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.179576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.179852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.198609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:00.199892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.261775 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2425/4875] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:00.270772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.271073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.271355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.289488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:00.290681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.299245 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2451/4876] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:00.303566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.313308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8911a1-6a99-466c-8e42-9a6933cd0631 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.318532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.319192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.319470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.319744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.321191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:00.321659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.323538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.340527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2426/4877] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:00.344597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.354337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d449-3b0a-4be4-ba67-7755f9b73848 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.360083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.360787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.361073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.361344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.362049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.364506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.395206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2452/4878] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:00.399934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.411180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a24c-d788-4187-b6ca-f90bdb7f4f7e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.490872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.491601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.491883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.492230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.494378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.495475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.496458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.497387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.510691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fd60-3d26-4a52-b061-204fe685342f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.516902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.518026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.518298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.518730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] PATH_INFO: `/v3/users/1434b8121c944d368cd1786999dd81fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.519975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1434b8121c944d368cd1786999dd81fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.520886 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2427/4879] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:00.522724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.524906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.536572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632defd-3997-413a-bae7-3b44d7187b1a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.543044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.543732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.544051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.544333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.545135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.547071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.560184 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2428/4880] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:00.564262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.576134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f58fd-60be-4ad1-87cb-86759488588b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.581981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.582939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1434b8121c944d368cd1786999dd81fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.583032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.583163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.583469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.584218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.585888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.590510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1434b8121c944d368cd1786999dd81fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.591879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1434b8121c944d368cd1786999dd81fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.600890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2429/4881] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:00.602696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.607770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1434b8121c944d368cd1786999dd81fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.614881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2245-f17d-40de-a6ff-27c999acae87 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.616077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-59389c71-8f1e-49fd-b8b8-2bc2fa89b5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1434b8121c944d368cd1786999dd81fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.620218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.621139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.621461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.621740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] PATH_INFO: `/v3/projects/4aac63e33be04ef8abfa5c1d42df2502/users/f386ffa5999e4ef593908fda06e3b684/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.622442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2453/4882] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:00 2021] DELETE /identity/v3/users/1434b8121c944d368cd1786999dd81fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:00.641173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aac63e33be04ef8abfa5c1d42df2502, user_id=f386ffa5999e4ef593908fda06e3b684, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.644057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.659311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2430/4883] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:00 2021] PUT /identity/v3/projects/4aac63e33be04ef8abfa5c1d42df2502/users/f386ffa5999e4ef593908fda06e3b684/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:00.669499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.669781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.670060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.702472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] MFA Rules not processed for user `f386ffa5999e4ef593908fda06e3b684`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:00.703744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.781548 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2454/4884] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:00.782724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.784435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.829400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.831157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:00.880471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907818-4ea4-40c3-b3e8-6a60020ae8f8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.885706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.886360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.886637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.886907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.887610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.889545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.903615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc074398-53c5-443d-88ed-db13ae50f05b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:00.912832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:00.913913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:00.914253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:00.914536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] PATH_INFO: `/v3/projects/e0514fff6fa34fbd85663d2eabb964cf` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:00.916044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0514fff6fa34fbd85663d2eabb964cf)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:00.918336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:00.927376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2431/4885] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:00.930124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:00.982063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0514fff6fa34fbd85663d2eabb964cf', 'request_id': 'req-c7661c1f-e8df-4d44-966b-b403d989709d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.988120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0514fff6fa34fbd85663d2eabb964cf', 'request_id': 'req-c7661c1f-e8df-4d44-966b-b403d989709d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:00.995447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0514fff6fa34fbd85663d2eabb964cf', 'request_id': 'req-c7661c1f-e8df-4d44-966b-b403d989709d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:01.005008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de727-d7a8-4377-8ce5-15e293ccb80e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.016539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] The token cache is being invalidate because project e0514fff6fa34fbd85663d2eabb964cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:01.017678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:01.018269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c7661c1f-e8df-4d44-966b-b403d989709d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:01.021175 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2455/4886] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:00 2021] DELETE /identity/v3/projects/e0514fff6fa34fbd85663d2eabb964cf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:01.028067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207b5f-ad08-4318-be18-4b265e7cb014 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.028251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207b5f-ad08-4318-be18-4b265e7cb014 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.028523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207b5f-ad08-4318-be18-4b265e7cb014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.056222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-36207b5f-ad08-4318-be18-4b265e7cb014 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:01.057631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36207b5f-ad08-4318-be18-4b265e7cb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.082423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.082423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.082423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.082820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.083508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.087271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.124015 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2432/4887] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:00 2021] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:01.127735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.138273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.148677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2456/4888] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:01.152406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.152546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.153165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.157392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9c46-7bb0-449d-897e-93e5bceb30aa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.165281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.166526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.166526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.166738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.167463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.169506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.179147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:01.180500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.184785 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2433/4889] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:01.186820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.198296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ac8b-114a-4040-9321-a788ccccded5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.201084 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2457/4890] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:01.205599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.207193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.207930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.208212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.208478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] PATH_INFO: `/v3/projects/47e1d98e763943c88aa4b72db4a0eafd/users/c3173f7d34ef423b873960f750a94576/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.221289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea7a09-c2e2-42da-b63d-4c8bf12d190a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.227881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.228869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.229198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.229571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.230284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:01.230686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.231329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e1d98e763943c88aa4b72db4a0eafd, user_id=c3173f7d34ef423b873960f750a94576, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.232272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.233985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.248849 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2458/4891] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:01.250073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.250852 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2434/4892] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:01 2021] PUT /identity/v3/projects/47e1d98e763943c88aa4b72db4a0eafd/users/c3173f7d34ef423b873960f750a94576/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:01.256060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.262463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6958de-a08d-4a0a-8276-4249b15b1893 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.332454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.333498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.333498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.333748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.336797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.338102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833012-0f9d-461d-80ab-571fee43f034 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.340936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.343527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.344585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.344965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.345303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.346440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.348655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.360007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2435/4893] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:01.367773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.372874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2459/4894] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:01.376992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.381311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281989-3cb6-4827-a5d0-fa32a382796d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.447407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea38ea-dacf-42f8-a374-41abc087d58c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.452781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.453454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.453742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.454004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.454698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.457156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b4100-6f38-4bcd-9b95-7a3dc8b2a542 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.459867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.460780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.461112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.461391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] PATH_INFO: `/v3/projects/47e1d98e763943c88aa4b72db4a0eafd/users/c3173f7d34ef423b873960f750a94576/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.463949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e1d98e763943c88aa4b72db4a0eafd, user_id=c3173f7d34ef423b873960f750a94576, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.466074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.480598 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2436/4895] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:01 2021] PUT /identity/v3/projects/47e1d98e763943c88aa4b72db4a0eafd/users/c3173f7d34ef423b873960f750a94576/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:01.490378 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2460/4896] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:01.496111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.498136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.498676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.498953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.532271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] MFA Rules not processed for user `c3173f7d34ef423b873960f750a94576`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:01.533600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.605067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5ea5b-0af9-46c6-93a0-9b3e4a64c0eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.614820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.615946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.616693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.616972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.617947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.620062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.642984 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2437/4897] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:01.648829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.661926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8ca9-1d18-40cd-97d3-3430888ee9da admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.669043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.670039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.670403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.670784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.672497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.673954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2461/4898] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:01.677603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.685121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.688321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2438/4899] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:01.688482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.690585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.708705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6c805-086c-4b02-b8fa-1ffd0ccee448 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.715303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.716489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.717276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.717754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] PATH_INFO: `/v3/projects/e92226d03bb14d21ad97c2be5a34f4c7/users/4dc66b90c957454ab79b033e74a06654/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.735800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92226d03bb14d21ad97c2be5a34f4c7, user_id=4dc66b90c957454ab79b033e74a06654, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.738923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd92a0f-305b-42ba-bf4b-c7c1c00b984b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.761065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2439/4900] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:01 2021] PUT /identity/v3/projects/e92226d03bb14d21ad97c2be5a34f4c7/users/4dc66b90c957454ab79b033e74a06654/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:01.766508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.767004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.767484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.773122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34ad7-5126-4f02-9a82-5dd560ebbb36 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.788386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:01.789642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.840275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.841384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.841384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.841601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.843555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.873586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2440/4901] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:01.886670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:01.888197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:01.920307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.921961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb4079-63ae-4aaf-a31f-242b4e149403 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:01.937585 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2462/4902] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:01.966215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669406ab-d47b-4223-9802-79d8912a9347 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:01.971358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:01.971358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:01.971358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:01.976908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:01.989105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:01.990765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ab284-1a43-42dd-a37f-89709b2836a2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:02.005134 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2441/4903] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:03.553299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:03.553765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:03.554031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:03.595818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] MFA Rules not processed for user `4dc66b90c957454ab79b033e74a06654`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:03.597875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:03.684215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2463/4904] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:03 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:03.695547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:03.696131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:03.696131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:03.714132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] MFA Rules not processed for user `4dc66b90c957454ab79b033e74a06654`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:03.715294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:03.722144 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2442/4905] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:03 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:03.736003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:03.737423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:03.821513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202683c-d7bc-40ca-a1dc-ed4b4a6ea416 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:03.832762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:03.833590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:03.833875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:03.834241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:03.842698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:03.844296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:03.853500 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2464/4906] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:03 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:04.659091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:04.681335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22e3e5-4755-40e2-822f-92abef9e91d5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:04.685257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:04.685926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:04.686208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:04.686484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:04.779067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:04.780877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100494-333d-4533-b6c9-3316395de27f service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:04.811961 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2443/4907] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:04 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:19.437901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:19.448954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01de3f-66ad-48d0-9ca2-0c01c7ba6d0b service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:19.454013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:19.454801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:19.455081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:19.455351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] PATH_INFO: `/v3/users/f386ffa5999e4ef593908fda06e3b684` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:19.456541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f386ffa5999e4ef593908fda06e3b684)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:19.458444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:19.505338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f386ffa5999e4ef593908fda06e3b684'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:19.512132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f386ffa5999e4ef593908fda06e3b684'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:19.512883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f386ffa5999e4ef593908fda06e3b684'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:19.526048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f386ffa5999e4ef593908fda06e3b684'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:19.535923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f386ffa5999e4ef593908fda06e3b684'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:19.542455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2465/4908] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:19 2021] DELETE /identity/v3/users/f386ffa5999e4ef593908fda06e3b684 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:19.546926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:19.547426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:19.547530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:19.564778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:19.566216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:19.632787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2444/4909] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:19.642867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:19.644857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:19.701609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4818f8-bc82-4199-8ab4-1192712e69a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:19.705983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:19.707104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:19.707385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:19.707650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:19.716766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:19.718168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:19.727858 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2466/4910] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:20.086628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:20.088094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:20.102796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a96ff9-8a68-4967-ab36-e72d85bef55e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:20.108751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:20.109616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:20.109969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:20.110329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] PATH_INFO: `/v3/projects/4aac63e33be04ef8abfa5c1d42df2502` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:20.111391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aac63e33be04ef8abfa5c1d42df2502)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:20.113558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:20.158827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aac63e33be04ef8abfa5c1d42df2502', 'request_id': 'req-3911dabf-570e-423a-bf47-ff4c1277edbe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.163985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aac63e33be04ef8abfa5c1d42df2502', 'request_id': 'req-3911dabf-570e-423a-bf47-ff4c1277edbe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.169838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aac63e33be04ef8abfa5c1d42df2502', 'request_id': 'req-3911dabf-570e-423a-bf47-ff4c1277edbe'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.180954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] The token cache is being invalidate because project 4aac63e33be04ef8abfa5c1d42df2502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:20.181233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.181863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.183368 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2445/4911] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:20 2021] DELETE /identity/v3/projects/4aac63e33be04ef8abfa5c1d42df2502 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:20.187255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:20.197297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a46110-1a29-411f-a2f2-0db600238632 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:20.251609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:20.252380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:20.252686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:20.252959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] PATH_INFO: `/v3/users/c3173f7d34ef423b873960f750a94576` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:20.254621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3173f7d34ef423b873960f750a94576)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:20.256533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:20.304784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3173f7d34ef423b873960f750a94576'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.312398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3173f7d34ef423b873960f750a94576'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.313162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3173f7d34ef423b873960f750a94576'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.326607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3173f7d34ef423b873960f750a94576'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.334202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-911bea35-2031-464c-99a9-920102b4f4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3173f7d34ef423b873960f750a94576'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.341557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2467/4912] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:20 2021] DELETE /identity/v3/users/c3173f7d34ef423b873960f750a94576 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:20.693972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:20.695427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:20.724272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911dabf-570e-423a-bf47-ff4c1277edbe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:20.788773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:20.789629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:20.789912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:20.790473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] PATH_INFO: `/v3/projects/47e1d98e763943c88aa4b72db4a0eafd` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:20.791698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e1d98e763943c88aa4b72db4a0eafd)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:20.793694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:20.841173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e1d98e763943c88aa4b72db4a0eafd', 'request_id': 'req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.848706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e1d98e763943c88aa4b72db4a0eafd', 'request_id': 'req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.855261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e1d98e763943c88aa4b72db4a0eafd', 'request_id': 'req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.868555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] The token cache is being invalidate because project 47e1d98e763943c88aa4b72db4a0eafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:20.868982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.869641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:20.871171 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2446/4913] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:20 2021] DELETE /identity/v3/projects/47e1d98e763943c88aa4b72db4a0eafd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:20.876997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ededd-90b7-40e3-af12-c10025994961 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:20.877506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ededd-90b7-40e3-af12-c10025994961 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:20.877676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ededd-90b7-40e3-af12-c10025994961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:20.895621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a34ededd-90b7-40e3-af12-c10025994961 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:20.896860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a34ededd-90b7-40e3-af12-c10025994961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:20.916225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:20.918110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:20.977730 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2468/4914] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:20.986264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:20.986555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:20.986829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:20.995933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f619-a2fc-4d37-bbcc-18f9797f77e8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.000735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.002031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.002307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.002605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] PATH_INFO: `/v3/users/4dc66b90c957454ab79b033e74a06654` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.003977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc66b90c957454ab79b033e74a06654)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.005918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.007370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:21.008743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.020772 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2469/4915] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:21.023316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.032519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bb179-c3b5-4696-9d1c-c12ad1e2a9d0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.038391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.038981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.039257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.039524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.040282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:21.040581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.042203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.057525 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2470/4916] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:11:21.058573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.062829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc66b90c957454ab79b033e74a06654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.069959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc66b90c957454ab79b033e74a06654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.070673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc66b90c957454ab79b033e74a06654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.071319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc66b90c957454ab79b033e74a06654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.076440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f730f-7e13-498e-9943-e2d28a2eb9c4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.082142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc66b90c957454ab79b033e74a06654'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.083545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.089272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.091047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.091335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.092117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.094235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.102365 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2447/4917] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:20 2021] DELETE /identity/v3/users/4dc66b90c957454ab79b033e74a06654 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:21.129432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2471/4918] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:21.133848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.135515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.222176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef57c3-0919-4e1f-9b69-5c3a8ceaff4b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.287863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.288594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.288853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.289126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.289831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.291842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.314151 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2448/4919] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:21.315422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.325770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af583f6-fc4b-4387-b472-646322e39702 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.330808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.332139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.332480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.332820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.333560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.335150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.345612 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2472/4920] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:21.354326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.365831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abeb54-02ec-4d7c-b824-831b32408a97 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.370920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.372470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.372863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.373256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.374680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.376277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.379630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.381813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.388158 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2449/4921] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:21.394036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.395845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72ada-f815-4339-a1a4-671b05ba1fcb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.404046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.405032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.405368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.405662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] PATH_INFO: `/v3/projects/e92226d03bb14d21ad97c2be5a34f4c7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.408648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92226d03bb14d21ad97c2be5a34f4c7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.410253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.414354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58d37-9436-42cc-a5e0-989b1bf3526f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.423201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.424138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.424424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.424743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] PATH_INFO: `/v3/projects/9a6df547ec4e402ab9152287ae7e4212/users/32dbe2d8d5f04723bd22ba9f22383cfa/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.442991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6df547ec4e402ab9152287ae7e4212, user_id=32dbe2d8d5f04723bd22ba9f22383cfa, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.445664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa419-e224-448e-ac49-e8794e883385 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.460682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2450/4922] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:21 2021] PUT /identity/v3/projects/9a6df547ec4e402ab9152287ae7e4212/users/32dbe2d8d5f04723bd22ba9f22383cfa/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:21.463826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92226d03bb14d21ad97c2be5a34f4c7', 'request_id': 'req-7a980ac4-394a-43d8-9b97-b8c5f14999ca'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.470295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.470583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.471097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92226d03bb14d21ad97c2be5a34f4c7', 'request_id': 'req-7a980ac4-394a-43d8-9b97-b8c5f14999ca'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.471557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.478511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92226d03bb14d21ad97c2be5a34f4c7', 'request_id': 'req-7a980ac4-394a-43d8-9b97-b8c5f14999ca'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.494514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] The token cache is being invalidate because project e92226d03bb14d21ad97c2be5a34f4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:21.494808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.495453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7a980ac4-394a-43d8-9b97-b8c5f14999ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:21.497417 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2473/4923] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:21 2021] DELETE /identity/v3/projects/e92226d03bb14d21ad97c2be5a34f4c7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:21.502210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] MFA Rules not processed for user `32dbe2d8d5f04723bd22ba9f22383cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:21.503316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.505911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863d54-d5d2-4807-87f5-bdedddbe5160 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.506197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863d54-d5d2-4807-87f5-bdedddbe5160 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.506647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04863d54-d5d2-4807-87f5-bdedddbe5160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.530266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-04863d54-d5d2-4807-87f5-bdedddbe5160 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:21.531509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-04863d54-d5d2-4807-87f5-bdedddbe5160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.573776 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2451/4924] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:21.592650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.592650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.609066 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2474/4925] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:21.614110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8d91-b48a-404b-a73d-22e894e6e74e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.614469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8d91-b48a-404b-a73d-22e894e6e74e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.614810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8d91-b48a-404b-a73d-22e894e6e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.632361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-73fa8d91-b48a-404b-a73d-22e894e6e74e None None] MFA Rules not processed for user `d5f53454610e48adacc0d8a9438b546a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:21.633585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-73fa8d91-b48a-404b-a73d-22e894e6e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.654154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b690ca-02b1-466a-9420-7eda8a3c5ad0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.659843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.660494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.660933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.661079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.661767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.663622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.691398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2475/4926] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:21.694200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.694521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.694847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.695860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2452/4927] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:21.699662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.726307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:21.727502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:21.782632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586f66-1f4a-497c-872f-80d1b3b3cdef admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.787538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.788286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.788654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.789003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.789920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.792046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.810610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2476/4928] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:21.814611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.819642 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2453/4929] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:21.823110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.828157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85cb7a-3ffd-42c6-aafb-1d0279a995fc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.835560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a498-0502-47f5-9126-9e2a7bd824ed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.837898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.838593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.838872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.839143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.840429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:21.840758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.842406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.845221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.845956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.846305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.846580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.847341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.849022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.864705 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2477/4930] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:11:21.864953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2454/4931] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:21.866274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.866408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.878195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442ca39-8d02-4cfc-b6dd-b0bc0d14a139 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.878458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174a20-27d5-4ebd-ae39-cc4c440b5a76 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.884655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.885050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.885664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.885793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.885941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.886041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.886217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] PATH_INFO: `/v3/projects/ea03753b21a446ab94ffae34bf048e3e/users/6ed77f8352ab4a26b3788675ec88ca6d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.886349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:21.886945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.889012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.904172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea03753b21a446ab94ffae34bf048e3e, user_id=6ed77f8352ab4a26b3788675ec88ca6d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:21.907177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:21.920401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2478/4932] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:21.921666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.922236 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2455/4933] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:21 2021] PUT /identity/v3/projects/ea03753b21a446ab94ffae34bf048e3e/users/6ed77f8352ab4a26b3788675ec88ca6d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:21.926604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:21.993092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7059f-6eb2-4ff7-ae06-9a551a8b4660 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.994843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa722-8ec1-4acb-ac2c-2b7d8a865ced admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:21.997702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:21.998360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:21.998661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:21.998933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.000009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.000239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.001281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.001281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.001281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.001608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.002054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.004570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.013563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2456/4934] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:22.017765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.027674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ce07-cb3d-4b52-9c9c-c97c2a2035c2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.028893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2479/4935] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:21 2021] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:22.032787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.033154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.033658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.033932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.034203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] PATH_INFO: `/v3/projects/ea03753b21a446ab94ffae34bf048e3e/users/6ed77f8352ab4a26b3788675ec88ca6d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.036238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea03753b21a446ab94ffae34bf048e3e, user_id=6ed77f8352ab4a26b3788675ec88ca6d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.038838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697cd0e-4bfa-4693-bb52-b3480da05764 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.044269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891845f-e4dc-4e47-a7d1-740c5f7e31ab admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.050016 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2457/4936] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:22 2021] PUT /identity/v3/projects/ea03753b21a446ab94ffae34bf048e3e/users/6ed77f8352ab4a26b3788675ec88ca6d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:22.061137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.061641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.061926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.089385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] MFA Rules not processed for user `6ed77f8352ab4a26b3788675ec88ca6d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:22.091224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:22.112161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.113441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.113720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.114053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.115134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.116805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.127069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2480/4937] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:22 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:22.131496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.143422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3c4d-bfda-420e-b5ca-64d72be0fe17 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.149439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.150062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.150340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.150612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.151490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.153104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.163948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2458/4938] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:22 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:22.165139 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2481/4939] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:22.168941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.174240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.177085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:22.180911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d704d6d-d5d4-4d15-aa1f-53567b4476e8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.185626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.186504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.186781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.187054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] PATH_INFO: `/v3/projects/a0e01de673d84d0da7e8acbf70a5c9a5/users/7ce40b624540436da087596ab1f1fc91/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.202480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e01de673d84d0da7e8acbf70a5c9a5, user_id=7ce40b624540436da087596ab1f1fc91, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.205244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc269cc-746c-47e3-b2d1-e3fe2d977ea6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.218519 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2459/4940] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:22 2021] PUT /identity/v3/projects/a0e01de673d84d0da7e8acbf70a5c9a5/users/7ce40b624540436da087596ab1f1fc91/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:22.224230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.224588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.224965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.250007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:22.251212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:22.265765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5430ba-0dcc-4ac2-abd3-dbe65a6c715f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.326910 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2460/4941] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:22.343532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.346899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:22.351040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.351868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.352214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.352548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.442502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c68b3-9b88-491c-9fc6-8a62b9624867 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.446397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.449062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.450245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.450998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.451321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.451598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.458771 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2482/4942] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:22 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:22.467985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.470864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fad01a-ba83-4050-afa4-59042c24712d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:22.484477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2461/4943] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:22.957299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:22.977306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a5fb2-4bcb-4d06-848d-45aa05a5a2f4 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:22.981775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:22.982920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:22.983105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:22.983568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] PATH_INFO: `/v3/users/32dbe2d8d5f04723bd22ba9f22383cfa` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:22.988187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dbe2d8d5f04723bd22ba9f22383cfa)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:22.990342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.061827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dbe2d8d5f04723bd22ba9f22383cfa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:23.072585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dbe2d8d5f04723bd22ba9f22383cfa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:23.073333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dbe2d8d5f04723bd22ba9f22383cfa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:23.099326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dbe2d8d5f04723bd22ba9f22383cfa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:23.113308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dbe2d8d5f04723bd22ba9f22383cfa'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:23.125170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2483/4944] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:22 2021] DELETE /identity/v3/users/32dbe2d8d5f04723bd22ba9f22383cfa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:23.131154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4592bd-16e9-44e7-a754-bbcbaa28697d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.131685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4592bd-16e9-44e7-a754-bbcbaa28697d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.131784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4592bd-16e9-44e7-a754-bbcbaa28697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.151267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dc4592bd-16e9-44e7-a754-bbcbaa28697d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:23.152119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc4592bd-16e9-44e7-a754-bbcbaa28697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:23.216897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2462/4945] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:23.226763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.228230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:23.292389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.292739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.293019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.302830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ca6e-27f3-4f72-b497-82f6b140acda admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.307337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.309552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.309954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.310078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.321863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.324580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.331905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] MFA Rules not processed for user `7ce40b624540436da087596ab1f1fc91`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:23.333913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:23.348005 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2484/4946] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:23.498950 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2463/4947] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:23 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:23.504490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.506867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:23.535628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5f78-5589-474f-992c-da727aee6240 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.551825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.552509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.552816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.553094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.553808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.556763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.648858 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2485/4948] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:23 2021] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:23.652988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.673796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920dde-44de-47cb-8d79-a0b464143b7f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.795792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.796724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.797277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.797728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.798591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.801295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.840257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2464/4949] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:23 2021] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:23.844382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.857410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4449c7-7e84-427c-a391-c0f72e0d9b69 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.872329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.873313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.873590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.873861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.874655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.877230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.903159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.903339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2486/4950] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:23 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:23.916497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd26b-300d-4f94-9ba8-4ed844f481a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.921384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.922056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.922333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.922606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.923334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.924953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:23.937235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2465/4951] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:23.941115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:23.953221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7bbf-7bdd-401c-9478-a8a404b5db12 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:23.958490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:23.959589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:23.959922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:23.960325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] PATH_INFO: `/v3/projects/d4247ea0595a430fb40afc7341e00f87/users/1bcec0b664994efbad9f55ba596b3f01/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:23.980461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4247ea0595a430fb40afc7341e00f87, user_id=1bcec0b664994efbad9f55ba596b3f01, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:23.984209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:24.000427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:24.002639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:24.008155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2487/4952] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:23 2021] PUT /identity/v3/projects/d4247ea0595a430fb40afc7341e00f87/users/1bcec0b664994efbad9f55ba596b3f01/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:24.024066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fef692-07bf-453c-9fb4-fe1487246828 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:24.095563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:24.096641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:24.096641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:24.096865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] PATH_INFO: `/v3/projects/9a6df547ec4e402ab9152287ae7e4212` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:24.098653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6df547ec4e402ab9152287ae7e4212)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:24.100672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:24.170647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6df547ec4e402ab9152287ae7e4212', 'request_id': 'req-ff7d1fc8-476d-41fa-900a-2c8011d0b841'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.177475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6df547ec4e402ab9152287ae7e4212', 'request_id': 'req-ff7d1fc8-476d-41fa-900a-2c8011d0b841'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.184329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6df547ec4e402ab9152287ae7e4212', 'request_id': 'req-ff7d1fc8-476d-41fa-900a-2c8011d0b841'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.199227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] The token cache is being invalidate because project 9a6df547ec4e402ab9152287ae7e4212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:24.199599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.201952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.204240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2466/4953] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:23 2021] DELETE /identity/v3/projects/9a6df547ec4e402ab9152287ae7e4212 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:24.208755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:24.210610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:24.226382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338117a-536f-4bdd-9c62-62dac5e2ac67 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:24.314789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:24.315604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:24.316016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:24.316365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] PATH_INFO: `/v3/users/6ed77f8352ab4a26b3788675ec88ca6d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:24.318163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed77f8352ab4a26b3788675ec88ca6d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:24.319794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:24.371177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed77f8352ab4a26b3788675ec88ca6d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.378095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed77f8352ab4a26b3788675ec88ca6d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.379369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed77f8352ab4a26b3788675ec88ca6d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.396279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed77f8352ab4a26b3788675ec88ca6d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.406414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-638355f2-721b-49ea-bd64-55a29fafad32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed77f8352ab4a26b3788675ec88ca6d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.413897 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2488/4954] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:24 2021] DELETE /identity/v3/users/6ed77f8352ab4a26b3788675ec88ca6d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:24.715239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:24.728032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d1fc8-476d-41fa-900a-2c8011d0b841 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:24.811492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:24.811492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:24.811789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:24.811988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] PATH_INFO: `/v3/projects/ea03753b21a446ab94ffae34bf048e3e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:24.813375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea03753b21a446ab94ffae34bf048e3e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:24.815304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:24.864820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea03753b21a446ab94ffae34bf048e3e', 'request_id': 'req-c214bd40-614e-48a4-a62b-518acbe72949'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.870070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea03753b21a446ab94ffae34bf048e3e', 'request_id': 'req-c214bd40-614e-48a4-a62b-518acbe72949'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.876219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea03753b21a446ab94ffae34bf048e3e', 'request_id': 'req-c214bd40-614e-48a4-a62b-518acbe72949'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.891500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] The token cache is being invalidate because project ea03753b21a446ab94ffae34bf048e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:24.891790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.892445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c214bd40-614e-48a4-a62b-518acbe72949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:24.894138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2467/4955] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:24 2021] DELETE /identity/v3/projects/ea03753b21a446ab94ffae34bf048e3e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:24.899798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:24.900042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:24.900319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:24.919059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:24.920519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.004954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2489/4956] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:25.006855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.007153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.007497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.032436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:25.033875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.046891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2468/4957] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:25.048285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.060084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0640-5320-40a4-9609-3c2fc8139306 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.065811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.067175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.067456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.067726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.069022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:25.069022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.070363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.084696 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2490/4958] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:25.087738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.121128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a886ea-cdcf-455b-95c8-2824a024d84e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.146550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.148116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.150735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.150735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.158110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.160732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028de21-e5d3-4afb-95a4-46ae21981f9e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.227155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2469/4959] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:25.231312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.241629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875faad-5d0a-411f-b4a8-a25ccf3cd5ae None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.242226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875faad-5d0a-411f-b4a8-a25ccf3cd5ae None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.244532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485c05-2dc8-4845-b305-e8ebbf4189ec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.246215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875faad-5d0a-411f-b4a8-a25ccf3cd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.278284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8875faad-5d0a-411f-b4a8-a25ccf3cd5ae None None] MFA Rules not processed for user `1bcec0b664994efbad9f55ba596b3f01`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:25.279621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8875faad-5d0a-411f-b4a8-a25ccf3cd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.335419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.336098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.336593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.336904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.337988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.339539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.365207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2470/4960] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:25.374725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.375175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.375524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.382138 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2491/4961] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:25.383241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.398048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] MFA Rules not processed for user `7ce40b624540436da087596ab1f1fc91`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:25.399782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.400301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ff53c-60ca-4030-bb88-315d82e5d334 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.405650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.406499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.406854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.407137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.408052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.410898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.425089 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2492/4962] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:25.427013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.437502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bd02-aab6-4fcc-8e47-4e9b2b236cc1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.444067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.444785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.445431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.445431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.446259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.452415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.465056 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2493/4963] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:25.469230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.484318 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2471/4964] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:25.484569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d8de-8568-4dc5-929e-963da81bc8a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.489716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.490618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.490897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.491170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] PATH_INFO: `/v3/projects/4d111073119c42b0b6837eaa3e2e210c/users/14f04017c3714c78be8ccb5cecaf7f63/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.493962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.498053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.513593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d111073119c42b0b6837eaa3e2e210c, user_id=14f04017c3714c78be8ccb5cecaf7f63, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.516268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a233b-8a4b-4ecc-b75f-82f05eb82818 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.534000 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2494/4965] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:25 2021] PUT /identity/v3/projects/4d111073119c42b0b6837eaa3e2e210c/users/14f04017c3714c78be8ccb5cecaf7f63/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:25.546830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.547981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.548957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.581940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] MFA Rules not processed for user `14f04017c3714c78be8ccb5cecaf7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:25.583288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76117f6-c240-4ba4-859a-82b172d515ac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.583732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.651378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.652070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.652351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.652644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.656892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2495/4966] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:25.657649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:25.657771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.733912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.736455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.746936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f98dc-4e1d-45fd-bdde-79eb3ede8b0b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.749788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2472/4967] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:25 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:25.752276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.753207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.753877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.754228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.755015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.757033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.787439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2496/4968] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:25.791826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.807928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2830e-c7a8-4b7e-9efa-2a83d8e45e7e service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.881400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.882186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.882459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.883734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.884798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.887039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.908365 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2473/4969] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:25 2021] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:25.912592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:25.931657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0b123-02de-4964-85ee-78c37954030b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:25.941104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:25.943477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:25.945415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:25.945997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:25.948312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:25.949980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:25.993553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2497/4970] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:25 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:25.996434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:26.009737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352dfff-2653-4dfd-bc23-b7d89b82139d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:26.015656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:26.016552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:26.017554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:26.017841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] PATH_INFO: `/v3/projects/1f4ad68483d54bf0950b264b58c21ff1/users/ccc1488151ed481b982cf431f92aa0fa/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:26.036954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4ad68483d54bf0950b264b58c21ff1, user_id=ccc1488151ed481b982cf431f92aa0fa, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:26.039786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:26.056453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2474/4971] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:25 2021] PUT /identity/v3/projects/1f4ad68483d54bf0950b264b58c21ff1/users/ccc1488151ed481b982cf431f92aa0fa/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:26.060475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:26.073681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed79bdc-6f9c-42bb-a757-6f40a3e7bdcb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:26.158509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:26.159198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:26.160222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:26.160336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:26.161193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:26.162870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4007c-d24a-4f76-bd81-5120c242b6a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:26.174498 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2498/4972] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:26 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:26.179156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:26.190602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1d1a-6c3c-49b6-962f-ac2914fddcdb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:26.195776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:26.196707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:26.196989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:26.197262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] PATH_INFO: `/v3/projects/1f4ad68483d54bf0950b264b58c21ff1/users/ccc1488151ed481b982cf431f92aa0fa/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:26.199257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4ad68483d54bf0950b264b58c21ff1, user_id=ccc1488151ed481b982cf431f92aa0fa, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:26.202640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:26.213515 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2475/4973] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:26 2021] PUT /identity/v3/projects/1f4ad68483d54bf0950b264b58c21ff1/users/ccc1488151ed481b982cf431f92aa0fa/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:26.224214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:26.226129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:26.232327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:26.262896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] MFA Rules not processed for user `ccc1488151ed481b982cf431f92aa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:26.264515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:26.344910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2499/4974] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:26 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:26.355748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:26.357829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:26.424125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0bcb4-1398-4df1-8b34-0b02f3cd37f3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:26.432799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:26.433732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:26.434237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:26.434719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:26.515744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:26.517886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:26.531607 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2476/4975] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:26 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:30.854256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:30.855845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:30.869646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b302-e5fe-4e1f-9cce-9420083a83b2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:30.873187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:30.874044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:30.874475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:30.875006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:30.887023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:30.888927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b9fa-8e55-4ff7-81ff-4037480182e9 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:30.900361 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2500/4976] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:30 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:35.866225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:35.951734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe3c81-b612-4a23-9fd8-0e65c936c03b service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:35.958618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:35.962573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:35.963168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:35.963995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] PATH_INFO: `/v3/users/14f04017c3714c78be8ccb5cecaf7f63` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:35.965645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f04017c3714c78be8ccb5cecaf7f63)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:35.968840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:36.077557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f04017c3714c78be8ccb5cecaf7f63'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:36.086319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f04017c3714c78be8ccb5cecaf7f63'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:36.087981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f04017c3714c78be8ccb5cecaf7f63'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:36.091018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f04017c3714c78be8ccb5cecaf7f63'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:36.103014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f04017c3714c78be8ccb5cecaf7f63'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:36.127546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2477/4977] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:35 2021] DELETE /identity/v3/users/14f04017c3714c78be8ccb5cecaf7f63 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:36.132433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:36.132974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:36.133090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:36.162330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:36.163544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:36.228165 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2501/4978] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:36.238635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:36.240088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:36.299594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea3ec-10c0-4edc-b14e-6584c383eb75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:36.304020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:36.304693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:36.304972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:36.305241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:36.314236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:36.315673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:36.325042 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2478/4979] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:36.930155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:36.932601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:36.955852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2f7fa-ac71-4713-b33f-ad72192c3467 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:36.976181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:36.977197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:36.977708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:36.978201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] PATH_INFO: `/v3/projects/4d111073119c42b0b6837eaa3e2e210c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:36.981080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d111073119c42b0b6837eaa3e2e210c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:36.983318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:37.080088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d111073119c42b0b6837eaa3e2e210c', 'request_id': 'req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.089075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d111073119c42b0b6837eaa3e2e210c', 'request_id': 'req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.101851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d111073119c42b0b6837eaa3e2e210c', 'request_id': 'req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.122056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] The token cache is being invalidate because project 4d111073119c42b0b6837eaa3e2e210c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:37.122912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.123773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.129721 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2502/4980] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:36 2021] DELETE /identity/v3/projects/4d111073119c42b0b6837eaa3e2e210c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:37.130132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:37.147843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376e24-591c-466e-bb9b-55024786beee service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:37.236969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:37.243595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:37.243893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:37.244176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] PATH_INFO: `/v3/users/ccc1488151ed481b982cf431f92aa0fa` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:37.245563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc1488151ed481b982cf431f92aa0fa)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:37.247764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:37.320766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc1488151ed481b982cf431f92aa0fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.337944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc1488151ed481b982cf431f92aa0fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.344500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc1488151ed481b982cf431f92aa0fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.345250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc1488151ed481b982cf431f92aa0fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.363740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc1488151ed481b982cf431f92aa0fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:37.388399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2479/4981] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:37 2021] DELETE /identity/v3/users/ccc1488151ed481b982cf431f92aa0fa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:37.768032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:37.772412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:37.888827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda79bf-6c0e-43f5-a3ac-f359d3e13310 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:37.963653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:37.965340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:37.996716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:37.996716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:37.996716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:37.996716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.001570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.045447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75e00-f062-42da-9ad9-e924c48bfe0d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.050691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.051759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.052036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.052460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] PATH_INFO: `/v3/users/0f5c8838662b4cfcafe4ddb79e088046` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.053886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5c8838662b4cfcafe4ddb79e088046)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.055783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.098952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.101366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.113734 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2503/4982] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:37 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:38.114741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.116224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.133555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5c8838662b4cfcafe4ddb79e088046'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.137774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ce4e-c68e-4ca9-b9f3-b5532ab080c5 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.144512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5c8838662b4cfcafe4ddb79e088046'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.145268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5c8838662b4cfcafe4ddb79e088046'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.145883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5c8838662b4cfcafe4ddb79e088046'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.150704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.152087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.152242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.152665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] PATH_INFO: `/v3/projects/1f4ad68483d54bf0950b264b58c21ff1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.154081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4ad68483d54bf0950b264b58c21ff1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.156808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d24402f9-d873-47d0-a940-fdbefb552836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5c8838662b4cfcafe4ddb79e088046'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.156971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.185629 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2480/4983] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:37 2021] DELETE /identity/v3/users/0f5c8838662b4cfcafe4ddb79e088046 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:38.244158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4ad68483d54bf0950b264b58c21ff1', 'request_id': 'req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.250720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4ad68483d54bf0950b264b58c21ff1', 'request_id': 'req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.260164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4ad68483d54bf0950b264b58c21ff1', 'request_id': 'req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.279242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] The token cache is being invalidate because project 1f4ad68483d54bf0950b264b58c21ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:38.279631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.280487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5fa2e493-a1cb-4c26-b0bc-9e594d1044d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.282350 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2504/4984] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:38 2021] DELETE /identity/v3/projects/1f4ad68483d54bf0950b264b58c21ff1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:38.292792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.293431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.293941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.316347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:38.317860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.419099 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2481/4985] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:38.428448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.428764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.429044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.454464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:38.455738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.467142 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2505/4986] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:38.468387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.478501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebbb02-16e0-4e47-8ee7-4b052c617370 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.483875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.484539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.484850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.485125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.485862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:38.486167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.488322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.500453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.500834 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2482/4987] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:38.505571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.505734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.525485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71127158-dc7f-4c04-b578-2b844c738855 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.526857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5fb6a-82d9-4dd4-9f90-6698003421d1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.538582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.538939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.539599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.539825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.539908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.540067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.540174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.540524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] PATH_INFO: `/v3/projects/c85b5e83c6fc491b9880ca7481937aee` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.540987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.542089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85b5e83c6fc491b9880ca7481937aee)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.543186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.544223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.578649 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2483/4988] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:38.582721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.601721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85b5e83c6fc491b9880ca7481937aee', 'request_id': 'req-00ab3af1-acc0-4d14-8006-fd989e5db522'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.608772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85b5e83c6fc491b9880ca7481937aee', 'request_id': 'req-00ab3af1-acc0-4d14-8006-fd989e5db522'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.616254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85b5e83c6fc491b9880ca7481937aee', 'request_id': 'req-00ab3af1-acc0-4d14-8006-fd989e5db522'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.629184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] The token cache is being invalidate because project c85b5e83c6fc491b9880ca7481937aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:38.629470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.630254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-00ab3af1-acc0-4d14-8006-fd989e5db522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:38.631819 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2506/4989] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:38 2021] DELETE /identity/v3/projects/c85b5e83c6fc491b9880ca7481937aee => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:38.638202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70e9-5c64-4a08-8cb1-43e002be45d6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.638687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70e9-5c64-4a08-8cb1-43e002be45d6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.639120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a70e9-5c64-4a08-8cb1-43e002be45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.660007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ee603-ea4a-4bc6-8e9a-6f09305ee847 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.661539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-134a70e9-5c64-4a08-8cb1-43e002be45d6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:38.662757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-134a70e9-5c64-4a08-8cb1-43e002be45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.730118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.730801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.731076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.731349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.732051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.733991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.742568 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2507/4990] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:38.751272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.751545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.751880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.769569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2484/4991] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:38.772965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.773496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:38.775229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.775351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:38.787625 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2508/4992] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:38.788737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.792660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218bc8-8d0e-4831-9fe3-5164a0e93875 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.798253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce697eb-ad84-4b27-a3af-8e1d1223edcd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.799235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.799957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.800242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.800516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.801292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.802879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.803597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.804264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.804576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.804877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.805737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:38.806058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.807754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.816595 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2485/4993] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:38 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:38.824731 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2509/4994] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:38.825150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.826309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.839749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763102ee-2529-4acd-9efa-975c85bb8e51 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.846038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca1f4-ce8a-4f22-ad1f-eb55bd4fb075 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.850217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.850967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.851393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.851769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.852514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.853572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.854349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.854476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.854805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.855152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.855930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.857910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.872221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2486/4995] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:38 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:38.874121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.885877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affefa77-120d-4281-b26d-5aa2be491e9b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.888359 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2510/4996] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:38.892212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.945493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.946373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.946653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.946927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] PATH_INFO: `/v3/projects/cc7f372711464978ab97a20f3bbfa870/users/f9ea12f76e8644368b2f7d55beed93eb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.954660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b450b0-cec8-435d-bafc-2fcb4a0624c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:38.960769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:38.961564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.961815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7f372711464978ab97a20f3bbfa870, user_id=f9ea12f76e8644368b2f7d55beed93eb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.961921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.962112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:38.962810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:38.964413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.964874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146782-42fd-460f-9501-81878c5ad494 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:38.978179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2487/4997] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:38 2021] PUT /identity/v3/projects/cc7f372711464978ab97a20f3bbfa870/users/f9ea12f76e8644368b2f7d55beed93eb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:38.984076 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2511/4998] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:38.990020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:38.990576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:38.990899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:38.991152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.017450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] MFA Rules not processed for user `f9ea12f76e8644368b2f7d55beed93eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:39.018678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:39.049185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e47f-302f-49b6-83ce-7dca37c7a190 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.055172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.055831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.056192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.056474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.057254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.058809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.068557 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2488/4999] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:38 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:39.072490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.083315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecaaaf-a019-4d1c-bf93-2df1e1d3db98 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.087402 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2512/5000] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:39.087963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.088551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.089241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.089523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.089800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.090559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.092123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.098809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed8ba-1006-4108-8d09-2d3a5e967cbb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.105630 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2489/5001] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:39.105771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.105771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.105771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.105771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.106155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.106656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.107266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.116651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80592d-6b34-449e-ba5b-9b0fb51b41fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.121264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.122116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.122549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.122670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] PATH_INFO: `/v3/projects/3a4353009c9e414fb3415e98df1fe1ae/users/202de6cb73e547f8a449898bf46a05fc/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.132741 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2513/5002] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:39 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:39.136695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.137541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4353009c9e414fb3415e98df1fe1ae, user_id=202de6cb73e547f8a449898bf46a05fc, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.140198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f7c5-3d7e-41b3-81b2-a41f9eb9de93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.153278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2490/5003] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:39 2021] PUT /identity/v3/projects/3a4353009c9e414fb3415e98df1fe1ae/users/202de6cb73e547f8a449898bf46a05fc/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:39.158771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13218001-b68b-433d-bb82-0921d556392d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.160409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13218001-b68b-433d-bb82-0921d556392d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.160901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13218001-b68b-433d-bb82-0921d556392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.179597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-13218001-b68b-433d-bb82-0921d556392d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:39.180813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-13218001-b68b-433d-bb82-0921d556392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:39.198393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e6f4-e2fd-4ed6-af4f-d87ebe3585e6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.240500 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2491/5004] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:39.250650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13218001-b68b-433d-bb82-0921d556392d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.252026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-13218001-b68b-433d-bb82-0921d556392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:39.260723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.261395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.261669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.261943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.262630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.264551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.284850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2514/5005] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:39 2021] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:11:39.288749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.303971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf832e-ba95-4de1-9aa0-8acdb99d162b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.309897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.311055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13218001-b68b-433d-bb82-0921d556392d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.311372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.311930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.312364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.314010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.314994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.315950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.316235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.316538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.316698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.328061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.329871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.340743 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2492/5006] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:39.341214 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2515/5007] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:39 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:39.341566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.355270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cb105-8006-4e86-ad9d-a4e9f20536c2 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.364472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.365443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.365771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.365993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] PATH_INFO: `/v3/projects/f8ba410d7c29463292660695cc59d1f1/users/d41ebd1841c0434384e78b29fc7d6023/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.382942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ba410d7c29463292660695cc59d1f1, user_id=d41ebd1841c0434384e78b29fc7d6023, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.385985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.405104 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2493/5008] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:39 2021] PUT /identity/v3/projects/f8ba410d7c29463292660695cc59d1f1/users/d41ebd1841c0434384e78b29fc7d6023/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:39.409639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.424219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4ac9-9e47-411a-8d4d-7d8bd31a9020 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.505258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.505988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.506322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.506747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.507699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.510243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3361ca-998e-450e-9a9f-809cca21b2f0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.531691 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2516/5009] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:39 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:39.533124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.547853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf20d8-d9b1-4343-84b2-031b8b96c0be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.554230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.555614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.556062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.556354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] PATH_INFO: `/v3/projects/f8ba410d7c29463292660695cc59d1f1/users/d41ebd1841c0434384e78b29fc7d6023/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.558899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ba410d7c29463292660695cc59d1f1, user_id=d41ebd1841c0434384e78b29fc7d6023, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:39.561986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:39.576225 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2494/5010] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:39 2021] PUT /identity/v3/projects/f8ba410d7c29463292660695cc59d1f1/users/d41ebd1841c0434384e78b29fc7d6023/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:39.592698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.593794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.594449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:39.628124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] MFA Rules not processed for user `d41ebd1841c0434384e78b29fc7d6023`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:39.629574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:39.729209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2517/5011] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:39 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:39.740968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:39.743793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:39.866503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055350-7744-486b-9300-8b17dc2a815a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:39.880264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:39.882718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:39.883005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:39.883288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:40.016134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:40.017937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c2bd8-16e4-40b0-8816-e6df0f7a0219 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:40.029377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2495/5012] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:42.829641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:42.953271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2933-c062-4070-80a4-191d828cf23c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:42.961990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:42.964082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:42.964377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:42.969963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] PATH_INFO: `/v3/users/f9ea12f76e8644368b2f7d55beed93eb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:42.971018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ea12f76e8644368b2f7d55beed93eb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:42.975561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:43.066486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ea12f76e8644368b2f7d55beed93eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.075604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ea12f76e8644368b2f7d55beed93eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.077248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ea12f76e8644368b2f7d55beed93eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.095228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ea12f76e8644368b2f7d55beed93eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.107633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ea12f76e8644368b2f7d55beed93eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.124533 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2518/5013] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:42 2021] DELETE /identity/v3/users/f9ea12f76e8644368b2f7d55beed93eb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:43.126305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:43.126815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:43.126940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:43.155588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:43.157867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:43.169831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:43.172148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:43.349255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2496/5014] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:43.355463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f78f1-18b1-4d2c-9238-7900815e23a3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:43.361150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:43.364559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:43.373846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:43.375059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:43.375403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:43.375749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] PATH_INFO: `/v3/users/d5f53454610e48adacc0d8a9438b546a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:43.377266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f53454610e48adacc0d8a9438b546a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:43.380224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:43.444222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbf8eb-8e62-4484-bf03-48367ed23b43 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:43.451417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:43.452534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:43.453192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:43.453321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:43.466815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:43.468243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f53454610e48adacc0d8a9438b546a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.473747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:43.476722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f53454610e48adacc0d8a9438b546a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.477616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f53454610e48adacc0d8a9438b546a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.489806 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2497/5015] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:43.514964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f53454610e48adacc0d8a9438b546a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.529912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d4e519c2-28e2-4b4f-a214-7aac575c3b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f53454610e48adacc0d8a9438b546a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:43.544847 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2519/5016] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:43 2021] DELETE /identity/v3/users/d5f53454610e48adacc0d8a9438b546a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:44.088947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.101075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381defd-dc70-485c-a9e7-3a329021678b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:44.176355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:44.177437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.177809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.178181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] PATH_INFO: `/v3/projects/7831ef525ec34d88ae73dc994fe9ba51` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.179472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7831ef525ec34d88ae73dc994fe9ba51)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:44.181833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:44.240299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7831ef525ec34d88ae73dc994fe9ba51', 'request_id': 'req-27ef370d-fd78-4d70-918d-b37e9b3c37b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.247397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7831ef525ec34d88ae73dc994fe9ba51', 'request_id': 'req-27ef370d-fd78-4d70-918d-b37e9b3c37b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.258133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7831ef525ec34d88ae73dc994fe9ba51', 'request_id': 'req-27ef370d-fd78-4d70-918d-b37e9b3c37b2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.279289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] The token cache is being invalidate because project 7831ef525ec34d88ae73dc994fe9ba51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:44.280630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.281552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.284829 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2498/5017] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:44 2021] DELETE /identity/v3/projects/7831ef525ec34d88ae73dc994fe9ba51 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:44.290342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a247-3249-4622-b8ba-a3d150a9085a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.291420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a247-3249-4622-b8ba-a3d150a9085a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.291934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a247-3249-4622-b8ba-a3d150a9085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.317006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.318607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.327376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dda5a247-3249-4622-b8ba-a3d150a9085a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:44.331759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dda5a247-3249-4622-b8ba-a3d150a9085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.428452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef370d-fd78-4d70-918d-b37e9b3c37b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:44.436650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:44.438336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.438769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.439195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] PATH_INFO: `/v3/projects/cc7f372711464978ab97a20f3bbfa870` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.446855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2520/5018] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:44.447064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7f372711464978ab97a20f3bbfa870)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:44.447064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:44.449064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.449451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.449816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.494197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:44.497900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.522613 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2521/5019] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:44.524666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.539412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52320-f0db-411e-8425-1045bf4821ba None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:44.542336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7f372711464978ab97a20f3bbfa870', 'request_id': 'req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.555669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7f372711464978ab97a20f3bbfa870', 'request_id': 'req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.564558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7f372711464978ab97a20f3bbfa870', 'request_id': 'req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.589883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] The token cache is being invalidate because project cc7f372711464978ab97a20f3bbfa870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:44.593217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.594078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.600205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2499/5020] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:44 2021] DELETE /identity/v3/projects/cc7f372711464978ab97a20f3bbfa870 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:44.602084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.604370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.619661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:44.620568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.621019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.621695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.622633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:44.623085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:44.625775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:44.664883 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2522/5021] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:44.666084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.669479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.688566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9d8c-bfef-472c-b8b3-df8dd9cff85e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:44.691229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf29fd-62b0-4b06-95e9-8cb368adbc3d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:44.695879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:44.697009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.697285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.697552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] PATH_INFO: `/v3/users/7ce40b624540436da087596ab1f1fc91` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.697685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:44.698807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce40b624540436da087596ab1f1fc91)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:44.699095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:44.699487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:44.699882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] PATH_INFO: `/v3/users/d41ebd1841c0434384e78b29fc7d6023` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:44.701891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41ebd1841c0434384e78b29fc7d6023)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:44.702176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:44.705260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:44.782048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41ebd1841c0434384e78b29fc7d6023'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.789360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce40b624540436da087596ab1f1fc91'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.798179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce40b624540436da087596ab1f1fc91'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.799076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce40b624540436da087596ab1f1fc91'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.799343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41ebd1841c0434384e78b29fc7d6023'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.805215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41ebd1841c0434384e78b29fc7d6023'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.809766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41ebd1841c0434384e78b29fc7d6023'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.822571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41ebd1841c0434384e78b29fc7d6023'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.836298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce40b624540436da087596ab1f1fc91'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.848384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce40b624540436da087596ab1f1fc91'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:44.858380 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2523/5022] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:44 2021] DELETE /identity/v3/users/7ce40b624540436da087596ab1f1fc91 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:44.859435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:44.861077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:44.866561 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2500/5023] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:44 2021] DELETE /identity/v3/users/d41ebd1841c0434384e78b29fc7d6023 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:44.990660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36746c8-f8bb-4b80-8c09-433190ea0e28 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.127273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.130537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.130945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.131321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.132179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.134306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.180363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2524/5024] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:44 2021] POST /identity/v3/projects => generated 397 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:45.185269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.187185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:45.218919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14255fdc-e658-40ce-9b27-a75cb3faff9f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.293652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.296441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:45.320971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.321696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.322044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.322383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.323395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.326837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.366189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2501/5025] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:45 2021] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:45.373857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.397945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e47e-8a26-4a99-aadb-c651cc8fa6a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.411906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.412177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.412299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.412625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.413368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.415087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.435456 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2502/5026] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:45 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:45.436107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.447746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66426a1-3b5f-456a-91d3-107edfe7535b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.459225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706a2a-9c01-4755-9dea-821a4da86891 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.479748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.480876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.481031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.481326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.483047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.486462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.492034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.493201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.495465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.495909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] PATH_INFO: `/v3/projects/a0e01de673d84d0da7e8acbf70a5c9a5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.504175 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2503/5027] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:45 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:45.509436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e01de673d84d0da7e8acbf70a5c9a5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.510386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.513694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.544180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f2bb-c032-4301-8a3c-2d489d6d6ff2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.562539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.563445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.563740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.563983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] PATH_INFO: `/v3/projects/761af007cf944b249f138d8190887b90/users/ae6eacec94864a57807646b3b537df6c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.611653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761af007cf944b249f138d8190887b90, user_id=ae6eacec94864a57807646b3b537df6c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.640304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef5655-b40a-4165-b731-ece7dc7a18d0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:45.642028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e01de673d84d0da7e8acbf70a5c9a5', 'request_id': 'req-48071965-5113-464a-a0b7-038c2e3fd974'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:45.650881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e01de673d84d0da7e8acbf70a5c9a5', 'request_id': 'req-48071965-5113-464a-a0b7-038c2e3fd974'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:45.694170 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2504/5028] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:45 2021] PUT /identity/v3/projects/761af007cf944b249f138d8190887b90/users/ae6eacec94864a57807646b3b537df6c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:45.696674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.696674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.696903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.704096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e01de673d84d0da7e8acbf70a5c9a5', 'request_id': 'req-48071965-5113-464a-a0b7-038c2e3fd974'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:45.728402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] The token cache is being invalidate because project a0e01de673d84d0da7e8acbf70a5c9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:45.729280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:45.730701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:45.733148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2525/5029] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:45 2021] DELETE /identity/v3/projects/a0e01de673d84d0da7e8acbf70a5c9a5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:45.734310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.739685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:45.765950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:45.767637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:45.905620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071965-5113-464a-a0b7-038c2e3fd974 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.916788 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2505/5030] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:45.917718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:45.928596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:45.944796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336dba-ff75-4332-ad59-e0d1fa06e7dd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:45.953130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:45.954123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:45.954948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:45.955235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] PATH_INFO: `/v3/users/1bcec0b664994efbad9f55ba596b3f01` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:45.959143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcec0b664994efbad9f55ba596b3f01)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:45.962874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.037046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.038033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.038245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.038452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] PATH_INFO: `/v3/projects/f8ba410d7c29463292660695cc59d1f1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.040067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ba410d7c29463292660695cc59d1f1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.042177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.056421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcec0b664994efbad9f55ba596b3f01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.067817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcec0b664994efbad9f55ba596b3f01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.070040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcec0b664994efbad9f55ba596b3f01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.071061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcec0b664994efbad9f55ba596b3f01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.083653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcec0b664994efbad9f55ba596b3f01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.111245 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2506/5031] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:45 2021] DELETE /identity/v3/users/1bcec0b664994efbad9f55ba596b3f01 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:46.115642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.118264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.147378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ba410d7c29463292660695cc59d1f1', 'request_id': 'req-ead554d8-5997-4e4b-82c2-e035fb39aa45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.160103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ba410d7c29463292660695cc59d1f1', 'request_id': 'req-ead554d8-5997-4e4b-82c2-e035fb39aa45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.169800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ba410d7c29463292660695cc59d1f1', 'request_id': 'req-ead554d8-5997-4e4b-82c2-e035fb39aa45'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.201730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] The token cache is being invalidate because project f8ba410d7c29463292660695cc59d1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:46.203453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.203606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ead554d8-5997-4e4b-82c2-e035fb39aa45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.206887 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2526/5032] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:45 2021] DELETE /identity/v3/projects/f8ba410d7c29463292660695cc59d1f1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:46.237898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3677c-7874-4eb3-b53c-ec19ddfeb43d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.238757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3677c-7874-4eb3-b53c-ec19ddfeb43d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.239637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3677c-7874-4eb3-b53c-ec19ddfeb43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.256396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550fdb-9fa5-43e3-9b97-abe77a3da361 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:46.270529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.271408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.271692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.271967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.278730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.295501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-72b3677c-7874-4eb3-b53c-ec19ddfeb43d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:46.303699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-72b3677c-7874-4eb3-b53c-ec19ddfeb43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.457529 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2527/5033] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:46.462752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.466176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.466893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.467701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.475620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.496474 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2507/5034] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:46.518002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:46.522414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.534565 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2528/5035] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:46.541946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.550649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.560413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e92e4-0490-41f1-8122-55670ee0ca83 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:46.567624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.579088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.579643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.579928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.580205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.581010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:46.581320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.583198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.586415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ddb25-7582-4fca-b879-0eff3f4c213d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:46.597813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.599282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.599282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.599688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] PATH_INFO: `/v3/projects/d4247ea0595a430fb40afc7341e00f87` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.601443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4247ea0595a430fb40afc7341e00f87)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.603775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.622688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2508/5036] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:46.627490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.643104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40073015-6882-4fb7-af5c-161d1fa0b8f6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:46.663402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.664271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.664560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.664842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.665886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.675265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.722596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4247ea0595a430fb40afc7341e00f87', 'request_id': 'req-ceec6705-291c-4dc9-9159-9fb32e227a23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.731467 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2509/5037] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:46.735873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.736560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4247ea0595a430fb40afc7341e00f87', 'request_id': 'req-ceec6705-291c-4dc9-9159-9fb32e227a23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.749279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4247ea0595a430fb40afc7341e00f87', 'request_id': 'req-ceec6705-291c-4dc9-9159-9fb32e227a23'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.779908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] The token cache is being invalidate because project d4247ea0595a430fb40afc7341e00f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:46.780346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.784508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ceec6705-291c-4dc9-9159-9fb32e227a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:46.786465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2529/5038] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:46 2021] DELETE /identity/v3/projects/d4247ea0595a430fb40afc7341e00f87 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:46.794597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79262-c003-404a-9ea8-cabdba29f1df None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.795140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79262-c003-404a-9ea8-cabdba29f1df None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.795424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79262-c003-404a-9ea8-cabdba29f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.831166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-87b79262-c003-404a-9ea8-cabdba29f1df None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:46.832316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87b79262-c003-404a-9ea8-cabdba29f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.876914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521c2a-2bc6-46b8-9ecb-97c523c9ce54 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:46.896792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:46.913740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.914488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.914783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.915552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:46.920316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:46.953819 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2510/5039] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:46.958395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:46.960954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:46.973864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2530/5040] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:11:46.976018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:46.976304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:46.976576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:46.995136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de048f41-3734-4531-8934-33a7208be7d2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.010094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.010978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.011214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.011431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.011562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.012734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.013139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.014581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.022931 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2531/5041] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:47.029298 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2511/5042] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:46 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:47.029482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.030836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.041661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81c26d-aa1a-47b7-ac14-9580155c4bd1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.048123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.048920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.049265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.050193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.051307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:47.051882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.053870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.054623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6944-9594-4477-9823-9fdb89f7e8e8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.060923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.061755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.062303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.062583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.063325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.064942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6323b0-60df-4628-a39c-8cdc1be6e146 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.080254 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2512/5043] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:47.080254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.080254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.080699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.095809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2532/5044] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:11:47.097287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.116244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] MFA Rules not processed for user `202de6cb73e547f8a449898bf46a05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.117688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.128721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9103-29cd-4ac9-96d8-1a44aa10ff3d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.135399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.136447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.138218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.139787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] PATH_INFO: `/v3/projects/2b98bfb2b28b4262b875f96bd53c342b/users/a6496c28abe44d83a98e4ce5461b398d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.183206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b98bfb2b28b4262b875f96bd53c342b, user_id=a6496c28abe44d83a98e4ce5461b398d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.185946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.222460 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2513/5045] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:47.223450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.230229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2533/5046] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:47 2021] PUT /identity/v3/projects/2b98bfb2b28b4262b875f96bd53c342b/users/a6496c28abe44d83a98e4ce5461b398d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:47.233835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.241157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.246874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9242274-6c50-4b15-b7af-8b97701d17a2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.336011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73308-c584-4d03-89c1-834c30748718 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.336556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.337135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.337243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.337494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.338234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.340254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e219-f6a2-4ebc-9b84-b9d05b5a7586 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.341500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.342242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.342618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.342984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.376540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2514/5047] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:47.378846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.379486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.379929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.417634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.419076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.420533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] MFA Rules not processed for user `a6496c28abe44d83a98e4ce5461b398d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.422600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.429739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2534/5048] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:47.430293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.442267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aafd1-53eb-470f-b1b4-bbcc3cbd2341 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.509756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.511596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.511874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.512833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.514072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.516503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.517114 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2515/5049] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:47.530330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.531868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.551438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2535/5050] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:47.555266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.573645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc681c8-6022-4c8a-a03a-b1ad703de6c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.587660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.588803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.589663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.590092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.590899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.593241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1869-6b7d-4dc1-8fae-8231ebb224b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.607484 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2536/5051] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:11:47.609299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3c02-61f1-4b5e-b85a-fa719af8a420 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.609650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3c02-61f1-4b5e-b85a-fa719af8a420 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.609930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3c02-61f1-4b5e-b85a-fa719af8a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.653523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-26bd3c02-61f1-4b5e-b85a-fa719af8a420 None None] MFA Rules not processed for user `ae6eacec94864a57807646b3b537df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.654808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-26bd3c02-61f1-4b5e-b85a-fa719af8a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.669681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00e69-0928-4e8f-b35c-957b6ceb424c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.680959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.681833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.682212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.682594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.700477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.702374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.726299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2516/5052] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:47.727400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.749832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a97af-c607-4189-8c18-bdcae03d99ed service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.755728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.756549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.757377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.758178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.759082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.760787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.772637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2517/5053] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:47.776721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:47.798808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7a2d-567a-4dfe-9419-6c848321e6ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:47.813839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:47.815868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.816731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.817260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] PATH_INFO: `/v3/projects/e16946d4a8d945b6b316d212abca4f83/users/704f4755d3f446429725f2b66cd8a672/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.837675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16946d4a8d945b6b316d212abca4f83, user_id=704f4755d3f446429725f2b66cd8a672, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:47.841586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc4f35-c7ef-4c69-866a-26a7b8a544f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:47.874204 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2537/5054] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:47.884931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.885308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.885584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.891453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2518/5055] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:47 2021] PUT /identity/v3/projects/e16946d4a8d945b6b316d212abca4f83/users/704f4755d3f446429725f2b66cd8a672/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:47.897045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:47.901643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:47.903651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:47.906541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] MFA Rules not processed for user `ae6eacec94864a57807646b3b537df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.908010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:47.965391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:47.966790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:48.063290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2538/5056] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:48.071781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:48.075455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:48.111210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2519/5057] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:48.154569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:48.162285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:48.330005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19972c8-8144-4712-a1a1-8d92faa708fe None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:48.345157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:48.345987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:48.346857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:48.347877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:48.365816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:48.367773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:48.379154 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2539/5058] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:11:48.406916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0501109-539e-4ad2-870c-aba5e8089cb5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:48.422657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:48.422657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:48.422657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:48.422657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:48.447418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:48.452304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:48.480200 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2520/5059] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:11:49.093615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:49.095680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:49.123942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09335b-7888-4f18-bc39-b586100e1710 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:49.139594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:49.141019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:49.141516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:49.142812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] PATH_INFO: `/v3/users/51992c976c3248d9bce6335688cd3884` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:49.145838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=51992c976c3248d9bce6335688cd3884)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:49.148182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:49.436040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51992c976c3248d9bce6335688cd3884'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:49.459563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51992c976c3248d9bce6335688cd3884'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:49.460455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51992c976c3248d9bce6335688cd3884'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:49.504039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51992c976c3248d9bce6335688cd3884'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:49.521915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a20e7310-16be-4f0d-9cb9-378022da1fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51992c976c3248d9bce6335688cd3884'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:49.533659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2540/5060] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:11:49 2021] DELETE /identity/v3/users/51992c976c3248d9bce6335688cd3884 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:50.322957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:50.343440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6921f42-fb82-48de-b2e9-cf407149e725 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:50.452438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:50.454001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:50.454293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:50.454727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] PATH_INFO: `/v3/projects/98e142c68d8145b6b141378452e1280e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:50.456995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e142c68d8145b6b141378452e1280e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:50.459553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:50.537453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e142c68d8145b6b141378452e1280e', 'request_id': 'req-c9189999-4c53-46ce-80c9-8072a74071b3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:50.551195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e142c68d8145b6b141378452e1280e', 'request_id': 'req-c9189999-4c53-46ce-80c9-8072a74071b3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:50.557883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e142c68d8145b6b141378452e1280e', 'request_id': 'req-c9189999-4c53-46ce-80c9-8072a74071b3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:50.581782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] The token cache is being invalidate because project 98e142c68d8145b6b141378452e1280e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:11:50.582286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:50.584004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c9189999-4c53-46ce-80c9-8072a74071b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:11:50.590828 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2521/5061] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:11:50 2021] DELETE /identity/v3/projects/98e142c68d8145b6b141378452e1280e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:11:50.592669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851c1c-b4e4-44fe-bdc1-2f08550db494 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:50.593142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851c1c-b4e4-44fe-bdc1-2f08550db494 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:50.593547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851c1c-b4e4-44fe-bdc1-2f08550db494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:50.623230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-05851c1c-b4e4-44fe-bdc1-2f08550db494 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:50.624478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05851c1c-b4e4-44fe-bdc1-2f08550db494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:50.773115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2541/5062] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:50.812980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:50.813601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:50.814065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:50.847667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:50.848187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:50.848716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:50.870049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] MFA Rules not processed for user `202de6cb73e547f8a449898bf46a05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:50.872998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:50.874297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:50.874834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:50.916238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2542/5063] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:50.919341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:50.943053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4df0a-f94e-48ce-a005-56881c9a56d3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:50.964730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:50.965639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:50.966330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:50.966610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:50.967381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:11:50.967682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:50.973398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.004324 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2543/5064] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:11:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:11:51.009629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:51.014995 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2522/5065] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:51.031057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc5f0-c74c-4b06-9e68-6e21bf76d796 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:51.045286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:51.051005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.070846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.071391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.079072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:51.082789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.197592 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2544/5066] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:11:51 2021] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:51.201661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:51.233891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05377-6c3a-4486-917c-7194d05b17f2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:51.384567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:51.389774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.390091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.390484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.391211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:51.395277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.442655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2523/5067] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:11:51 2021] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:11:51.445858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:51.486383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc8ef-30ca-4995-9f74-aa1f7247f821 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:51.503663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:51.505498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.505787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.509150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.509996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:51.523716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.556294 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2545/5068] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:51.560175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:51.575199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14468368-5426-472c-a770-33d9004b86ac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:51.581268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:51.581945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.582480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.582768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.583522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:51.585304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dfd80-a897-4aca-97d1-d711ca7316f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.618891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2524/5069] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:11:51.622757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:51.642332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e6ad-4fc5-41fd-be5b-33817c62b5f7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:51.674960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:51.677516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.677804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.681103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] PATH_INFO: `/v3/projects/445e25acae4d425ea5d2c34a6876043a/users/99798be20500461c994645777b26d264/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.757799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445e25acae4d425ea5d2c34a6876043a, user_id=99798be20500461c994645777b26d264, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:51.767912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431293-87ed-4320-8ee9-52d6c0ede326 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:51.813793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2546/5070] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:11:51 2021] PUT /identity/v3/projects/445e25acae4d425ea5d2c34a6876043a/users/99798be20500461c994645777b26d264/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:11:51.826346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:51.826628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:51.827616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:51.903972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] MFA Rules not processed for user `99798be20500461c994645777b26d264`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:51.905584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:52.095530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2525/5071] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:51 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:52.107733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460463-b759-45cd-9293-4f1aa3afafe2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:52.108599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460463-b759-45cd-9293-4f1aa3afafe2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:52.108599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460463-b759-45cd-9293-4f1aa3afafe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:52.149748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c9460463-b759-45cd-9293-4f1aa3afafe2 None None] MFA Rules not processed for user `99798be20500461c994645777b26d264`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:11:52.152208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c9460463-b759-45cd-9293-4f1aa3afafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:52.194950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2547/5072] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:11:52 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:11:52.206768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:11:52.208227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:11:52.408502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a853d0-3e61-4217-99fd-bd54ddd67178 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:11:52.434576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:11:52.435258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:11:52.435584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:11:52.436130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:11:52.464120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:11:52.465894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:11:52.501813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2526/5073] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:11:52 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:01.693826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070e92-4161-4f9f-aefb-fa852c99ed54 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:01.695247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070e92-4161-4f9f-aefb-fa852c99ed54 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:01.695894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070e92-4161-4f9f-aefb-fa852c99ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:01.750353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c070e92-4161-4f9f-aefb-fa852c99ed54 None None] MFA Rules not processed for user `704f4755d3f446429725f2b66cd8a672`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:01.753936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c070e92-4161-4f9f-aefb-fa852c99ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:01.935001 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2548/5074] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:01 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:02.103211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:02.105639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:02.148180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5285418-31ea-4b2d-b5dc-3440eea7051c service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:02.156429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:02.157283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:02.157566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:02.157843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:02.169087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:02.170651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:02.181768 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2527/5075] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:02 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:04.962340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e9ef-1089-4886-bdd4-59828a6942fb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:04.963809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e9ef-1089-4886-bdd4-59828a6942fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:04.964772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e9ef-1089-4886-bdd4-59828a6942fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:05.011511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b808e9ef-1089-4886-bdd4-59828a6942fb None None] MFA Rules not processed for user `704f4755d3f446429725f2b66cd8a672`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:05.013092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b808e9ef-1089-4886-bdd4-59828a6942fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:05.066857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2549/5076] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:04 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:06.771380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:06.772875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:06.893050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce047-ea62-42a3-9131-0259e0f2c8cf service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:06.907269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:06.908795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:06.909780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:06.910060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] PATH_INFO: `/v3/users/a6496c28abe44d83a98e4ce5461b398d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:06.911381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6496c28abe44d83a98e4ce5461b398d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:06.915334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:06.998145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6496c28abe44d83a98e4ce5461b398d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.015861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6496c28abe44d83a98e4ce5461b398d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.016694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6496c28abe44d83a98e4ce5461b398d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.017387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6496c28abe44d83a98e4ce5461b398d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.027164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6496c28abe44d83a98e4ce5461b398d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.058906 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2528/5077] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:06 2021] DELETE /identity/v3/users/a6496c28abe44d83a98e4ce5461b398d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:07.060577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.061084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.061180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.092038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:07.093783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:07.185401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2550/5078] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:07.195654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:07.198508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:07.308135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2401e-c7fe-46ab-9037-b929c0461ce0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:07.312110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:07.312812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.313096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.313374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.338058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:07.340020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301063-ac4a-400b-bf31-1ab70ab7c95e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:07.354673 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2529/5079] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:07.708644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:07.710454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:07.723737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ed90-eb8f-4d13-85e8-4b5b5fd41453 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:07.728755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:07.730031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.730505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.731091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] PATH_INFO: `/v3/projects/2b98bfb2b28b4262b875f96bd53c342b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.732831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b98bfb2b28b4262b875f96bd53c342b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:07.735686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:07.784074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b98bfb2b28b4262b875f96bd53c342b', 'request_id': 'req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.789809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b98bfb2b28b4262b875f96bd53c342b', 'request_id': 'req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.796318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b98bfb2b28b4262b875f96bd53c342b', 'request_id': 'req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.817120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] The token cache is being invalidate because project 2b98bfb2b28b4262b875f96bd53c342b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:07.817416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.818085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4252bf92-20b0-4ca3-ac78-eb90eea0c8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:07.819618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2551/5080] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:07 2021] DELETE /identity/v3/projects/2b98bfb2b28b4262b875f96bd53c342b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:07.826112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.826654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.826654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.854175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:07.856228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:07.930657 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2530/5081] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:07.938537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.938842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.939119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.959589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:07.961124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:07.970379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2552/5082] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:07.974707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:07.985072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7e6c8-d06b-496b-ad4e-f0d3dacb8c97 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:07.991124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:07.991996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:07.992477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:07.992889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:07.993855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:07.994041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:07.995680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.013317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2531/5083] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:08.015051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.027111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0deb7b6-1c77-4b12-890d-ebd1ff189eab None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.033142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.034468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.034957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.035512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.036225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.038265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.078723 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2553/5084] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:08 2021] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:08.079741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.090103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f925e-5e7a-4ee4-8e0b-18b4a554420a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.148018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.148747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.149027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.149295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.149993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.151928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.173290 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2532/5085] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:08 2021] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:08.177653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.187882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdde301-a52c-4403-a49b-c73dac5543b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.193424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.194082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.194363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.194644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.195374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.196989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.207690 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2554/5086] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:08.211800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.222155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86567e8-0e71-48d9-9b6b-95464a373438 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.227027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.227685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.227960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.228229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.228979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.230535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4db6-9e3e-4ec4-81b7-a14d1ec0662b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.241388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2533/5087] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:08.245468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.256081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dedd7-dc00-4a0d-8492-437a89d6dfa8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.262238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.263120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.263411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.263667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] PATH_INFO: `/v3/projects/c3afde4294654e3eab3416027f24c8f8/users/95719842ccac481598eaf0365d7b1369/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.278960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3afde4294654e3eab3416027f24c8f8, user_id=95719842ccac481598eaf0365d7b1369, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.281898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.294990 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2555/5088] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:08 2021] PUT /identity/v3/projects/c3afde4294654e3eab3416027f24c8f8/users/95719842ccac481598eaf0365d7b1369/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:08.306354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.306637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.306915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.334738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] MFA Rules not processed for user `95719842ccac481598eaf0365d7b1369`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:08.335940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:08.400850 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2534/5089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:08.412642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.414885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:08.480649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0b48-1d73-4c74-be1b-de1484ce5697 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.484550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.485844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.486128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.487018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.496045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.497510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82372d0-a2e3-48fa-9925-84c66e19c139 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.507817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2556/5090] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:08 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:08.546041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.636406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863de0a-b509-4769-bf20-a32029f64d43 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:08.641184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:08.642274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.642424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.643288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] PATH_INFO: `/v3/users/95719842ccac481598eaf0365d7b1369` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.644932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95719842ccac481598eaf0365d7b1369)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:08.647172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:08.729745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95719842ccac481598eaf0365d7b1369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:08.741608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95719842ccac481598eaf0365d7b1369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:08.742986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95719842ccac481598eaf0365d7b1369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:08.744048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95719842ccac481598eaf0365d7b1369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:08.757534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95719842ccac481598eaf0365d7b1369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:08.785794 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2535/5091] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:08 2021] DELETE /identity/v3/users/95719842ccac481598eaf0365d7b1369 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:08.791072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:08.791720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:08.792206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:08.835025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:08.836278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:08.922327 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2557/5092] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:08.938546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:08.941429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:09.024935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be3341-b8dd-420f-8cd6-08432df80392 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:09.031159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:09.031369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:09.031532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:09.031910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:09.044070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:09.045704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc75aac-b73e-4178-b787-864401a9ec62 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:09.056734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2536/5093] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:09.580557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:09.581971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:09.598457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb1c4-eb71-444f-a39e-69f9815699b0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:09.610376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:09.611222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:09.611503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:09.611997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] PATH_INFO: `/v3/projects/c3afde4294654e3eab3416027f24c8f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:09.613478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3afde4294654e3eab3416027f24c8f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:09.625922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:09.694735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3afde4294654e3eab3416027f24c8f8', 'request_id': 'req-0c32cdad-bb5f-447d-aba6-e3a41aac5364'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:09.703521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3afde4294654e3eab3416027f24c8f8', 'request_id': 'req-0c32cdad-bb5f-447d-aba6-e3a41aac5364'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:09.713883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3afde4294654e3eab3416027f24c8f8', 'request_id': 'req-0c32cdad-bb5f-447d-aba6-e3a41aac5364'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:09.732141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] The token cache is being invalidate because project c3afde4294654e3eab3416027f24c8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:09.732971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:09.733900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c32cdad-bb5f-447d-aba6-e3a41aac5364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:09.743245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:09.743526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:09.743801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:09.753120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2558/5094] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:09 2021] DELETE /identity/v3/projects/c3afde4294654e3eab3416027f24c8f8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:09.780066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:09.781711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:09.887749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2537/5095] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:09.890845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:09.891834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:09.892346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:09.915862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:09.917493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:09.927613 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2559/5096] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:09.932468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:09.944416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad624-f149-4e20-8ce5-e6d8c7eb2a82 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:09.952711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:09.953691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:09.954237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:09.954787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:09.955796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:09.956534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:09.958530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:09.974798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2538/5097] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:09.979585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.000654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb517-7477-4c62-b1e7-63fdb010f590 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.010615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.011313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.011597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.011866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.012572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.014479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.041004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2560/5098] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:09 2021] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:10.045089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.055784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eef698-9401-42d9-ae7b-5a70db7d3490 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.115747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.116770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.117048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.117525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.118238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.120119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.145899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2539/5099] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:10 2021] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:10.147047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.157658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0837-fdb4-453a-9c51-450bc01564c4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.173858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.175067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.175345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.175613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.176355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.178016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.199354 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2561/5100] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:10.200184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.211833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560693b-b4b9-41c3-80b5-1b02df6bc547 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.216515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.217224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.217498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.217794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.218560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.220132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318d4a-034a-41c5-b4a8-48d33ca4fdd8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.231977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2540/5101] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:10.236336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.247291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dab1-a01e-4578-8c61-694d76948555 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.253039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.254079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.254374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.254744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] PATH_INFO: `/v3/projects/d1b41fe8af644d33915bdae4bbd34947/users/b14e52c2dee142bb896f6e0e61e52426/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.274641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b41fe8af644d33915bdae4bbd34947, user_id=b14e52c2dee142bb896f6e0e61e52426, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.277798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.294969 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2562/5102] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:10 2021] PUT /identity/v3/projects/d1b41fe8af644d33915bdae4bbd34947/users/b14e52c2dee142bb896f6e0e61e52426/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:10.300090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91741-0a7f-4b99-aa13-0aa6e66441a8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.300378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91741-0a7f-4b99-aa13-0aa6e66441a8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.300684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91741-0a7f-4b99-aa13-0aa6e66441a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.318200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-95a91741-0a7f-4b99-aa13-0aa6e66441a8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:10.319407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95a91741-0a7f-4b99-aa13-0aa6e66441a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:10.389971 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2541/5103] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:10.402639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:10.404843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:10.479814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec942d-c07c-44ff-9f80-1165cda093e7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:10.484076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:10.484990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:10.485435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:10.485790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:10.505344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:10.506794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:10.516946 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2563/5104] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:11.245320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:11.245821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:11.247018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:11.291616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] MFA Rules not processed for user `b14e52c2dee142bb896f6e0e61e52426`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:11.293174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.393087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2542/5105] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:11.404286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:11.405922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.478481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0003d-9d87-4ef2-aa2d-51459bab652e service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:11.485098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:11.486900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:11.487487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:11.489335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:11.504801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:11.506377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:11.525320 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2564/5106] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:11.585316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:11.586760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.606977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e557-b81e-41b6-b1c4-48e215ca56bc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:11.611075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:11.612922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:11.613205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:11.613483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:11.616323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.673696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:11.685572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510adb4f-64bb-4b8e-805d-f7035f18c7fa service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:11.696530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:11.697360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:11.697707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:11.697878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:11.701216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.710760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:11.713645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:11.724525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:11.726559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:11.731119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2543/5107] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:11.731857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:11.733470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:11.741404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2565/5108] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:12:11.758830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ed01d-2558-4ea8-bd89-fd2aacfb92c4 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:11.765419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:11.766298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:11.767038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:11.767038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] PATH_INFO: `/v3/users/ae6eacec94864a57807646b3b537df6c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:11.774577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6eacec94864a57807646b3b537df6c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:11.790818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:11.859830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6eacec94864a57807646b3b537df6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:11.867018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6eacec94864a57807646b3b537df6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:11.868951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6eacec94864a57807646b3b537df6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:11.869879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6eacec94864a57807646b3b537df6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:11.887888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bbfd6df7-1fa5-4f01-8f0c-42a654957271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6eacec94864a57807646b3b537df6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:11.914701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2544/5109] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:11 2021] DELETE /identity/v3/users/ae6eacec94864a57807646b3b537df6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:12.119677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.136587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2364ed-6131-4c46-aada-09f8686a279a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.216993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.218298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.218582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.218968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] PATH_INFO: `/v3/projects/761af007cf944b249f138d8190887b90` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.220261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761af007cf944b249f138d8190887b90)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.222446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.280815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761af007cf944b249f138d8190887b90', 'request_id': 'req-205605a4-3295-4389-b514-4bff345765a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:12.287234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761af007cf944b249f138d8190887b90', 'request_id': 'req-205605a4-3295-4389-b514-4bff345765a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:12.297797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761af007cf944b249f138d8190887b90', 'request_id': 'req-205605a4-3295-4389-b514-4bff345765a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:12.318637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] The token cache is being invalidate because project 761af007cf944b249f138d8190887b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:12.318935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:12.319600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-205605a4-3295-4389-b514-4bff345765a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:12.322239 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2566/5110] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:12 2021] DELETE /identity/v3/projects/761af007cf944b249f138d8190887b90 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:12.328792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.329426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.329426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.357021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:12.359055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:12.431798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2545/5111] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:12.441416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.441876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.442005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.463631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:12.464894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:12.477684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2567/5112] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:12.481923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.492050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067ef10-9fc2-4c2d-a9a2-36bc32140a91 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.496753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.497413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.497740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.497965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.498700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:12.499000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.500643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.515893 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2546/5113] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:12.517092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.526846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49ccea-f8bf-40bf-9db9-8f930af72ba0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.531734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.532383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.532687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.532962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.534305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.536178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.564979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2568/5114] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:12.566473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.577518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaad85-49ce-4a95-8f09-c1c771d071e1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.631402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.632214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.632494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.632797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.633619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.635492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.655580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2547/5115] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:12.660362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.670332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c639-65d5-473f-ae54-fe0c429df166 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.674960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.675604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.675880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.676149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.676915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.678474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.688760 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2569/5116] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:12.693308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.707353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2f55-0de4-41f8-adf3-c5610771a4dc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.712600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.713298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.713578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.713857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.714584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.716150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd46ca-3e4a-4f88-8ea2-f83a8248aed1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.727492 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2548/5117] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:12.731677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.741242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be038291-cd37-48e6-822a-7c5b0d9952d9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:12.745722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:12.746573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.746848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.747117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] PATH_INFO: `/v3/projects/7e846505b09e497aba24ca52c85dff3c/users/a03cbeb518814a4c9885f0947128ac9f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.760894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e846505b09e497aba24ca52c85dff3c, user_id=a03cbeb518814a4c9885f0947128ac9f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:12.763492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb60587-d667-4329-a9b3-e09d4c6cf404 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:12.776312 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2570/5118] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:12 2021] PUT /identity/v3/projects/7e846505b09e497aba24ca52c85dff3c/users/a03cbeb518814a4c9885f0947128ac9f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:12.787077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.787400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.787675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.815141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:12.817118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:12.883180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2549/5119] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:12.894273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d11d-b1b5-47a3-8e70-f70552ee15cc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:12.894625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d11d-b1b5-47a3-8e70-f70552ee15cc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:12.894816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d11d-b1b5-47a3-8e70-f70552ee15cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:12.911657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6ef9d11d-b1b5-47a3-8e70-f70552ee15cc None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:12.912882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ef9d11d-b1b5-47a3-8e70-f70552ee15cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:12.919906 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2571/5120] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:12.930501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:12.931971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.027418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea185-ff12-44b1-82e0-f6005446aa41 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:13.034407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:13.034965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.035245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.035518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.044653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:13.046215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc87fd-ecd8-4012-80b1-24d6ad9376cd service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:13.056261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2550/5121] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:13.079249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5ed7-dd52-4b79-94be-c85e63643e67 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.079910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5ed7-dd52-4b79-94be-c85e63643e67 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.080429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5ed7-dd52-4b79-94be-c85e63643e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.101086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-845d5ed7-dd52-4b79-94be-c85e63643e67 None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:13.103009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-845d5ed7-dd52-4b79-94be-c85e63643e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.124781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2572/5122] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:13.136249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71435a90-d7a5-4d92-87d6-f466a287c1cf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.136589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71435a90-d7a5-4d92-87d6-f466a287c1cf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.136955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71435a90-d7a5-4d92-87d6-f466a287c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.160349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-71435a90-d7a5-4d92-87d6-f466a287c1cf None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:13.162052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-71435a90-d7a5-4d92-87d6-f466a287c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.171459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2551/5123] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:13.201094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.201702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.202628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.226932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:13.228133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.235832 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2573/5124] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:13.262508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba300-759b-4825-b469-d58f2d45f483 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.262806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba300-759b-4825-b469-d58f2d45f483 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.263239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba300-759b-4825-b469-d58f2d45f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.283639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8bcba300-759b-4825-b469-d58f2d45f483 None None] MFA Rules not processed for user `a03cbeb518814a4c9885f0947128ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:13.284928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8bcba300-759b-4825-b469-d58f2d45f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.292527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2552/5125] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:13.310499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:13.388700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240b48-d6e9-4b82-9e3c-084f2e3b3561 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:13.393471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:13.394384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.394727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.395066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] PATH_INFO: `/v3/users/a03cbeb518814a4c9885f0947128ac9f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.396339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03cbeb518814a4c9885f0947128ac9f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:13.398318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:13.443882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03cbeb518814a4c9885f0947128ac9f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:13.452273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03cbeb518814a4c9885f0947128ac9f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:13.453259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03cbeb518814a4c9885f0947128ac9f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:13.467223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03cbeb518814a4c9885f0947128ac9f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:13.476550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03cbeb518814a4c9885f0947128ac9f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:13.491739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2574/5126] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:13 2021] DELETE /identity/v3/users/a03cbeb518814a4c9885f0947128ac9f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:13.497930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.499550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.500049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.527837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:13.529709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.599964 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2553/5127] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:13.610283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:13.611813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.667071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d956b8f-a54d-4414-b8c0-5f8fd17a6367 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:13.671099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:13.671789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.672064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.672332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.682129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:13.683521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77685-5ab5-45db-9dea-8e2b569c7228 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:13.692774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2575/5128] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:13.953118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:13.954600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:13.967220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4ffc8-112a-4b4a-a952-ec9ce2d47fa6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:13.972370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:13.975514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:13.975811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:13.976092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] PATH_INFO: `/v3/projects/7e846505b09e497aba24ca52c85dff3c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:13.977362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e846505b09e497aba24ca52c85dff3c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:13.979320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.027406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e846505b09e497aba24ca52c85dff3c', 'request_id': 'req-61b33f44-6009-497f-b9af-f40dc0cd5f27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:14.032975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e846505b09e497aba24ca52c85dff3c', 'request_id': 'req-61b33f44-6009-497f-b9af-f40dc0cd5f27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:14.040906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e846505b09e497aba24ca52c85dff3c', 'request_id': 'req-61b33f44-6009-497f-b9af-f40dc0cd5f27'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:14.053068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] The token cache is being invalidate because project 7e846505b09e497aba24ca52c85dff3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:14.053347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:14.053975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-61b33f44-6009-497f-b9af-f40dc0cd5f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:14.055495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2554/5129] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:13 2021] DELETE /identity/v3/projects/7e846505b09e497aba24ca52c85dff3c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:14.063986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.064296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.064565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.082847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:14.084011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:14.139223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2576/5130] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:14.147572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.148064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.148344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.166842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:14.168033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:14.175890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2555/5131] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:14.180099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.190252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345b2ce-bb84-4688-b7ad-30ef74faa190 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.194759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.195399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.195671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.195941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.196696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:14.196995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.198548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.213209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2577/5132] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:14.215104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.225356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6720d-33b0-4261-8307-bf244d9146db None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.229852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.230997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.230997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.231164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.231773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.233660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.274082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2556/5133] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:14 2021] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:14.275301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.286827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19bd12-bbbc-4e87-88be-b626a2ca1788 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.347175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.347836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.348109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.348378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.349098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.350956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.371596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2578/5134] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:14 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:14.375862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.386620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7916-b09b-45ca-a336-dd2d063534a2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.391274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.391956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.392239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.392515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.393314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.395478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.407518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2557/5135] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:14.412915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.423774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa92be-7771-4448-9181-d5241674a80b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.429332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.430332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.430595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.430932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.431734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.433589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac917f-49f9-4d8c-a63a-f160fbfe8ba1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.445155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2579/5136] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:14.449071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.461466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083140ae-518d-4641-84bb-570630c7c558 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.466194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.467102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.467512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.467722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] PATH_INFO: `/v3/projects/866ebc6b206b4044984d9f76c5fe558b/users/5b9d75bcae8343abbe44e9b8440113a8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.485647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866ebc6b206b4044984d9f76c5fe558b, user_id=5b9d75bcae8343abbe44e9b8440113a8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.488462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.501938 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2558/5137] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:14 2021] PUT /identity/v3/projects/866ebc6b206b4044984d9f76c5fe558b/users/5b9d75bcae8343abbe44e9b8440113a8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:14.507694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cb01-1a7b-4dca-b562-06c817f05bb5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.507976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cb01-1a7b-4dca-b562-06c817f05bb5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.508250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cb01-1a7b-4dca-b562-06c817f05bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.527634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b7b5cb01-1a7b-4dca-b562-06c817f05bb5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:14.528880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b7b5cb01-1a7b-4dca-b562-06c817f05bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:14.592857 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2580/5138] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:14.602586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:14.604415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:14.664973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072737-9f2d-4f5a-b921-07692a5cd422 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:14.669152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:14.669800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:14.670078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:14.670380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:14.680204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:14.681697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94628ef-4ad1-4c58-8b2b-5a6b3b11168d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:14.691993 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2559/5139] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:15.013727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:15.014152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:15.014537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:15.051799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] MFA Rules not processed for user `5b9d75bcae8343abbe44e9b8440113a8`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:15.053251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:15.152809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2581/5140] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:15.165087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:15.165087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:15.165087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:15.183354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] MFA Rules not processed for user `5b9d75bcae8343abbe44e9b8440113a8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:15.184582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:15.191843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2560/5141] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:15.204365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:15.206054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:15.280266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d083-f591-418a-81d1-26cf77e84d62 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:15.286666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:15.287216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:15.287569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:15.287784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:15.295878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:15.297483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:15.307503 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2582/5142] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:15 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:16.390373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:16.406716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0f9d-dc27-42cb-ad3c-ad294460defb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:16.412160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:16.413054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:16.413338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:16.413613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] PATH_INFO: `/v3/users/5b9d75bcae8343abbe44e9b8440113a8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:16.414817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9d75bcae8343abbe44e9b8440113a8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:16.416731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:16.462251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9d75bcae8343abbe44e9b8440113a8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.469216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9d75bcae8343abbe44e9b8440113a8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.469893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9d75bcae8343abbe44e9b8440113a8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.470511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9d75bcae8343abbe44e9b8440113a8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.479322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-881d1b8a-fc01-4e05-95a0-bfb794ee8304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9d75bcae8343abbe44e9b8440113a8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.496125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2561/5143] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:16 2021] DELETE /identity/v3/users/5b9d75bcae8343abbe44e9b8440113a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:16.772220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:16.783856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78226b5-e309-48e1-80dc-525e3d680252 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:16.861119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:16.862123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:16.862470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:16.862812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] PATH_INFO: `/v3/projects/866ebc6b206b4044984d9f76c5fe558b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:16.864151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866ebc6b206b4044984d9f76c5fe558b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:16.866153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:16.911742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866ebc6b206b4044984d9f76c5fe558b', 'request_id': 'req-c642f1bd-6de9-49b5-991b-d82753909ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.916795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866ebc6b206b4044984d9f76c5fe558b', 'request_id': 'req-c642f1bd-6de9-49b5-991b-d82753909ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.922750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866ebc6b206b4044984d9f76c5fe558b', 'request_id': 'req-c642f1bd-6de9-49b5-991b-d82753909ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.938737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] The token cache is being invalidate because project 866ebc6b206b4044984d9f76c5fe558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:16.939017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.939690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c642f1bd-6de9-49b5-991b-d82753909ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:16.941825 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2583/5144] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:16 2021] DELETE /identity/v3/projects/866ebc6b206b4044984d9f76c5fe558b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:16.947764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:16.948085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:16.948362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:16.966363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:16.967596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:17.044674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2562/5145] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:17.053178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.053539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.053882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.081836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:17.083175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:17.091279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2584/5146] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:17.095729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.105937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c86ad-50f6-47d7-83cc-a62c010c3754 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.111447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.112763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.112989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.113266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.114002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:17.114302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.115909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.132660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2563/5147] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:17.135856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.145253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b43b-3386-4884-9da0-270f33525cb0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.150068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.150750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.151024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.151292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.151988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.153943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.182307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2585/5148] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:17.186099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.197842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07111a7b-6097-48b8-bad2-654137426790 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.256793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.257470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.257771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.258019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.258736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.260639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.284492 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2564/5149] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:17.288665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.304769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64fe5a-30a4-41dc-8c39-02d477241406 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.313747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.314756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.315235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.315579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.316385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.318769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.335296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2586/5150] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:17 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:17.337129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.347994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d5fa-1217-4eea-8d99-5fe56f489396 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.363232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.363935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.364212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.364474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.365354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.366926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e9eec-e318-4a0a-9a8b-65bfc6abdd5a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.377439 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2565/5151] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:17.381710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.391916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9595c4-4585-4f1d-b0e5-2cef8601232d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.396799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.397673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.398007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.398285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] PATH_INFO: `/v3/projects/5eabb87d224d4c83a7455303f6716311/users/c4e0dbc5f16a4831a7e3aa2511683382/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.427930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eabb87d224d4c83a7455303f6716311, user_id=c4e0dbc5f16a4831a7e3aa2511683382, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.430895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.447058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2587/5152] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:17 2021] PUT /identity/v3/projects/5eabb87d224d4c83a7455303f6716311/users/c4e0dbc5f16a4831a7e3aa2511683382/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:17.457266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.457797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.457797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.485473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] MFA Rules not processed for user `c4e0dbc5f16a4831a7e3aa2511683382`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:17.486457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:17.554202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2566/5153] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:17.558633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.624583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e06bf-3b09-4e49-9463-ddf0359f500f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.629958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.630703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.631049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.631392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.632168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.634189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.662855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2588/5154] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:17.666959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.678389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb464-cce7-4041-9319-ac2475057ec1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.738631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.739299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.739577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.739848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.740559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.742700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.767894 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2567/5155] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:17 2021] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:17.769686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.781176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148a52-8436-4064-b169-fcd41ce8eeae admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.786901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.787644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.787994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.788338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.789181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.790831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.802717 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2589/5156] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:17.807084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.817081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d48e3e-fbea-4c99-84bf-1c83294d7967 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.822306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.822649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.822931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.823230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] PATH_INFO: `/v3/projects/c623e1cff7144af789e42485abc7b2a6/users/687b1aa85d064e07bc67ae9f78d11a3f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.841687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c623e1cff7144af789e42485abc7b2a6, user_id=687b1aa85d064e07bc67ae9f78d11a3f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.850795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.872697 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2568/5157] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:17 2021] PUT /identity/v3/projects/c623e1cff7144af789e42485abc7b2a6/users/687b1aa85d064e07bc67ae9f78d11a3f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:17.875194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.885854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4b1c-0cf8-448d-b57d-ec9c6c271bad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.947305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.948169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.948747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.949300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.950185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.952467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb2243-4402-4cb5-b1c9-866dcc9553f6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:17.962942 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2590/5158] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:17 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:17.966997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:17.978117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337a2c-e051-4347-8f4f-012bc2cbf0c4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:17.983350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:17.984238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:17.984516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:17.984837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] PATH_INFO: `/v3/projects/c623e1cff7144af789e42485abc7b2a6/users/687b1aa85d064e07bc67ae9f78d11a3f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:17.987816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c623e1cff7144af789e42485abc7b2a6, user_id=687b1aa85d064e07bc67ae9f78d11a3f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:17.990798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.003625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2569/5159] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:17 2021] PUT /identity/v3/projects/c623e1cff7144af789e42485abc7b2a6/users/687b1aa85d064e07bc67ae9f78d11a3f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:18.012783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.013065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.013334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.043170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] MFA Rules not processed for user `687b1aa85d064e07bc67ae9f78d11a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:18.044407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:18.109440 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2591/5160] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:18 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:18.113658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.124061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d036-d929-4b90-961b-937f50cacbc8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.129119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.129757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.130037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.130314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.131008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.132882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.159810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2570/5161] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:18 2021] POST /identity/v3/projects => generated 333 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:18.163886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.173781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afa47-dec3-40e2-9cac-38e104dfedba None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.233746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.234584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.234945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.235411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.236185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.238548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.273432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2592/5162] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:12:18 2021] POST /identity/v3/projects => generated 333 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:18.278260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.290011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561431fa-d2e2-4884-889b-f04c260ed257 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.345637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.346557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.346942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.347319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.348126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.350085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.394603 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2571/5163] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:18 2021] POST /identity/v3/projects => generated 358 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:18.395961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.407135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303261f-fd69-407e-9209-22dc5b6242c7 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.476638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.477700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.478214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.478780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.479822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.482308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.507188 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2593/5164] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 04:12:18 2021] GET /identity/v3/projects => generated 6479 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:18.513031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.527537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6733b-92e8-4973-a484-99a337bc3273 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.536352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.537091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.537377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.537656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.538436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:18.538747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.541030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.571800 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2572/5165] 10.222.0.13 () {58 vars in 1157 bytes} [Wed Nov 10 04:12:18 2021] GET /identity/v3/projects?enabled=False => generated 444 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:18.577258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.588290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b7b-8ff2-4557-9bbf-4fc37f18f5bf tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.599770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.600478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.600787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.601032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.601838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Adding query filter params (parent_id=da8cd9dd809345c19216fb5563d73837) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:18.602130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.605014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.624081 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2594/5166] 10.222.0.13 () {58 vars in 1215 bytes} [Wed Nov 10 04:12:18 2021] GET /identity/v3/projects?parent_id=da8cd9dd809345c19216fb5563d73837 => generated 498 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:18.629525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.642245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ba15-6a5b-4b3b-8892-d8825fbfed50 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.647123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.647988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.648271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.648565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects/27c5458eb7504d5cb0e2708860449236` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.649834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27c5458eb7504d5cb0e2708860449236)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.651754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:18.845221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c5458eb7504d5cb0e2708860449236', 'request_id': 'req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:18.851303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c5458eb7504d5cb0e2708860449236', 'request_id': 'req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:18.863288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c5458eb7504d5cb0e2708860449236', 'request_id': 'req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:18.877564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] The token cache is being invalidate because project 27c5458eb7504d5cb0e2708860449236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:18.878023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:18.878848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:18.884681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2573/5167] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:18 2021] DELETE /identity/v3/projects/27c5458eb7504d5cb0e2708860449236 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:18.885157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:18.888010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:18.901381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d343c6-edd2-4144-9a12-60abf3133e67 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:18.958025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:18.958984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:18.959265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:18.959538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects/da8cd9dd809345c19216fb5563d73837` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:18.960778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da8cd9dd809345c19216fb5563d73837)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:18.962658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:19.007541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8cd9dd809345c19216fb5563d73837', 'request_id': 'req-6e12d956-dc64-464f-ab39-d02e593630cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.012796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8cd9dd809345c19216fb5563d73837', 'request_id': 'req-6e12d956-dc64-464f-ab39-d02e593630cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.018761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8cd9dd809345c19216fb5563d73837', 'request_id': 'req-6e12d956-dc64-464f-ab39-d02e593630cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.035023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] The token cache is being invalidate because project da8cd9dd809345c19216fb5563d73837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:19.035546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.036267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.038208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2595/5168] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:18 2021] DELETE /identity/v3/projects/da8cd9dd809345c19216fb5563d73837 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:19.042112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:19.053365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3b0c4-c2fb-486f-85ae-5e53a72aea92 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:19.113495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687b1aa85d064e07bc67ae9f78d11a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c623e1cff7144af789e42485abc7b2a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:19.114250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:19.114532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:19.114806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] PATH_INFO: `/v3/projects/689b9475f0214c0ebf71b265185f3503` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:19.116033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=689b9475f0214c0ebf71b265185f3503)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:19.118374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:19.174592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689b9475f0214c0ebf71b265185f3503', 'request_id': 'req-b420a703-2b7b-498c-b08e-96d333e65d01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.182251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689b9475f0214c0ebf71b265185f3503', 'request_id': 'req-b420a703-2b7b-498c-b08e-96d333e65d01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.193267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689b9475f0214c0ebf71b265185f3503', 'request_id': 'req-b420a703-2b7b-498c-b08e-96d333e65d01'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.209499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] The token cache is being invalidate because project 689b9475f0214c0ebf71b265185f3503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:19.209809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.210939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b420a703-2b7b-498c-b08e-96d333e65d01 tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.212355 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2574/5169] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:19 2021] DELETE /identity/v3/projects/689b9475f0214c0ebf71b265185f3503 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:19.216725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:19.231248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:19.309608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d956-dc64-464f-ab39-d02e593630cc tempest-ListProjectsTestJSON-659781095 tempest-ListProjectsTestJSON-659781095-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:19.372871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:19.374008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:19.374719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:19.377029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] PATH_INFO: `/v3/users/c4e0dbc5f16a4831a7e3aa2511683382` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:19.378458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e0dbc5f16a4831a7e3aa2511683382)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:19.380400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:19.437578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e0dbc5f16a4831a7e3aa2511683382'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.445603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e0dbc5f16a4831a7e3aa2511683382'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.445603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e0dbc5f16a4831a7e3aa2511683382'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.459583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e0dbc5f16a4831a7e3aa2511683382'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.466897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e0dbc5f16a4831a7e3aa2511683382'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:19.479450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2596/5170] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:19 2021] DELETE /identity/v3/users/c4e0dbc5f16a4831a7e3aa2511683382 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:19.484534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:19.485055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:19.485665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:19.512027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:19.513529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:19.578851 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2575/5171] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:19.602489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:19.604444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:19.673925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f68e4-d2ec-4066-be2c-81363021281f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:19.678130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:19.678879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:19.679225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:19.679586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:19.688824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:19.690776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:19.701412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2597/5172] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:20.125834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:20.127402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:20.140095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f57f-eb1e-4691-ab80-97c89e54e749 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:20.146104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:20.146754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:20.147040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:20.147304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] PATH_INFO: `/v3/projects/5eabb87d224d4c83a7455303f6716311` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:20.148506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eabb87d224d4c83a7455303f6716311)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:20.150463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:20.205615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eabb87d224d4c83a7455303f6716311', 'request_id': 'req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.211695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eabb87d224d4c83a7455303f6716311', 'request_id': 'req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.218030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eabb87d224d4c83a7455303f6716311', 'request_id': 'req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.233190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] The token cache is being invalidate because project 5eabb87d224d4c83a7455303f6716311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:20.233607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.235307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.237248 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2576/5173] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:20 2021] DELETE /identity/v3/projects/5eabb87d224d4c83a7455303f6716311 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:20.241024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:20.251041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e91e9-bbf6-4e40-86df-7ee656955f81 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:20.308757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:20.309781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:20.310689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:20.311092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] PATH_INFO: `/v3/users/687b1aa85d064e07bc67ae9f78d11a3f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:20.312400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=687b1aa85d064e07bc67ae9f78d11a3f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:20.314412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:20.369388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687b1aa85d064e07bc67ae9f78d11a3f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.378233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687b1aa85d064e07bc67ae9f78d11a3f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.379038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687b1aa85d064e07bc67ae9f78d11a3f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.392066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687b1aa85d064e07bc67ae9f78d11a3f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.400147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16759ea3-9aca-44f9-97ed-d1258d0248dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687b1aa85d064e07bc67ae9f78d11a3f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:20.406930 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2598/5174] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:20 2021] DELETE /identity/v3/users/687b1aa85d064e07bc67ae9f78d11a3f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:20.837344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:20.839585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:20.855569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eec1c3-51d0-4b1a-a553-d49fc0683e3d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:20.929010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:20.931749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:20.932100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:20.932441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] PATH_INFO: `/v3/projects/c623e1cff7144af789e42485abc7b2a6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:20.933838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c623e1cff7144af789e42485abc7b2a6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:20.936045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.001277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c623e1cff7144af789e42485abc7b2a6', 'request_id': 'req-98c3b67f-752a-4489-9466-ed9095becdf6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:21.008237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c623e1cff7144af789e42485abc7b2a6', 'request_id': 'req-98c3b67f-752a-4489-9466-ed9095becdf6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:21.016202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c623e1cff7144af789e42485abc7b2a6', 'request_id': 'req-98c3b67f-752a-4489-9466-ed9095becdf6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:21.034327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] The token cache is being invalidate because project c623e1cff7144af789e42485abc7b2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:21.034895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:21.035749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-98c3b67f-752a-4489-9466-ed9095becdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:21.045593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2577/5175] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:20 2021] DELETE /identity/v3/projects/c623e1cff7144af789e42485abc7b2a6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:21.047241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.047587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.047919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.080347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:21.084482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:21.197360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2599/5176] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:21.206867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.207128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.207521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.236673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:21.238477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:21.247053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2578/5177] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:21.251276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.269882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6576-2dd9-4556-a022-dc974d04b27d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.276299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.277245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.277619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.277988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.278854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:21.279246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.281080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.295290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2600/5178] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:21.300992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.310656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe507c4-1803-4d47-928a-c451f5722593 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.315736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.316544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.316841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.317137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.317890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.319729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.369066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2579/5179] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:21.373251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.391742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8bf4-67fc-4825-8b4b-ad199667277e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.482974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.483820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.484147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.484455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.485301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.487453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.511888 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2601/5180] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:21.515956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.541177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24564-2cba-4bb7-9464-65b5b57655c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.557326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.557941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.558224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.558493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.559242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.561148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.583569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2580/5181] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:21.586078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.603799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de47f1-5376-40f9-9708-bae72c398b57 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.611132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.611804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.612109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.612541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.613326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.614975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f58c5-18ae-4599-984d-21f6e66059c8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.629508 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2602/5182] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:21.634548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:21.645792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05a71-be27-42d9-8426-623728aecfa5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:21.654759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:21.655675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.655956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.656239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] PATH_INFO: `/v3/projects/2ab0d21041c74c6e808a7c0b37c578f5/users/59cc21b5894343d4b6ac43bbe0822d05/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.709669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab0d21041c74c6e808a7c0b37c578f5, user_id=59cc21b5894343d4b6ac43bbe0822d05, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:21.713225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:21.746459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2581/5183] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:21 2021] PUT /identity/v3/projects/2ab0d21041c74c6e808a7c0b37c578f5/users/59cc21b5894343d4b6ac43bbe0822d05/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:21.758560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:21.758862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:21.759788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:21.818521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] MFA Rules not processed for user `59cc21b5894343d4b6ac43bbe0822d05`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:21.819362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:21.978237 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2603/5184] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:21.982784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.147500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a069dd-cb9c-4e5c-ab5f-81c02a33c61e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.157309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.158105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.158467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.159301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.160754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.170574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.245974 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2582/5185] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:21 2021] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:22.253498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.275248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c996759-0f9b-4272-b3bd-10ea93c35fec None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.390895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.391706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.392146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.392518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.393392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.395417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.418429 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2604/5186] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:22 2021] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:22.422838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.434620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433e23-0872-40fb-9a56-aa51f5669bb6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.440888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.441579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.441856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.442129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.442878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.444633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.457179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2583/5187] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:22.461085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.479551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81cc83-ec66-4166-912b-b9456e264663 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.485088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.486555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.487541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.488085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] PATH_INFO: `/v3/projects/207e2e6524f242fca81b8e9d8f4bf325/users/87bb4e6f2f594fc199a1b054f620facf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.523147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207e2e6524f242fca81b8e9d8f4bf325, user_id=87bb4e6f2f594fc199a1b054f620facf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.525970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.552898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2605/5188] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:22 2021] PUT /identity/v3/projects/207e2e6524f242fca81b8e9d8f4bf325/users/87bb4e6f2f594fc199a1b054f620facf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:22.556188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.568310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc327-c7c3-405f-b1fe-987c5fd127ae admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.645137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.645892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.646751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.647228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.648169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.650501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe7a17-9c00-48d4-930e-da09625b9e58 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.666810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2584/5189] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:22.667640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.683468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738160-e9e7-4431-a543-fda446973aa9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.701578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.706169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.706825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.707681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] PATH_INFO: `/v3/projects/207e2e6524f242fca81b8e9d8f4bf325/users/87bb4e6f2f594fc199a1b054f620facf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.710646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=207e2e6524f242fca81b8e9d8f4bf325, user_id=87bb4e6f2f594fc199a1b054f620facf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.714519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:22.748298 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2606/5190] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:22 2021] PUT /identity/v3/projects/207e2e6524f242fca81b8e9d8f4bf325/users/87bb4e6f2f594fc199a1b054f620facf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:22.760317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.760784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.761077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.810325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] MFA Rules not processed for user `87bb4e6f2f594fc199a1b054f620facf`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:22.813033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:22.930784 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2585/5191] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:22 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:22.936287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:22.954057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6c6c-1edd-4c65-8bad-da97aa50bcec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:22.961100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:22.962107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:22.962386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:22.962752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:22.963770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:22.965786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.009518 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2607/5192] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:22 2021] POST /identity/v3/projects => generated 360 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:23.014088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.026680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282dc8-f9ce-46ff-89e0-3aba226aee28 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.162800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.163798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.164081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.164488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1706529353` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.165938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=509807d7b2d741ac914e45107536e248, value=tempest-tag-1706529353)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.168206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.303084 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1706529353. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:12:23.303084 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:12:23.303084 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:12:23.324039 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2586/5193] 10.222.0.13 () {60 vars in 1332 bytes} [Wed Nov 10 04:12:23 2021] PUT /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1706529353 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Nov 10 04:12:23.326220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.339415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009a15-1c9f-486a-9689-5822a8567db4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.348876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.350400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.351040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.351508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1706529353` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.375652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=509807d7b2d741ac914e45107536e248, value=tempest-tag-1706529353)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.378824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.404965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.405574 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2608/5194] 10.222.0.13 () {58 vars in 1313 bytes} [Wed Nov 10 04:12:23 2021] GET /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1706529353 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:23.464132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70fdf-cadf-44dc-aa81-2b19f76cceaa tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.478844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.479817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.480101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.480657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.483814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=509807d7b2d741ac914e45107536e248)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.486409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.587731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2587/5195] 10.222.0.13 () {60 vars in 1264 bytes} [Wed Nov 10 04:12:23 2021] PUT /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags => generated 141 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:23.588653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.605157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b99a-da42-4a39-b67b-02a9622f27b7 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.610172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.611104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.611444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.611723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.624332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=509807d7b2d741ac914e45107536e248)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.626514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.638571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2609/5196] 10.222.0.13 () {58 vars in 1244 bytes} [Wed Nov 10 04:12:23 2021] GET /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags => generated 141 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:23.643963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.657542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b11c-3f57-4fcf-8dd6-c63c3091aa20 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.663081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.663977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.664255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.664530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1761094095` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.665858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=509807d7b2d741ac914e45107536e248, value=tempest-tag-1761094095)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.667970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.712495 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1761094095. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:12:23.712495 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:12:23.712495 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:12:23.718450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2588/5197] 10.222.0.13 () {58 vars in 1316 bytes} [Wed Nov 10 04:12:23 2021] DELETE /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1761094095 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:23.723424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.733762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0a4c-2d23-436f-be82-08ac613f5890 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.738849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.739766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.740043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.740312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1761094095` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.755737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=509807d7b2d741ac914e45107536e248, value=tempest-tag-1761094095)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.757476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.789963 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Could not find project tag: tempest-tag-1761094095.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1761094095. Nov 10 04:12:23.792657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2610/5198] 10.222.0.13 () {58 vars in 1313 bytes} [Wed Nov 10 04:12:23 2021] GET /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags/tempest-tag-1761094095 => generated 107 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:12:23.795727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.806754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8a9c5-0cb1-4be5-bc0b-a99560154370 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.813841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.814690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.815001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.815271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.817531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=509807d7b2d741ac914e45107536e248)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.820067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.869384 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2589/5199] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:12:23 2021] DELETE /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:23.872903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.885347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830b08-4cbc-452c-a6c7-3097a70fc3c4 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.891662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.892499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.892809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.893721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248/tags` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.910286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=509807d7b2d741ac914e45107536e248)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.913088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:23.927056 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2611/5200] 10.222.0.13 () {58 vars in 1244 bytes} [Wed Nov 10 04:12:23 2021] GET /identity/v3/projects/509807d7b2d741ac914e45107536e248/tags => generated 66 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 10 04:12:23.931625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:23.942666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ac62-9515-487d-bd83-7e36619b546d tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:23.947389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87bb4e6f2f594fc199a1b054f620facf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '207e2e6524f242fca81b8e9d8f4bf325', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:23.948272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:23.948553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:23.948879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] PATH_INFO: `/v3/projects/509807d7b2d741ac914e45107536e248` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:23.950081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorizing `identity:delete_project(project_id=509807d7b2d741ac914e45107536e248)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:23.952228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:24.011185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509807d7b2d741ac914e45107536e248', 'request_id': 'req-148af364-a819-43cc-9f7c-37f680221d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.019600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509807d7b2d741ac914e45107536e248', 'request_id': 'req-148af364-a819-43cc-9f7c-37f680221d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.030193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509807d7b2d741ac914e45107536e248', 'request_id': 'req-148af364-a819-43cc-9f7c-37f680221d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.046514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] The token cache is being invalidate because project 509807d7b2d741ac914e45107536e248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:24.046834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.048745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.050438 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2590/5201] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:23 2021] DELETE /identity/v3/projects/509807d7b2d741ac914e45107536e248 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:24.056554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:24.059984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:24.151322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d6851-4c16-489a-9e2e-7f3a907d05d9 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:24.184815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:24.189695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:24.246971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:24.248022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:24.248393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:24.248563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] PATH_INFO: `/v3/users/59cc21b5894343d4b6ac43bbe0822d05` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:24.250163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59cc21b5894343d4b6ac43bbe0822d05)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:24.253134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:24.305240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af364-a819-43cc-9f7c-37f680221d34 tempest-IdentityV3ProjectTagsTest-896132411 tempest-IdentityV3ProjectTagsTest-896132411-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:24.312520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:24.314065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:24.314207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:24.314367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:24.317029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:24.335085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:24.338710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80df70-dc6c-4eed-b987-76669905e287 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:24.352180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59cc21b5894343d4b6ac43bbe0822d05'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.354617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2591/5202] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:12:24.362911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59cc21b5894343d4b6ac43bbe0822d05'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.363579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59cc21b5894343d4b6ac43bbe0822d05'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.379428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59cc21b5894343d4b6ac43bbe0822d05'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.392117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59cc21b5894343d4b6ac43bbe0822d05'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:24.405299 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2612/5203] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:24 2021] DELETE /identity/v3/users/59cc21b5894343d4b6ac43bbe0822d05 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:24.410498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:24.410817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:24.411085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:24.437861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:24.439383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:24.540027 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2592/5204] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:24.553928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:24.555976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:24.638682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f410509-807d-4e27-a816-4d88c70fa389 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:24.643943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:24.644526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:24.644831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:24.645101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:24.663450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:24.665224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:24.684808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2613/5205] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:25.197565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:25.199519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:25.227448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb25f-6362-4147-adbc-af70a5537362 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:25.237382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:25.238873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:25.238873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:25.239154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] PATH_INFO: `/v3/projects/2ab0d21041c74c6e808a7c0b37c578f5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:25.249974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab0d21041c74c6e808a7c0b37c578f5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:25.253748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:25.367985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab0d21041c74c6e808a7c0b37c578f5', 'request_id': 'req-17780264-2f52-4faa-95c1-91d92c398ece'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.386620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab0d21041c74c6e808a7c0b37c578f5', 'request_id': 'req-17780264-2f52-4faa-95c1-91d92c398ece'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.399653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab0d21041c74c6e808a7c0b37c578f5', 'request_id': 'req-17780264-2f52-4faa-95c1-91d92c398ece'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.437997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] The token cache is being invalidate because project 2ab0d21041c74c6e808a7c0b37c578f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:25.438280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.443183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.446463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2593/5206] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:25 2021] DELETE /identity/v3/projects/2ab0d21041c74c6e808a7c0b37c578f5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:25.450384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:25.463279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6a86-1748-4af2-a4b6-4678b5890ee8 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:25.578011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:25.579378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:25.580106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:25.581176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] PATH_INFO: `/v3/users/87bb4e6f2f594fc199a1b054f620facf` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:25.582756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bb4e6f2f594fc199a1b054f620facf)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:25.585854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:25.699414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bb4e6f2f594fc199a1b054f620facf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.721135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bb4e6f2f594fc199a1b054f620facf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.722790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bb4e6f2f594fc199a1b054f620facf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.776949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bb4e6f2f594fc199a1b054f620facf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.805605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0470fdef-9427-47b9-aed7-5a9da60a9145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bb4e6f2f594fc199a1b054f620facf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:25.823557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2614/5207] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:25 2021] DELETE /identity/v3/users/87bb4e6f2f594fc199a1b054f620facf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:26.445981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:26.448110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:26.469658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780264-2f52-4faa-95c1-91d92c398ece admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:26.567334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:26.568312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:26.568902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:26.569456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] PATH_INFO: `/v3/projects/207e2e6524f242fca81b8e9d8f4bf325` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:26.570779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207e2e6524f242fca81b8e9d8f4bf325)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:26.573490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:26.671831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207e2e6524f242fca81b8e9d8f4bf325', 'request_id': 'req-00c4a2e0-d63e-475f-82f2-8c0c545ca311'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:26.682069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207e2e6524f242fca81b8e9d8f4bf325', 'request_id': 'req-00c4a2e0-d63e-475f-82f2-8c0c545ca311'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:26.696109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207e2e6524f242fca81b8e9d8f4bf325', 'request_id': 'req-00c4a2e0-d63e-475f-82f2-8c0c545ca311'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:26.736773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] The token cache is being invalidate because project 207e2e6524f242fca81b8e9d8f4bf325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:26.736773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:26.736773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00c4a2e0-d63e-475f-82f2-8c0c545ca311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:26.736773 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2594/5208] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:26 2021] DELETE /identity/v3/projects/207e2e6524f242fca81b8e9d8f4bf325 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:26.740573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:26.741231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:26.741231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:26.784925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:26.787340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:26.910519 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2615/5209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:26.921163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:26.921467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:26.921716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:26.945776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:26.947099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:26.964867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2595/5210] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:26.972702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:26.984874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ba4ce-c662-410c-87c8-2929a11ef9b7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.009435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.010350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.013519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.014028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.015538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:27.015875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.017885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.052665 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2616/5211] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:27.055816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.070758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9883ff3-c892-47a1-8e02-e2f6846a1411 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.081582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.082310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.082656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.082927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.085598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.087909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.152475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2596/5212] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:27 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:27.153710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.165980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465315-db32-40dc-8c94-a11e50fc84c6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.258849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.259534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.259832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.260113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.260977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.264498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.307331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2617/5213] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:27 2021] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:27.311597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.327574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdab04f-6810-439d-b37a-ac09fb601f2f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.336516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.337884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.338358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.338893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.340046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.342947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.358450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2597/5214] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:27 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:27.362804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.375758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b16c-688d-4d6a-b853-beb5b15d299d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.381508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.382606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.383825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.384398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.385465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.387356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab78d7-012f-455d-8c9c-96e1a64fce04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.404368 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2618/5215] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:27 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:27.405283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.420225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e35a6-0c35-4a1e-aa12-498dc7210b7e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.425832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.427006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.427151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.427417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] PATH_INFO: `/v3/projects/84d3df13dfb84837b1b44dfe7b0946d7/users/68ba4db542524c25985ffcc99a9f001a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.451295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d3df13dfb84837b1b44dfe7b0946d7, user_id=68ba4db542524c25985ffcc99a9f001a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.454099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.477213 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2598/5216] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:27 2021] PUT /identity/v3/projects/84d3df13dfb84837b1b44dfe7b0946d7/users/68ba4db542524c25985ffcc99a9f001a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:27.488848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.489166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.489402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.533402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] MFA Rules not processed for user `68ba4db542524c25985ffcc99a9f001a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:27.535494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:27.625229 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2619/5217] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:27.630985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.751951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc0a7-06bf-4102-a13d-d14a428ff68c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:27.761241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:27.762069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:27.762362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:27.762661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:27.763495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:27.770245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:27.847434 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2599/5218] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:27 2021] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:27.854636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:27.876161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61d4e-1e50-4f00-96c7-9e9382ab3b74 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.035127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.035767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.036215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.036413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.037639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.039273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.078120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2620/5219] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:27 2021] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:28.082627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:28.105946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203e88-e41b-4505-82e5-fbdb5bf47d68 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.116487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.120400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.122967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.123345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.124346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.126519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.139782 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2600/5220] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:28.144806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:28.162808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e816-46c7-44a6-a42f-496e558a7e50 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.168863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.169772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.170214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.170648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.171565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.173530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.194756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2621/5221] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:28.199774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:28.241881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c583-ae52-4494-ad28-e0d68bc7df92 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.255163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:28.257635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:28.262781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.263693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.264003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.264252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] PATH_INFO: `/v3/projects/704d7b688a644a199d9e40f36a53bb82/users/64c1457ca8974dd5a3549960d23701e2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.292308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704d7b688a644a199d9e40f36a53bb82, user_id=64c1457ca8974dd5a3549960d23701e2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.295962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af17c9-e0f5-40f3-ae37-dd39225353d5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.333311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2601/5222] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:28 2021] PUT /identity/v3/projects/704d7b688a644a199d9e40f36a53bb82/users/64c1457ca8974dd5a3549960d23701e2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:28.343718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7e64-209e-401e-bba4-da780968000e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.354419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7e64-209e-401e-bba4-da780968000e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.354419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7e64-209e-401e-bba4-da780968000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.374826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b7ec-aa79-4ec8-a4d1-cf6bbee0e50d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.406684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-367d7e64-209e-401e-bba4-da780968000e None None] MFA Rules not processed for user `64c1457ca8974dd5a3549960d23701e2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:28.409785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-367d7e64-209e-401e-bba4-da780968000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:28.472925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.473895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.474169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.474641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.477036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:28.492693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.494419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.505894 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2622/5223] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:12:28.518413 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2602/5224] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:28.523301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:28.638329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aecec-58c6-4aff-813e-50b4ea871e0e service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:28.647586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ba4db542524c25985ffcc99a9f001a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d3df13dfb84837b1b44dfe7b0946d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:28.648854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.649541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.650182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] PATH_INFO: `/v3/users/68ba4db542524c25985ffcc99a9f001a/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.652530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] RBAC: Authorizing `identity:list_user_projects(user_id=68ba4db542524c25985ffcc99a9f001a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:28.655405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1af5a-17d7-4074-9ae6-21702311fbe1 tempest-IdentityV3ProjectsTest-1101131612 tempest-IdentityV3ProjectsTest-1101131612-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:28.746918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2623/5225] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:12:28 2021] GET /identity/v3/users/68ba4db542524c25985ffcc99a9f001a/projects => generated 517 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:28.749790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.750311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.750670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.791913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] MFA Rules not processed for user `68ba4db542524c25985ffcc99a9f001a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:28.793635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:28.810608 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2603/5226] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:28.812639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:28.813005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:28.813536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:28.853971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] MFA Rules not processed for user `68ba4db542524c25985ffcc99a9f001a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:28.855245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:28.908168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.models.token_model [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] User 68ba4db542524c25985ffcc99a9f001a has no access to project 704d7b688a644a199d9e40f36a53bb82 {{(pid=96285) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Nov 10 04:12:28.914348 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0bf9537b-72c0-4083-9f2f-4cf0fb565397 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:12:28.916074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2624/5227] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:28 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 105 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:12:28.921825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:29.011041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c77a73-796d-4ba8-9860-03ece0e1f8ff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:29.016480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:29.017436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:29.017714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:29.018016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] PATH_INFO: `/v3/users/68ba4db542524c25985ffcc99a9f001a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:29.019270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ba4db542524c25985ffcc99a9f001a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:29.021329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:29.122105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ba4db542524c25985ffcc99a9f001a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:29.140111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ba4db542524c25985ffcc99a9f001a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:29.141462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ba4db542524c25985ffcc99a9f001a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:29.142692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ba4db542524c25985ffcc99a9f001a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:29.157703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ba4db542524c25985ffcc99a9f001a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:29.222370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2604/5228] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:28 2021] DELETE /identity/v3/users/68ba4db542524c25985ffcc99a9f001a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:29.225014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:29.225723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:29.225848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:29.263805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:29.265708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:29.388267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2625/5229] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:29.407521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:29.409704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:29.516687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b3bc-f71b-4d8a-ba22-9013c09448bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:29.524455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:29.525251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:29.525405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:29.526339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:29.542469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:29.544406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981df13-1c70-430f-b225-9888fd799fe6 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:29.559757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2605/5230] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:30.074357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:30.077125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:30.108322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7626-1ce4-4db6-912b-5613c7d45cd6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:30.110026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:30.111584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:30.111584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:30.119142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:30.120135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:30.121328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:30.122728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] PATH_INFO: `/v3/projects/84d3df13dfb84837b1b44dfe7b0946d7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:30.124171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d3df13dfb84837b1b44dfe7b0946d7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:30.126189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:30.132529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] MFA Rules not processed for user `202de6cb73e547f8a449898bf46a05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:30.134831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:30.243449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d3df13dfb84837b1b44dfe7b0946d7', 'request_id': 'req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.256972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2606/5231] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:30.257132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d3df13dfb84837b1b44dfe7b0946d7', 'request_id': 'req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.264263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d3df13dfb84837b1b44dfe7b0946d7', 'request_id': 'req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.283548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] The token cache is being invalidate because project 84d3df13dfb84837b1b44dfe7b0946d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:30.283868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.284585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.287010 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2626/5232] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:30 2021] DELETE /identity/v3/projects/84d3df13dfb84837b1b44dfe7b0946d7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:30.291245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:30.319080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07357648-a4dd-4a5f-8e7d-b8a1c950f208 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:30.387882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:30.388801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:30.389080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:30.389507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] PATH_INFO: `/v3/users/64c1457ca8974dd5a3549960d23701e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:30.390789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c1457ca8974dd5a3549960d23701e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:30.393703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:30.494581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c1457ca8974dd5a3549960d23701e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.510422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c1457ca8974dd5a3549960d23701e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.510893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c1457ca8974dd5a3549960d23701e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.511558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c1457ca8974dd5a3549960d23701e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.529576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a2bd3827-0db2-4b53-8e1c-ef38bce1ab11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c1457ca8974dd5a3549960d23701e2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:30.554996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2607/5233] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:30 2021] DELETE /identity/v3/users/64c1457ca8974dd5a3549960d23701e2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:31.200463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:31.210194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:31.265611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5945-66b0-45b0-926e-fe5cd5c5fcd9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:31.392598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:31.401024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:31.401795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:31.402660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] PATH_INFO: `/v3/projects/704d7b688a644a199d9e40f36a53bb82` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:31.405417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704d7b688a644a199d9e40f36a53bb82)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:31.409933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:31.541992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704d7b688a644a199d9e40f36a53bb82', 'request_id': 'req-6bd44fab-4e1b-43bc-a5c8-49772827bc67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:31.558880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704d7b688a644a199d9e40f36a53bb82', 'request_id': 'req-6bd44fab-4e1b-43bc-a5c8-49772827bc67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:31.568222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704d7b688a644a199d9e40f36a53bb82', 'request_id': 'req-6bd44fab-4e1b-43bc-a5c8-49772827bc67'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:31.611643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] The token cache is being invalidate because project 704d7b688a644a199d9e40f36a53bb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:31.616556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:31.618362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bd44fab-4e1b-43bc-a5c8-49772827bc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:31.620290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2627/5234] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:31 2021] DELETE /identity/v3/projects/704d7b688a644a199d9e40f36a53bb82 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:31.627425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:31.629390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:31.629390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:31.666382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:31.668084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:31.785141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2608/5235] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:31.792739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:31.793278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:31.793697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:31.856397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:31.857654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:31.867724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2628/5236] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:31.873063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:31.894482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81f04a-7bd6-42cf-8eed-4680a5a1f7f2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:31.902225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:31.902894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:31.903169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:31.903437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:31.904365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:31.904710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:31.906323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:31.925505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2609/5237] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:31.930039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:31.952942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f8df-e268-428f-8515-a599f890eda2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:31.959846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:31.961069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:31.961591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:31.962300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:31.963450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:31.966113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:31.975286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:31.977433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:32.007683 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2629/5238] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:31 2021] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:32.009010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.017175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a849-a7de-4257-8ccf-f43dc1cc6719 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.096818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c482-bdde-4178-883d-c6b9e23a93e4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.102603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.103689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.104192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.104708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.105641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.137439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.141147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.143693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.144556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.145996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] PATH_INFO: `/v3/users/99798be20500461c994645777b26d264` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.148047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99798be20500461c994645777b26d264)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.154299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.177906 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2630/5239] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:32 2021] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:32.181397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.209347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b4c2-fb1e-4742-bd51-522436efb40b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.216556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.219343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.219633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.219882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.220646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.223190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.239401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99798be20500461c994645777b26d264'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:32.250183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99798be20500461c994645777b26d264'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:32.251076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99798be20500461c994645777b26d264'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:32.251728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99798be20500461c994645777b26d264'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:32.262543 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2631/5240] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:32 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:32.267644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.276948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3cf97cc4-9185-4349-8cea-30e6119dd117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99798be20500461c994645777b26d264'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:32.277856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:32.310156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2326-aeac-48df-881a-cf7b7ac6ed83 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.328152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2610/5241] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:31 2021] DELETE /identity/v3/users/99798be20500461c994645777b26d264 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:32.334296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.335191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.335626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.336051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] PATH_INFO: `/v3/projects/6698996b9fa440a58fc3e54441c10a6e/users/34647cdd56864bedb8e694a3bb4a9318/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.339573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.340005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.340368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.358909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6698996b9fa440a58fc3e54441c10a6e, user_id=34647cdd56864bedb8e694a3bb4a9318, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.362352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:32.363661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:32.364887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.408072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2632/5242] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:32 2021] PUT /identity/v3/projects/6698996b9fa440a58fc3e54441c10a6e/users/34647cdd56864bedb8e694a3bb4a9318/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:32.412337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.484751 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2611/5243] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:32.497835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.500444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:32.548053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3403-8238-4f62-8e61-1d8068377f9f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.558349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.559237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.559683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.560155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.560949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.563114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.575551 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2633/5244] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:32 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:32.582799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.616349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fe2c-6ad5-4a4b-9b1d-9aa0924c7ff0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.623870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.624838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.625381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.626231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] PATH_INFO: `/v3/projects/6698996b9fa440a58fc3e54441c10a6e/users/34647cdd56864bedb8e694a3bb4a9318/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.630675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6698996b9fa440a58fc3e54441c10a6e, user_id=34647cdd56864bedb8e694a3bb4a9318, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.632500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0916b5a-3678-49fa-bbb7-2fca9b013328 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:32.635242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78da0d-c5bb-48b6-8dc2-eb28293c722b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.650090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2634/5245] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:32 2021] PUT /identity/v3/projects/6698996b9fa440a58fc3e54441c10a6e/users/34647cdd56864bedb8e694a3bb4a9318/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:32.667893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.668646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.669255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.715010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] MFA Rules not processed for user `34647cdd56864bedb8e694a3bb4a9318`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:32.717516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:32.760320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:32.761349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:32.761673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:32.762785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:32.796785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:32.798743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:32.845114 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2612/5246] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:32.920411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2635/5247] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:32 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:32.921804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:32.937393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc82407-78e0-4877-a3a9-cd18213a9c58 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.131203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.133009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.133490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.133906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.135058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.138848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.228574 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2613/5248] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:32 2021] POST /identity/v3/projects => generated 391 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:33.232584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.251476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a265c1-5430-4060-9727-4d493f0536f9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.418845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.421393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:33.465572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.472303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.473207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.474586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.475509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.480811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.524310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2636/5249] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:33 2021] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:33.528624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.552048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70560-c673-4cd3-848f-bcf3c437db6a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.566072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.567052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.567490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.567923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.568968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.572056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.594272 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2637/5250] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:33 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:33.595674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.607444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297d38-cabe-45f7-8e93-433f6784f9b7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.615677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.617392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.619028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.619496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.620471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.622416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.648491 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2638/5251] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:33 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:33.649683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.662063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05195b4-7f1c-44bf-8ee6-eca8dec6847d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.663805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9cfc2-d566-4f9d-91ff-f4cdbf73f967 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:33.669610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.670749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.671302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.671752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] PATH_INFO: `/v3/projects/dec64a0030a64ea6b71f92df1f2d8ff2/users/a49ec1680fed41c2a4ca770a2509e15a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.672177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:33.673369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.674814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.675196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] PATH_INFO: `/v3/projects/445e25acae4d425ea5d2c34a6876043a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.678282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=445e25acae4d425ea5d2c34a6876043a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.680653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.701762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec64a0030a64ea6b71f92df1f2d8ff2, user_id=a49ec1680fed41c2a4ca770a2509e15a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:33.704855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242db3d-f8cf-4660-a210-39fc0b5727a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:33.731908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2639/5252] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:33 2021] PUT /identity/v3/projects/dec64a0030a64ea6b71f92df1f2d8ff2/users/a49ec1680fed41c2a4ca770a2509e15a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:33.745398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.745680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.746215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.766504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445e25acae4d425ea5d2c34a6876043a', 'request_id': 'req-02a168f0-ed53-4cc9-8146-65c1f3158f4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:33.775067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445e25acae4d425ea5d2c34a6876043a', 'request_id': 'req-02a168f0-ed53-4cc9-8146-65c1f3158f4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:33.782489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] MFA Rules not processed for user `a49ec1680fed41c2a4ca770a2509e15a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:33.784272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:33.787076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445e25acae4d425ea5d2c34a6876043a', 'request_id': 'req-02a168f0-ed53-4cc9-8146-65c1f3158f4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:33.813345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] The token cache is being invalidate because project 445e25acae4d425ea5d2c34a6876043a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:33.813861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:33.815302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-02a168f0-ed53-4cc9-8146-65c1f3158f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:33.820039 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2614/5253] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:33 2021] DELETE /identity/v3/projects/445e25acae4d425ea5d2c34a6876043a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:33.835564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a830-75fa-44f1-9305-3a4fb55964bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:33.837148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a830-75fa-44f1-9305-3a4fb55964bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:33.838623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a830-75fa-44f1-9305-3a4fb55964bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:33.871685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b451a830-75fa-44f1-9305-3a4fb55964bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:33.881667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b451a830-75fa-44f1-9305-3a4fb55964bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:33.963115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2640/5254] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:33 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:33.977170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:33.980206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:34.087515 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2615/5255] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:34.094819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.095547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.096405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.129233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:34.130975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af046-a17a-40a9-90b9-9adacd8dcf94 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.131127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:34.142222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.143480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.143745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.144073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.147687 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2616/5256] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:34.149579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.150954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:34.165573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f760e-8506-4052-b6e3-97aa5fb61e34 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.171975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.173172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.173550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.173861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.175362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:34.175860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.180901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.200735 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2617/5257] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:34.205187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.228254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb613c-1ebc-4e7e-82e2-365ec9c574ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.241643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.242472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.249860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.250259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.252809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.257650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.271221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.273276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.287827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2641/5258] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:33 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:34.335941 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2618/5259] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:34 2021] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:34.340056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.365894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7739d4-c943-4d76-b6b3-c6a98867ab0d service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.448111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.448887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.449997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.450281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.451246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.454215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.488659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2642/5260] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:34 2021] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:34.491544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.503563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445a5d7-a154-4a55-a670-19b1299189ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.514036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.514638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.514914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.515333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.515918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.520052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.541078 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2619/5261] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:34 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:34.546160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.563191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb301-32ca-41ad-9067-8e4f19d99472 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.576599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.577349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.577616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.577962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.578641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.588688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61be1e-9674-4387-b74a-f81a8b39dfaa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.617697 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2643/5262] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:34 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:34.624161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:34.640948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5a8ec-545a-42d8-ba05-ac74a00c4a3e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:34.646864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:34.648113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.648790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.664256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] PATH_INFO: `/v3/projects/039e3178e1c54d10996ea32eb3342123/users/ab0c0319a4434266857862c4a8c08eb1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.708952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=039e3178e1c54d10996ea32eb3342123, user_id=ab0c0319a4434266857862c4a8c08eb1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:34.719473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c90cc5-f527-4755-98a5-3234d3c60abb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:34.753132 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2620/5263] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:34 2021] PUT /identity/v3/projects/039e3178e1c54d10996ea32eb3342123/users/ab0c0319a4434266857862c4a8c08eb1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:34.763440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.763981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.764404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.810162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] MFA Rules not processed for user `ab0c0319a4434266857862c4a8c08eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:34.812293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:34.936299 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2644/5264] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:34.947895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:34.948105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:34.948315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:34.976152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] MFA Rules not processed for user `ab0c0319a4434266857862c4a8c08eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:34.977758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:34.997110 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2621/5265] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:35.006710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:35.008501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.138354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9adb5-c33f-42cf-b593-40b8285ba2dc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:35.161053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:35.161719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.162257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.162810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.173786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:35.176097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a06ef-d07a-4b80-85dd-e29dd3ac98e9 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:35.199794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2645/5266] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:35.235234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:35.237363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.318033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd73884-eeb9-41d0-9d3b-5ca3ba838ccf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:35.323039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:35.323985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.324334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.324719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] PATH_INFO: `/v3/users/34647cdd56864bedb8e694a3bb4a9318` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.326434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34647cdd56864bedb8e694a3bb4a9318)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:35.328286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:35.391674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fda86-4592-40eb-9548-49bb2959901b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.393272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fda86-4592-40eb-9548-49bb2959901b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.394109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fda86-4592-40eb-9548-49bb2959901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.411106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34647cdd56864bedb8e694a3bb4a9318'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:35.414681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fc0fda86-4592-40eb-9548-49bb2959901b None None] MFA Rules not processed for user `b14e52c2dee142bb896f6e0e61e52426`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:35.421967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34647cdd56864bedb8e694a3bb4a9318'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:35.423187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34647cdd56864bedb8e694a3bb4a9318'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:35.423418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34647cdd56864bedb8e694a3bb4a9318'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:35.425234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc0fda86-4592-40eb-9548-49bb2959901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.436706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34647cdd56864bedb8e694a3bb4a9318'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:35.485514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2622/5267] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:35 2021] DELETE /identity/v3/users/34647cdd56864bedb8e694a3bb4a9318 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:35.486458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:35.488519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.497359 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2646/5268] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:35.498935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.499217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.499484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.521924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:35.523452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.593922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c023ec-3f9d-4f21-9b08-800f3a764d4e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:35.599656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:35.600295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.600576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.600984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.601610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2647/5269] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:35.605477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.612975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:35.615541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:35.620580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:35.622108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:35.633343 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2623/5270] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:35.684172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf800-ed7f-43ee-898d-b0127637fda4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:35.687902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:35.688542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:35.689071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:35.689350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:35.711753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:35.713262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:35.726877 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2648/5271] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:36.128996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:36.130968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:36.153114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5096cbc-d152-4004-811e-dfba3dbcd08b service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:36.159137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:36.159848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:36.160126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:36.160398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] PATH_INFO: `/v3/projects/6698996b9fa440a58fc3e54441c10a6e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:36.162483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6698996b9fa440a58fc3e54441c10a6e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:36.164405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:36.218410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6698996b9fa440a58fc3e54441c10a6e', 'request_id': 'req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.224342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6698996b9fa440a58fc3e54441c10a6e', 'request_id': 'req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.230888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6698996b9fa440a58fc3e54441c10a6e', 'request_id': 'req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.245441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] The token cache is being invalidate because project 6698996b9fa440a58fc3e54441c10a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:36.245729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.246365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.247893 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2624/5272] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:36 2021] DELETE /identity/v3/projects/6698996b9fa440a58fc3e54441c10a6e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:36.252827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:36.264571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a0ad-bb28-4d55-a48c-c71ea102ad99 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:36.322928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:36.324223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:36.324223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:36.324464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] PATH_INFO: `/v3/users/a49ec1680fed41c2a4ca770a2509e15a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:36.325864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49ec1680fed41c2a4ca770a2509e15a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:36.327806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:36.396593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49ec1680fed41c2a4ca770a2509e15a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.403680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49ec1680fed41c2a4ca770a2509e15a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.404390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49ec1680fed41c2a4ca770a2509e15a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.421496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49ec1680fed41c2a4ca770a2509e15a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.430424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8953c07d-fcbc-483a-8859-cab6460fe289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49ec1680fed41c2a4ca770a2509e15a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:36.437962 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2649/5273] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:36 2021] DELETE /identity/v3/users/a49ec1680fed41c2a4ca770a2509e15a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:37.131278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.133799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:37.158340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f0e4-77b2-4e77-a8b9-cf31d4be64ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.244918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.257805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.258362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.258920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] PATH_INFO: `/v3/projects/dec64a0030a64ea6b71f92df1f2d8ff2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.260556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec64a0030a64ea6b71f92df1f2d8ff2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.268747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.333574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec64a0030a64ea6b71f92df1f2d8ff2', 'request_id': 'req-ac2829ec-994a-4a4e-97cf-ef830ba92d26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:37.339997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec64a0030a64ea6b71f92df1f2d8ff2', 'request_id': 'req-ac2829ec-994a-4a4e-97cf-ef830ba92d26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:37.361254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec64a0030a64ea6b71f92df1f2d8ff2', 'request_id': 'req-ac2829ec-994a-4a4e-97cf-ef830ba92d26'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:37.384732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] The token cache is being invalidate because project dec64a0030a64ea6b71f92df1f2d8ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:37.385215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:37.386023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ac2829ec-994a-4a4e-97cf-ef830ba92d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:37.387721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2625/5274] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:37 2021] DELETE /identity/v3/projects/dec64a0030a64ea6b71f92df1f2d8ff2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:37.393868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.394218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.394585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.415719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:37.418121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:37.483194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2650/5275] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:37.491679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035710-3cca-43b9-b777-972a0344337a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.491963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035710-3cca-43b9-b777-972a0344337a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.492237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035710-3cca-43b9-b777-972a0344337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.510799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c3035710-3cca-43b9-b777-972a0344337a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:37.511990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3035710-3cca-43b9-b777-972a0344337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:37.521317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2626/5276] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:37.525627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.535755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5baa0-51a4-44a5-9288-e18f3ac74486 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.540684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.541337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.541614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.541890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.542621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:37.542923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.544535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.556953 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2651/5277] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:37.561121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035710-3cca-43b9-b777-972a0344337a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.570061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035710-3cca-43b9-b777-972a0344337a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.574968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.575614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.575890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.576427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.577343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.579239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.605848 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2627/5278] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:37 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:37.610468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.622712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaff1a5-4f4e-4233-84b0-38fc5ae94ffe admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.701807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.703256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.703913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.704430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.705691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.708455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.734618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2652/5279] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:37 2021] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:37.739595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.752066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6571e0-db47-46f3-baf4-4866c395aa03 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.758386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.759249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.759968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.760399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.761338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.763332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.778173 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2628/5280] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:37 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:37.779971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.790690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829b0b-b8a4-4aeb-a36b-977b5e23a731 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.795614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.796500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.796814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.797099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] PATH_INFO: `/v3/projects/955fab27e28d4692ba4e39e1cb823440/users/b493aef2c1684b00828d5a1e1044f067/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.814773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] RBAC: Authorizing `identity:create_grant(project_id=955fab27e28d4692ba4e39e1cb823440, user_id=b493aef2c1684b00828d5a1e1044f067, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.817831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.837172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2653/5281] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:37 2021] PUT /identity/v3/projects/955fab27e28d4692ba4e39e1cb823440/users/b493aef2c1684b00828d5a1e1044f067/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:37.841097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.868353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad537-626e-4e5f-835f-d408656786f5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.939204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.939938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.940218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.941042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.941243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:37.943155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c018137-5726-4b15-aaf0-bd392f0793c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:37.958476 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2629/5282] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:37 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:37.959523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:37.972931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67b1e-9617-40b6-add1-bff7bffa427e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:37.993685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:37.995325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:37.995620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:37.995908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] PATH_INFO: `/v3/projects/955fab27e28d4692ba4e39e1cb823440/users/b493aef2c1684b00828d5a1e1044f067/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:37.998153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955fab27e28d4692ba4e39e1cb823440, user_id=b493aef2c1684b00828d5a1e1044f067, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.001257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.015824 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2654/5283] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:37 2021] PUT /identity/v3/projects/955fab27e28d4692ba4e39e1cb823440/users/b493aef2c1684b00828d5a1e1044f067/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:38.028053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.028385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.028688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.072588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] MFA Rules not processed for user `b493aef2c1684b00828d5a1e1044f067`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:38.073992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:38.113999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.116208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:38.213810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2630/5284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:38 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:38.217949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.238205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5d80b-8e05-4e55-8168-fed2f24771c4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.246752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.247414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.247693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.247970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.249866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:38.261334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.263019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.274807 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2655/5285] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:12:38.297668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94beb9-6100-4cea-8918-605c6b3bfe08 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.302648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.303309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.303734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.304020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.304781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.306825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.335073 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2631/5286] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:38 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:38.339217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.352013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898412c3-8247-4696-8238-8c466f98511a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.410852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.411827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.412134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.412525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.413353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.416005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.448729 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2656/5287] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:38 2021] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:38.453069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.464648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801e1-a2c1-4979-896c-f8f03e5e79d4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.472659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.473451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.473803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.474168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.475017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.476712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.490349 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2632/5288] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:38.494064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.505919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146c41-b96e-467c-97b6-ed638d65b868 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.511656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.513639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.514048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.514647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.515472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.517404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3b11-e19e-4bfe-b5d3-99fe4b516519 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.533181 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2657/5289] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:38.537418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.548858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82233-b4d3-435a-90df-4004d656d77f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.555642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.556746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.557125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.557466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] PATH_INFO: `/v3/projects/f789afc7c3b84e0a9a85c0680f54962a/users/e7ceb43d3dc5454d9dae83182f6082af/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.574161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f789afc7c3b84e0a9a85c0680f54962a, user_id=e7ceb43d3dc5454d9dae83182f6082af, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.577112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.592746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2633/5290] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:38 2021] PUT /identity/v3/projects/f789afc7c3b84e0a9a85c0680f54962a/users/e7ceb43d3dc5454d9dae83182f6082af/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:38.602915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.603205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.603481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.635608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] MFA Rules not processed for user `e7ceb43d3dc5454d9dae83182f6082af`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:38.636840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:38.704930 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2658/5291] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:38 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:38.721177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:38.723012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:38.781482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e94b-fc7b-4466-87eb-cdd006f73dc4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:38.785288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:38.786241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:38.786406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:38.786643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:38.871380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:38.873108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc8cea-6767-44e8-95bb-839696fc6074 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:38.883748 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2634/5292] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:38 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:12:39.481107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:39.543733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8676cda-8cf7-4593-82ae-1ceeb7e3fed7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:39.548117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:39.549507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:39.549782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:39.550050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] PATH_INFO: `/v3/users/b493aef2c1684b00828d5a1e1044f067` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:39.551246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b493aef2c1684b00828d5a1e1044f067)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:39.553187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:39.600311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b493aef2c1684b00828d5a1e1044f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:39.607110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b493aef2c1684b00828d5a1e1044f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:39.607875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b493aef2c1684b00828d5a1e1044f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:39.619518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b493aef2c1684b00828d5a1e1044f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:39.626330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b493aef2c1684b00828d5a1e1044f067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:39.632953 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2659/5293] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:39 2021] DELETE /identity/v3/users/b493aef2c1684b00828d5a1e1044f067 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:39.637416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:39.637935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:39.637935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:39.654550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:39.655739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:39.716382 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2635/5294] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:39.727915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:39.729372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:39.789354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d7cf1-f78a-4f4d-bd3e-0cd3b92a3360 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:39.793042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:39.793696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:39.794027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:39.794234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:39.805033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:39.806791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:39.817578 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2660/5295] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:40.101588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:40.103183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:40.124660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc469ee3-05a1-4240-aa18-724e16b518df None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:40.131367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:40.132369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:40.133120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:40.133324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] PATH_INFO: `/v3/projects/955fab27e28d4692ba4e39e1cb823440` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:40.144186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955fab27e28d4692ba4e39e1cb823440)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:40.146441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:40.229773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955fab27e28d4692ba4e39e1cb823440', 'request_id': 'req-a1f61b9a-587f-4fd2-8035-994b34b33d62'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.236920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955fab27e28d4692ba4e39e1cb823440', 'request_id': 'req-a1f61b9a-587f-4fd2-8035-994b34b33d62'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.248738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955fab27e28d4692ba4e39e1cb823440', 'request_id': 'req-a1f61b9a-587f-4fd2-8035-994b34b33d62'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.265511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] The token cache is being invalidate because project 955fab27e28d4692ba4e39e1cb823440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:40.266581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.268298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.270345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2636/5296] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:40 2021] DELETE /identity/v3/projects/955fab27e28d4692ba4e39e1cb823440 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:40.274186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:40.292569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ad7ce-a06f-4307-8e63-6dd013a14e0a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:40.355773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:40.356783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:40.357059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:40.357330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] PATH_INFO: `/v3/users/e7ceb43d3dc5454d9dae83182f6082af` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:40.358694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ceb43d3dc5454d9dae83182f6082af)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:40.360636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:40.437977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ceb43d3dc5454d9dae83182f6082af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.446638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ceb43d3dc5454d9dae83182f6082af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.447522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ceb43d3dc5454d9dae83182f6082af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.466007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ceb43d3dc5454d9dae83182f6082af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.477679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d1504fb4-fcbc-4d0c-b983-a31339387c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ceb43d3dc5454d9dae83182f6082af'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:40.488223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2661/5297] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:40 2021] DELETE /identity/v3/users/e7ceb43d3dc5454d9dae83182f6082af => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:40.941749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:40.943293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:40.957122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61b9a-587f-4fd2-8035-994b34b33d62 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.025190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.026117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.026393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.026667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] PATH_INFO: `/v3/projects/f789afc7c3b84e0a9a85c0680f54962a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.028495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f789afc7c3b84e0a9a85c0680f54962a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.030470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.075737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f789afc7c3b84e0a9a85c0680f54962a', 'request_id': 'req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:41.082954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f789afc7c3b84e0a9a85c0680f54962a', 'request_id': 'req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:41.091736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f789afc7c3b84e0a9a85c0680f54962a', 'request_id': 'req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:41.106283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] The token cache is being invalidate because project f789afc7c3b84e0a9a85c0680f54962a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:41.106661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:41.107312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ddbcd9fd-c681-4860-94ab-5abf4cfe49ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:41.109097 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2637/5298] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:40 2021] DELETE /identity/v3/projects/f789afc7c3b84e0a9a85c0680f54962a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:41.114702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.114986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.115281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.134462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:41.135780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:41.193406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2662/5299] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:41.201716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.202069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.202409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.221765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:41.223150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:41.231123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2638/5300] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:41.235460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.245381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80b04-e755-41e0-bcce-f294031cbaa3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.250430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.251088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.251370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.251643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.252566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:41.252896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.254486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.266633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2663/5301] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:41.271385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.280520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138783f-ecfc-4e39-b9f4-ec613dda1db8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.286157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.286940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.287096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.287449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.288056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.289966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.319886 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2639/5302] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:41.324147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.335616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20d6a-e8f6-4ae8-ae4d-f4c4821250bb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.389831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.390494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.390770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.391073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.391781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.394284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.418219 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2664/5303] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:41.419725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.430428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adcc5-34bc-4ca5-85ac-df1408968e2f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.435126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.435788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.436069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.436344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.437115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.438684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.449698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2640/5304] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:41.453881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.467711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3282e-f968-4aa7-a983-a509523d5bf1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.474716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.475793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.475793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.476030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.476859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.478491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d2617-58b5-40fc-9510-8dccd0704622 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.489601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2665/5305] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:41.493389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.504128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82f3d-0afe-42f0-8a50-c617659f5b1b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.509114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.509994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.510278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.510551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] PATH_INFO: `/v3/projects/737e53db1a284b8091da7b1bf7c0828b/users/716c7a7990724586bd0753055b091210/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.530863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737e53db1a284b8091da7b1bf7c0828b, user_id=716c7a7990724586bd0753055b091210, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.533528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.545951 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2641/5306] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:41 2021] PUT /identity/v3/projects/737e53db1a284b8091da7b1bf7c0828b/users/716c7a7990724586bd0753055b091210/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:41.556191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b678-2ea2-4c79-be94-6324909fc499 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.556476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b678-2ea2-4c79-be94-6324909fc499 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.556774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b678-2ea2-4c79-be94-6324909fc499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.584340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-80c9b678-2ea2-4c79-be94-6324909fc499 None None] MFA Rules not processed for user `716c7a7990724586bd0753055b091210`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:41.585752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80c9b678-2ea2-4c79-be94-6324909fc499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:41.648912 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2666/5307] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:41.665543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:41.667325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:41.726957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94589e-a711-4e43-b660-455c0be70841 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:41.730544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:41.731183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.731460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.731786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.741346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:41.742767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:41.751993 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2642/5308] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:41 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:41.868108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce78ef-1999-4158-a194-1b87ee224046 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:41.868393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce78ef-1999-4158-a194-1b87ee224046 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:41.868893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce78ef-1999-4158-a194-1b87ee224046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:41.889388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dcce78ef-1999-4158-a194-1b87ee224046 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:41.890696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dcce78ef-1999-4158-a194-1b87ee224046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:41.969918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2667/5309] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:42.038448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:42.040459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:42.120140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ca0-1b31-44a8-aa46-c7218361e023 service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:42.125610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:42.126253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.126533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.126812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.135203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:42.136799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:42.145645 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2643/5310] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:42.354632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1bc6e-4914-4442-b1a8-49b2fa7d9fb7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.354991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1bc6e-4914-4442-b1a8-49b2fa7d9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.355338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1bc6e-4914-4442-b1a8-49b2fa7d9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.373672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-03b1bc6e-4914-4442-b1a8-49b2fa7d9fb7 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:42.374976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-03b1bc6e-4914-4442-b1a8-49b2fa7d9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:42.382638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2668/5311] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:42.395527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:42.406384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f3d5-e1e2-4bd5-bf24-dc0e61c9a336 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:42.411476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:42.412215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.412372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.412713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.422226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:42.424412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:42.432300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2644/5312] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:42.643708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6226d8-a2e4-4112-9a20-1ed9ebdfa306 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.644174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6226d8-a2e4-4112-9a20-1ed9ebdfa306 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.644270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6226d8-a2e4-4112-9a20-1ed9ebdfa306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.661518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2c6226d8-a2e4-4112-9a20-1ed9ebdfa306 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:42.662707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c6226d8-a2e4-4112-9a20-1ed9ebdfa306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:42.669919 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2669/5313] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:42.682876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:42.694311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6e854-d214-4c0e-93cf-6fccb969cde1 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:42.699302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:42.699921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.700227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.700495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.708629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:42.710218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:42.718220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2645/5314] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:42.918696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbade-00ff-4bad-a785-020c5c0ce612 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.919093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbade-00ff-4bad-a785-020c5c0ce612 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.919588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbade-00ff-4bad-a785-020c5c0ce612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.939604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eefdbade-00ff-4bad-a785-020c5c0ce612 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:42.941223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eefdbade-00ff-4bad-a785-020c5c0ce612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:42.948787 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2670/5315] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:42.961761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:42.974595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c11d-d74f-4b75-88df-f48cf33e3a29 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:42.980867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:42.981512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:42.981774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:42.982050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:42.994654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:42.996473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:43.007020 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2646/5316] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:43.304311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519db01-4aa7-4a4f-98ab-18a5ff26d8a5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:43.304601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519db01-4aa7-4a4f-98ab-18a5ff26d8a5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:43.304911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519db01-4aa7-4a4f-98ab-18a5ff26d8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:43.323657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5519db01-4aa7-4a4f-98ab-18a5ff26d8a5 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:43.325238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5519db01-4aa7-4a4f-98ab-18a5ff26d8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:43.334114 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2671/5317] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:43.349644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:43.364258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec201d-2b03-4365-906f-251823dda817 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:43.370636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:43.371633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:43.372099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:43.372587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:43.382207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:43.383927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:43.393841 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2647/5318] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:43.632147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba9ac-be67-411f-a74f-b1e9a21afd48 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:43.632431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba9ac-be67-411f-a74f-b1e9a21afd48 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:43.632741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba9ac-be67-411f-a74f-b1e9a21afd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:43.650562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-576ba9ac-be67-411f-a74f-b1e9a21afd48 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:43.651741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-576ba9ac-be67-411f-a74f-b1e9a21afd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:43.659197 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2672/5319] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:43.672539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:43.683192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1525-d5fa-45dd-8cf7-10448b040b62 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:43.688192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:43.688854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:43.689131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:43.689958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:43.697983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:43.699509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:43.708541 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2648/5320] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:44.573439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c52c-1815-4838-9b90-9643a9c4df72 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:44.573822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c52c-1815-4838-9b90-9643a9c4df72 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:44.574164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c52c-1815-4838-9b90-9643a9c4df72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:44.593637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1691c52c-1815-4838-9b90-9643a9c4df72 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:44.594923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1691c52c-1815-4838-9b90-9643a9c4df72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:44.602774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2673/5321] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:44.615836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:44.627545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35590518-d54f-4d96-a65f-515f03beb419 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:44.632745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:44.633501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:44.633786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:44.634061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:44.642532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:44.644769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:44.652769 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2649/5322] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:44.792688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b290c6-3a79-47dd-bda2-fc29fc90bed5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:44.793147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b290c6-3a79-47dd-bda2-fc29fc90bed5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:44.793291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b290c6-3a79-47dd-bda2-fc29fc90bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:44.810997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f1b290c6-3a79-47dd-bda2-fc29fc90bed5 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:44.812174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f1b290c6-3a79-47dd-bda2-fc29fc90bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:44.819947 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2674/5323] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:44.833160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:44.843851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1732a-4074-492e-aa11-f660ee2dce65 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:44.848776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:44.849398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:44.849671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:44.849941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:44.858049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:44.859608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:44.868306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2650/5324] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:45.007511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6b4-45bd-4d96-a610-9eba9517d532 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.007795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6b4-45bd-4d96-a610-9eba9517d532 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.008091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6b4-45bd-4d96-a610-9eba9517d532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.026953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a4a1f6b4-45bd-4d96-a610-9eba9517d532 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:45.028268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a4a1f6b4-45bd-4d96-a610-9eba9517d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.037021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2675/5325] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:45.051272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:45.062913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510e8b-5e53-4888-a041-83b26bdc1051 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:45.068102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:45.068773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.069055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.069336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.077953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:45.079513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:45.087703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2651/5326] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:45.230641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.231246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.231523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.260640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:45.262357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.272097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2676/5327] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:45.294131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:45.306373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f684e6-7f6a-45fd-b327-caad3dfcd5ba service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:45.311675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:45.312322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.312600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.312902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.324841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:45.324841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649b43-3f74-4976-a5c8-4c1cde9ab6a1 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:45.333504 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2652/5328] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:45.429735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:45.431381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.514521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.514784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.515057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.537298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:45.538795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.548495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2653/5329] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:45.568261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d546f0-d68a-4b10-a806-983a6b6f36a6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:45.568412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:45.576322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:45.577037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.577497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.577939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.580039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.581633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf322bf-b048-499e-9bcc-fa9693aeb134 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:45.588563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:45.589309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.589744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.589967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.596850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:45.598429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384b800-0b9a-4f3f-a848-c37711bf4ab9 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:45.606434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:45.608136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:45.612378 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2677/5330] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:45.620091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2654/5331] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:12:45.775937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82033-f6db-40c5-8047-70529aba823d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.776574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82033-f6db-40c5-8047-70529aba823d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.776951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82033-f6db-40c5-8047-70529aba823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.797766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-49a82033-f6db-40c5-8047-70529aba823d None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:45.799629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49a82033-f6db-40c5-8047-70529aba823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:45.816700 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2678/5332] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:12:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:45.831068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:45.842161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2ffd-ff11-4dc5-8136-0127e72ff953 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:45.847693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:45.848422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:45.848735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:45.849006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:45.857026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:45.858555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77609f-620d-40f6-994a-82d09b4318a9 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:45.866930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2655/5333] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:12:45.972875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82033-f6db-40c5-8047-70529aba823d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.034156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82033-f6db-40c5-8047-70529aba823d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.038584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.039438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.039713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.039983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] PATH_INFO: `/v3/users/716c7a7990724586bd0753055b091210` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.041217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716c7a7990724586bd0753055b091210)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.043300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.086501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716c7a7990724586bd0753055b091210'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.092970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716c7a7990724586bd0753055b091210'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.093623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716c7a7990724586bd0753055b091210'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.105124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716c7a7990724586bd0753055b091210'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.112614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716c7a7990724586bd0753055b091210'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.118356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2679/5334] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:45 2021] DELETE /identity/v3/users/716c7a7990724586bd0753055b091210 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:46.122942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.123257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.123569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.140731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:46.141912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:46.197070 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2656/5335] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:46.207969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.209387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:46.264158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351f27e-f5f0-4e41-a96d-ac6b44446db5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.268447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.269104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.269385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.269660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.278518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.279931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b13b5-ce04-4b88-b140-24257c1214f7 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.289859 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2680/5336] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:46.547306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.548788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:46.560433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4e59-d464-4770-90a9-cefe01c8538a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.565524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.566492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.566772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.567042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] PATH_INFO: `/v3/projects/737e53db1a284b8091da7b1bf7c0828b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.568261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] RBAC: Authorizing `identity:delete_project(project_id=737e53db1a284b8091da7b1bf7c0828b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.570350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.617773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737e53db1a284b8091da7b1bf7c0828b', 'request_id': 'req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.623275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737e53db1a284b8091da7b1bf7c0828b', 'request_id': 'req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.630166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737e53db1a284b8091da7b1bf7c0828b', 'request_id': 'req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.644211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] The token cache is being invalidate because project 737e53db1a284b8091da7b1bf7c0828b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:46.644529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.645212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3f7c84bc-d7e7-49c4-994b-cb3ee59fecab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:46.646740 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2657/5337] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:46 2021] DELETE /identity/v3/projects/737e53db1a284b8091da7b1bf7c0828b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:46.652666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.652955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.653230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.681232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:46.682422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:46.744787 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2681/5338] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:46.753130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.753533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.753896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.772767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:46.774031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:46.782152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2658/5339] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:46.791052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.801147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90680367-0ad8-42f9-a27a-85550870c326 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.805785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.806430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.806711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.806984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.807717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:46.808023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.809668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.821059 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2682/5340] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:46.825459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.835361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c87de-da12-49a2-8201-4e6ed3f60ced None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.840055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.840757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.841034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.841322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.842049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.843894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.871333 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2659/5341] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:46 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:12:46.875472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.885816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966a0c-3f96-41dd-9e78-acfb4e2a8593 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.944217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.945212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.946426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.946426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.946673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.948502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:46.976652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2683/5342] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:46 2021] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:46.978019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:46.991075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0291e7-f4f9-4a18-8dc6-d689da65ca19 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:46.995673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:46.996347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:46.996652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:46.996933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:46.997672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:46.999248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:47.010569 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2660/5343] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:47.014256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:47.025940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eefa0c-94ff-4b1d-b0e4-4233055b7fca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:47.038102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:47.038854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:47.039206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:47.039549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:47.040387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:47.042155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db98342-add9-4bc0-bf18-cc76231a0e49 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:47.053417 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2684/5344] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:47.061734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:47.078014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e0a9-023a-4b15-a463-e41c58cb3b04 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:47.083286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:47.084158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:47.084433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:47.084730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] PATH_INFO: `/v3/projects/8a0bfcc606564ccc968a2f2f4387e94c/users/e4477f0400f6438682136357caad94be/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:47.102916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0bfcc606564ccc968a2f2f4387e94c, user_id=e4477f0400f6438682136357caad94be, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:47.105641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:47.118761 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2661/5345] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:47 2021] PUT /identity/v3/projects/8a0bfcc606564ccc968a2f2f4387e94c/users/e4477f0400f6438682136357caad94be/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:47.207717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:47.207986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:47.208267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:47.235492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] MFA Rules not processed for user `e4477f0400f6438682136357caad94be`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:47.236793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:47.311786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2685/5346] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:47.324891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:47.326962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:47.389906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62416e-c1f1-4088-a336-3bd3de61216e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:47.397747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:47.398482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:47.398701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:47.398963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:47.408736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:47.410558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e523a-696d-4db4-ab1e-dc1aa12ab77d service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:47.423394 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2662/5347] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:47 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:48.021713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.084496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406494aa-3363-4b74-a687-c4ba489417ef None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:48.089074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:48.089934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.090212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.090485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] PATH_INFO: `/v3/users/e4477f0400f6438682136357caad94be` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.091681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4477f0400f6438682136357caad94be)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:48.093659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:48.139595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4477f0400f6438682136357caad94be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.147580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4477f0400f6438682136357caad94be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.148259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4477f0400f6438682136357caad94be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.159564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4477f0400f6438682136357caad94be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.167910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4477f0400f6438682136357caad94be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.173927 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2686/5348] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:48 2021] DELETE /identity/v3/users/e4477f0400f6438682136357caad94be => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:48.179048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.179560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.179560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.197276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:48.198481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:48.256744 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2663/5349] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:12:48.266541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.268558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:48.325161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae322cd-9d6c-4095-a243-9144f006994a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:48.329185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:48.329876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.330155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.330429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.339793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:48.341197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4e6d-4d2c-41ed-ad0d-913fcfd5d82a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:48.351217 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2687/5350] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:48.634604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.636524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:48.654856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc80a-3ebb-4ebb-a710-27d95c55031d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:48.669710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:48.670716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.670886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.671186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] PATH_INFO: `/v3/projects/8a0bfcc606564ccc968a2f2f4387e94c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.672520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0bfcc606564ccc968a2f2f4387e94c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:48.674627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:48.721874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0bfcc606564ccc968a2f2f4387e94c', 'request_id': 'req-91ec891b-2906-4a85-aa78-d7a73b33076e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.727034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0bfcc606564ccc968a2f2f4387e94c', 'request_id': 'req-91ec891b-2906-4a85-aa78-d7a73b33076e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.733126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0bfcc606564ccc968a2f2f4387e94c', 'request_id': 'req-91ec891b-2906-4a85-aa78-d7a73b33076e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.744955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] The token cache is being invalidate because project 8a0bfcc606564ccc968a2f2f4387e94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:48.745240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.745857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ec891b-2906-4a85-aa78-d7a73b33076e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:48.747393 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2664/5351] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:48 2021] DELETE /identity/v3/projects/8a0bfcc606564ccc968a2f2f4387e94c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:48.753089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.753371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.753643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.771582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:48.772805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:48.833657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2688/5352] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:48.842096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.843034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.843379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.862367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:48.863592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:48.871900 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2665/5353] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:48.876327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.887819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb906-b2e0-4711-af30-266a8f0e176e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:48.893085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:48.893733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.894006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.894274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.895001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:48.895305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:48.896900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:48.908050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2689/5354] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:12:48.912373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.921823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719169e-d84d-4e68-ac8d-4745d4b4d78d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:48.926735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:48.927385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:48.927663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:48.927936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:48.928675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:48.930602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:48.958625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2666/5355] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:48 2021] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:48.961025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:48.971052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee3b57-1ba9-49b5-a055-2e4b308007a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.035328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.036241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.036524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.036830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.037617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.039537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.065243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2690/5356] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:48 2021] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:49.069447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.081700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe81f-2755-47ef-8fa0-74a93989bd06 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.086579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.087371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.087657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.087929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.088708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.090341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.101861 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2667/5357] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:12:49.106076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.116145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a435a8f-8c2d-4f84-bb95-8d0c51e87ac4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.121011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.121734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.122084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.122790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.123269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.125086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8fb0-3826-4e43-beab-8028feb2291a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.140687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2691/5358] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:49.141824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.152635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ee-d007-4db0-9afc-ddd6fc47f136 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.157621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.158555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.158830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.159097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] PATH_INFO: `/v3/projects/86fb1ad9b27d4a03976a82ec1f5bc7db/users/d8be1015c67c4eacacd6a011f6eb13a6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.174108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fb1ad9b27d4a03976a82ec1f5bc7db, user_id=d8be1015c67c4eacacd6a011f6eb13a6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.176729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.190625 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2668/5359] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:49 2021] PUT /identity/v3/projects/86fb1ad9b27d4a03976a82ec1f5bc7db/users/d8be1015c67c4eacacd6a011f6eb13a6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:49.200577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.200958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.201505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.227496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] MFA Rules not processed for user `d8be1015c67c4eacacd6a011f6eb13a6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:49.228764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:49.296852 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2692/5360] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:49 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:49.309411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.311224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:49.376502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfd20-f456-46ca-a1d1-13954464c81e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.382801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.383701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.383985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.384262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.394927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.396470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd7b85-2905-449a-abf1-c2a8e80edcad service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.406953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2669/5361] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:49 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:49.710201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.772112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb1c86-7287-4ce1-9b0d-49d6fd6d8a69 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:49.776674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:49.777519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.777792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.778057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] PATH_INFO: `/v3/users/d8be1015c67c4eacacd6a011f6eb13a6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.779231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8be1015c67c4eacacd6a011f6eb13a6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:49.781136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:49.825990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8be1015c67c4eacacd6a011f6eb13a6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:49.832758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8be1015c67c4eacacd6a011f6eb13a6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:49.833432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8be1015c67c4eacacd6a011f6eb13a6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:49.844490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8be1015c67c4eacacd6a011f6eb13a6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:49.851760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8be1015c67c4eacacd6a011f6eb13a6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:49.857638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2693/5362] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:49 2021] DELETE /identity/v3/users/d8be1015c67c4eacacd6a011f6eb13a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:49.862507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:49.862804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:49.863074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:49.879730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:49.880939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:49.939532 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2670/5363] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:49.949272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:49.950651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:50.005457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b916-ebe1-4c9b-8085-d13a7b0391ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.009071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.009702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.009980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.010282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.019595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.021044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883856-8e90-426a-a983-2a00687e9028 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.030227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2694/5364] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:50.289885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.291310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:50.305190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96271-9227-40e1-b548-ba3dfd03819d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.309843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.310694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.310972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.311241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] PATH_INFO: `/v3/projects/86fb1ad9b27d4a03976a82ec1f5bc7db` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.313457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fb1ad9b27d4a03976a82ec1f5bc7db)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.316200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.363921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fb1ad9b27d4a03976a82ec1f5bc7db', 'request_id': 'req-3106869a-b601-407a-8467-5c0270f8edcb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:50.369650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fb1ad9b27d4a03976a82ec1f5bc7db', 'request_id': 'req-3106869a-b601-407a-8467-5c0270f8edcb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:50.377180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fb1ad9b27d4a03976a82ec1f5bc7db', 'request_id': 'req-3106869a-b601-407a-8467-5c0270f8edcb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:50.391024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] The token cache is being invalidate because project 86fb1ad9b27d4a03976a82ec1f5bc7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:50.391336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:50.391952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3106869a-b601-407a-8467-5c0270f8edcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:50.394048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2671/5365] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:50 2021] DELETE /identity/v3/projects/86fb1ad9b27d4a03976a82ec1f5bc7db => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:50.399969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.400453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.400556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.418759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:50.419941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:50.487710 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2695/5366] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:50.496218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.496509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.496834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.520051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:50.521672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:50.531305 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2672/5367] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:50.535796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.550767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c5609-7130-41d4-a282-4b3c56b00d5e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.555899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.556558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.557081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.557361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.558103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:50.558408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.559994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.572364 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2696/5368] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:50.576983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.587056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc90648-284b-4002-b89f-93d03babcd0e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.591806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.592456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.592785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.593055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.593746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.595645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.636907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2673/5369] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:50 2021] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:50.638016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.652794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d671-65f4-4704-8e9f-edc8d975ca33 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.729910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.730597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.730860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.731275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.731980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.734209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.767457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.773105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2697/5370] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:50 2021] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:50.781693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c021-ac63-4100-9429-e0fd6fe228b9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.788896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.789827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.790117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.790426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.791708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.794172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.813066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2674/5371] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:50 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:50.817802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.836550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ffa99-78eb-49ae-991e-5808e9d39ff3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.843111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.844220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.846421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.847084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.856074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.859210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf819f-3238-4623-86bd-262f65c55a6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.878556 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2698/5372] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:50 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:50.880836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:50.897265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65902ee-95be-4070-96a2-4f63cb8be5d6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:50.902708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:50.904509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.904987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.905416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] PATH_INFO: `/v3/projects/5c10109e24fe4545bbb773857dfb1d9f/users/a2fcd59849f1469a9643a252cc9207c1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.926957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c10109e24fe4545bbb773857dfb1d9f, user_id=a2fcd59849f1469a9643a252cc9207c1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:50.929224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:50.946287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2675/5373] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:50 2021] PUT /identity/v3/projects/5c10109e24fe4545bbb773857dfb1d9f/users/a2fcd59849f1469a9643a252cc9207c1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:50.955563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:50.955845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:50.956123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:50.987231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] MFA Rules not processed for user `a2fcd59849f1469a9643a252cc9207c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:50.988527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:51.076377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2699/5374] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:50 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:51.088664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:51.090375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:51.148442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa774d-6b93-4266-9d34-6df3f69310d3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:51.152517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:51.153607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:51.153883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:51.154151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:51.163342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:51.164748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39fd3f-cbc4-4fc3-be10-6b677993d85c service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:51.173303 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2676/5375] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:51 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:51.334626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:51.394151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c438c-3891-4329-93da-09f66fa5a133 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:51.398647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:51.399495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:51.399767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:51.400035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] PATH_INFO: `/v3/users/a2fcd59849f1469a9643a252cc9207c1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:51.401348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fcd59849f1469a9643a252cc9207c1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:51.403239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:51.445969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fcd59849f1469a9643a252cc9207c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.452871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fcd59849f1469a9643a252cc9207c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.453520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fcd59849f1469a9643a252cc9207c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.464952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fcd59849f1469a9643a252cc9207c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.472320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fcd59849f1469a9643a252cc9207c1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.478105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2700/5376] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:12:51 2021] DELETE /identity/v3/users/a2fcd59849f1469a9643a252cc9207c1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:51.482774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:51.483277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:51.483394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:51.499988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:51.501192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:51.556141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2677/5377] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:51.566010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:51.567380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:51.622350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51ceab-43bf-40e3-8b89-3a563ad4705a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:51.625985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:51.626610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:51.626879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:51.627144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:51.635823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:51.637271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a341a-23bf-4779-8547-8730c0f8334a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:51.646956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2701/5378] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:51.913430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:51.914875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:51.928477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacabc-7dea-4fae-82e4-03fca61bb227 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:51.932838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:51.935155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:51.935608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:51.935971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] PATH_INFO: `/v3/projects/5c10109e24fe4545bbb773857dfb1d9f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:51.937600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c10109e24fe4545bbb773857dfb1d9f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:51.939887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:51.989828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c10109e24fe4545bbb773857dfb1d9f', 'request_id': 'req-c04b7697-5818-46f3-bc05-1b3233b059c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:51.995189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c10109e24fe4545bbb773857dfb1d9f', 'request_id': 'req-c04b7697-5818-46f3-bc05-1b3233b059c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:52.001718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c10109e24fe4545bbb773857dfb1d9f', 'request_id': 'req-c04b7697-5818-46f3-bc05-1b3233b059c8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:52.014544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] The token cache is being invalidate because project 5c10109e24fe4545bbb773857dfb1d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:12:52.014898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:52.015734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c04b7697-5818-46f3-bc05-1b3233b059c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:12:52.017312 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2678/5379] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:12:51 2021] DELETE /identity/v3/projects/5c10109e24fe4545bbb773857dfb1d9f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:52.023705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.023994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.024269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.046951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:52.048139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:52.115266 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2702/5380] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:52.126372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.126895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.127175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.151719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:52.153044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:52.162061 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2679/5381] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:52.166392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.176830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4115-275b-46e9-a65b-14d3696cbbdf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.182273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.183061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.183205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.183489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.184243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:12:52.184537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.186069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.199370 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2703/5382] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:12:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:12:52.208196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.222578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa217889-98a3-41c7-8600-1fea80205048 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.227495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.228392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.228765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.229112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.230068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.232014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.264252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2680/5383] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:52.269334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.295298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72a34-ca2f-47b9-a548-611648f2e233 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.372038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.372707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.373041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.373356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.374097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.377379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.400924 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2704/5384] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:52.403587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.415472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006102c-a3bd-4aec-b140-ca22e7b48b5d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.421074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.421730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.422007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.422403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.423126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.424860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.437024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2681/5385] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:52.441578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.452335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded31a-ea01-4853-8bd6-bead3ccfa899 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.457752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.458403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.458683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.458957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.459684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.461310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354faa1d-aa00-4e73-a8a8-7c96fb3f91ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.472360 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2705/5386] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:52.478648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.491092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0808b-563c-45c0-adea-4555b6533923 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.496353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.497294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.497575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.497851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] PATH_INFO: `/v3/projects/d62aa7e8f439479e9b10744d8935b20d/users/457cfdcbacf241dfbbe6779e298c20cb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.513020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62aa7e8f439479e9b10744d8935b20d, user_id=457cfdcbacf241dfbbe6779e298c20cb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.515636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.529562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2682/5387] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:52 2021] PUT /identity/v3/projects/d62aa7e8f439479e9b10744d8935b20d/users/457cfdcbacf241dfbbe6779e298c20cb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:52.542052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.542547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.542826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.574380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] MFA Rules not processed for user `457cfdcbacf241dfbbe6779e298c20cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:52.575846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:52.648619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2706/5388] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:52.653752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.725757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c75379-1ee2-4787-a284-c3971e465155 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.730846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.731955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.732280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.732555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.733303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.735467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.764304 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2683/5389] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:52.769953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.781154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f844b-6053-4b13-b6f5-744e97ec3ac5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.843212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.843879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.844158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.844431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.845177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.847104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.870701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2707/5390] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:12:52 2021] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:12:52.871959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.883321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf566-3896-4c00-b4c3-fd3562d53842 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.888575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.889266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.889540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.889812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.890641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.892899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:52.904323 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2684/5391] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:52.909005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:52.935263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2169b-7d44-49a1-b9c8-f857252e6793 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:52.951521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:52.952508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:52.952734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:52.953115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] PATH_INFO: `/v3/projects/473d16e063d64ce6abaef8e4f46407c2/users/aef8d0aa3f024ce0882548ae9024a402/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:52.979519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473d16e063d64ce6abaef8e4f46407c2, user_id=aef8d0aa3f024ce0882548ae9024a402, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:52.982984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:53.008108 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2708/5392] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:52 2021] PUT /identity/v3/projects/473d16e063d64ce6abaef8e4f46407c2/users/aef8d0aa3f024ce0882548ae9024a402/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:12:53.011850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:53.028671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065863c-e26e-4eaf-9869-3748ba9760c6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:53.151140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:53.151920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:53.152283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:53.152831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:53.153765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:53.155638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1aaa7-5656-4244-9d10-d200041cc3a7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:53.171958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2685/5393] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:12:53.176714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:53.190011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0e5-f182-42a0-9dde-1429695aecc1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:53.195982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:53.197200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:53.197758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:53.198104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] PATH_INFO: `/v3/projects/473d16e063d64ce6abaef8e4f46407c2/users/aef8d0aa3f024ce0882548ae9024a402/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:53.200763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473d16e063d64ce6abaef8e4f46407c2, user_id=aef8d0aa3f024ce0882548ae9024a402, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:53.204031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:53.216650 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2709/5394] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:12:53 2021] PUT /identity/v3/projects/473d16e063d64ce6abaef8e4f46407c2/users/aef8d0aa3f024ce0882548ae9024a402/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:12:53.225866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86627900-5bca-42be-939a-0e4d762dcb1a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:53.226588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86627900-5bca-42be-939a-0e4d762dcb1a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:53.227021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86627900-5bca-42be-939a-0e4d762dcb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:53.271716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-86627900-5bca-42be-939a-0e4d762dcb1a None None] MFA Rules not processed for user `aef8d0aa3f024ce0882548ae9024a402`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:53.275429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-86627900-5bca-42be-939a-0e4d762dcb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:53.379618 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2686/5395] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:12:53 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:53.395263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:53.397200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:53.468516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fae98-8253-41cf-b442-733c1bec0013 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:53.473213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:53.474524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:53.474775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:53.475050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:53.485849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:53.488758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:53.499400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2710/5396] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:12:53 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:12:56.342785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:56.343271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:56.343868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:56.368274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:12:56.370143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:56.450795 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2687/5397] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:12:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:12:56.466741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:12:56.468675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:12:56.555234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba9600-604b-4cf9-9ded-96afae0437df service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:12:56.577761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:12:56.578747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:12:56.579228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:12:56.579738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:12:56.590466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:12:56.592375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:12:56.603410 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2711/5398] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:12:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:13:01.077007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:01.098019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e85e3c-a0f4-4f04-8799-e8a5b84448ec None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:01.126652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef8d0aa3f024ce0882548ae9024a402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '473d16e063d64ce6abaef8e4f46407c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:01.128546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:01.128861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:01.129142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:01.129958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:01.130222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:01.137694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:01.186119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2688/5399] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:01.187444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:01.202076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2759f-9627-4aa2-9deb-7a864d04b81f service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:01.215187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef8d0aa3f024ce0882548ae9024a402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '473d16e063d64ce6abaef8e4f46407c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:01.215988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:01.216376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:01.216991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:01.217807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:01.219835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:01.277314 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2712/5400] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:01 2021] POST /identity/v3/projects => generated 347 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:01.282238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:01.293345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d344-3b28-41bf-a1ed-7c09074f30a2 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:01.438011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef8d0aa3f024ce0882548ae9024a402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '473d16e063d64ce6abaef8e4f46407c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:01.439391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:01.439875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:01.440329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:01.441273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:01.441741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:01.443507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:01.459452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2689/5401] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:02.631558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:02.647045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a43e1-d954-4733-832d-7c2d2bd9ae8c tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:02.662853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef8d0aa3f024ce0882548ae9024a402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '473d16e063d64ce6abaef8e4f46407c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:02.664147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:02.664748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:02.665506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] PATH_INFO: `/v3/projects/5dd3f3efc0a348619a515fd45d20bf38` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:02.693608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5dd3f3efc0a348619a515fd45d20bf38)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:02.702694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:02.913587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd3f3efc0a348619a515fd45d20bf38', 'request_id': 'req-d3b44dc6-e245-42d8-8255-27bc826ed5dd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:02.925519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd3f3efc0a348619a515fd45d20bf38', 'request_id': 'req-d3b44dc6-e245-42d8-8255-27bc826ed5dd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:02.940340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd3f3efc0a348619a515fd45d20bf38', 'request_id': 'req-d3b44dc6-e245-42d8-8255-27bc826ed5dd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:02.980328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] The token cache is being invalidate because project 5dd3f3efc0a348619a515fd45d20bf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:02.980872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:02.981737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:02.988284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2713/5402] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:02 2021] DELETE /identity/v3/projects/5dd3f3efc0a348619a515fd45d20bf38 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:02.998126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:03.000899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:03.146737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b94ab-0c52-4781-b256-36838c6df840 tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:03.303329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:03.304295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:03.304787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:03.305111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:03.310459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:03.428355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:03.430865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:03.444125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2690/5403] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:02 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:04.800775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:04.810378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:04.951407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b44dc6-e245-42d8-8255-27bc826ed5dd tempest-RoutersAdminTest-1209760423 tempest-RoutersAdminTest-1209760423-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:04.958237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:04.959667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:04.960407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:04.961026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] PATH_INFO: `/v3/users/202de6cb73e547f8a449898bf46a05fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:04.962653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202de6cb73e547f8a449898bf46a05fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:04.965809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:05.079691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202de6cb73e547f8a449898bf46a05fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:05.102851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202de6cb73e547f8a449898bf46a05fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:05.104111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202de6cb73e547f8a449898bf46a05fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:05.143846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202de6cb73e547f8a449898bf46a05fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:05.164900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e09f29c3-991b-4548-a643-7063114e14e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202de6cb73e547f8a449898bf46a05fc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:05.182852 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2714/5404] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:04 2021] DELETE /identity/v3/users/202de6cb73e547f8a449898bf46a05fc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:06.018188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:06.056482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e933-cd8e-42de-b19a-729f72d527f8 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:06.243221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:06.245136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:06.246848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:06.248767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] PATH_INFO: `/v3/projects/3a4353009c9e414fb3415e98df1fe1ae` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:06.253150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4353009c9e414fb3415e98df1fe1ae)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:06.267300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:06.390069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4353009c9e414fb3415e98df1fe1ae', 'request_id': 'req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:06.406065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4353009c9e414fb3415e98df1fe1ae', 'request_id': 'req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:06.423415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4353009c9e414fb3415e98df1fe1ae', 'request_id': 'req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:06.449419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] The token cache is being invalidate because project 3a4353009c9e414fb3415e98df1fe1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:06.449887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:06.452009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a9864c-04ec-47b8-bdc6-1aff3d76da4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:06.455267 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2691/5405] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:06 2021] DELETE /identity/v3/projects/3a4353009c9e414fb3415e98df1fe1ae => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:06.464559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:06.465172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:06.465280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:06.511337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:06.512863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:06.644907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2715/5406] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:06.651618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:06.652081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:06.652454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:06.679148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:06.680533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:06.690689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2692/5407] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:06.694825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:06.730242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307aa47-9821-43ae-a7a9-61b34ea365d4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:06.743684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:06.744437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:06.744814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:06.745099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:06.750524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:06.750937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:06.753032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:06.767975 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2716/5408] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:06.772127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:06.790668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb98fb-8e62-4680-9c7d-5868c66b0e35 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:06.795629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:06.796306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:06.796584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:06.796899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:06.797637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:06.801400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:06.875460 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2693/5409] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:06 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:06.881329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:06.915253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13849-2256-42f9-9690-e94ebf5e811b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:07.015405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:07.016501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.017834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.018435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.019478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:07.022961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:07.075072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2717/5410] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:06 2021] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:07.079255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:07.115296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c556-2adf-495e-86d7-88007ec8849a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:07.135875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:07.136763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.137040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.137525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.145930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:07.147775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:07.187108 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2694/5411] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:13:07.191682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:07.209070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f744f-cfa1-492d-bab1-321511215932 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:07.218722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:07.219410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.219691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.220000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.222514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:07.224138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b39e90-74ef-4d2f-a27e-575e6fba9b11 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:07.264204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:07.265109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2718/5412] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:07.293359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2a9f-5c72-42c6-a996-dac20396c4b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:07.315272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:07.316179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.316450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.316748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] PATH_INFO: `/v3/projects/86321f398a2f4013915e01d7352f33b5/users/c1b28fb14ec347ce8369595664ed6d88/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.377314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=86321f398a2f4013915e01d7352f33b5, user_id=c1b28fb14ec347ce8369595664ed6d88, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:07.382739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:07.415985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2695/5413] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:07 2021] PUT /identity/v3/projects/86321f398a2f4013915e01d7352f33b5/users/c1b28fb14ec347ce8369595664ed6d88/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:07.417397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760759c-9a21-4904-8213-1600e9e9cd59 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.417682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760759c-9a21-4904-8213-1600e9e9cd59 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.417955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760759c-9a21-4904-8213-1600e9e9cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.447154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7760759c-9a21-4904-8213-1600e9e9cd59 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:07.448538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7760759c-9a21-4904-8213-1600e9e9cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:07.561471 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2719/5414] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:07.578400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:07.580317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:07.685786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443c19-1ff2-4956-b8b7-2362b484abfa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:07.698813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:07.699395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:07.702070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:07.702557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:07.732310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:07.740363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43a49c-1a46-423f-982d-bfdd16cc2525 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:07.766547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2696/5415] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:10.330699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:10.331160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:10.331277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:10.436724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] MFA Rules not processed for user `c1b28fb14ec347ce8369595664ed6d88`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:10.438276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:10.612256 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2720/5416] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:10.613656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:10.614146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:10.614246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:10.705687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] MFA Rules not processed for user `c1b28fb14ec347ce8369595664ed6d88`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:10.719455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:10.756432 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2697/5417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:10.768099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:10.769601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:10.974293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78bb77-2337-4303-a7c8-dde32ccfdb78 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:10.991959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:10.999459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:10.999921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:11.000381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:11.019837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:11.022889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46781-f307-4fb5-aeab-59039991e488 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:11.038684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2721/5418] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:10 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:14.978669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:14.981770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:15.006248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e46bf-0138-461b-ad37-bcd7db700dbd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:15.017363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:15.019217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:15.023633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:15.024309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] PATH_INFO: `/v3/users/ab0c0319a4434266857862c4a8c08eb1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:15.030115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0c0319a4434266857862c4a8c08eb1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:15.033767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:15.164045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0c0319a4434266857862c4a8c08eb1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:15.197759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0c0319a4434266857862c4a8c08eb1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:15.198757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0c0319a4434266857862c4a8c08eb1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:15.202086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0c0319a4434266857862c4a8c08eb1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:15.217832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0c0319a4434266857862c4a8c08eb1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:15.254100 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2698/5419] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:14 2021] DELETE /identity/v3/users/ab0c0319a4434266857862c4a8c08eb1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:15.260105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:15.260105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:15.260105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:15.310935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:15.312326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:15.428546 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2722/5420] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:15.447477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:15.452382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:15.586878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf4e9-416a-4927-ab51-383f58886182 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:15.597058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:15.598084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:15.599770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:15.600410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:15.618550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:15.620655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518614-a423-41e3-adc6-0db5cc506a7d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:15.677969 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2699/5421] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:17.318505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:17.320124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:17.339932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef359394-663e-44d3-82e2-bf679715b5db None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:17.351305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:17.355359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:17.355858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:17.356288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] PATH_INFO: `/v3/projects/039e3178e1c54d10996ea32eb3342123` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:17.359133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039e3178e1c54d10996ea32eb3342123)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:17.363432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:17.464770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039e3178e1c54d10996ea32eb3342123', 'request_id': 'req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:17.472953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039e3178e1c54d10996ea32eb3342123', 'request_id': 'req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:17.485941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039e3178e1c54d10996ea32eb3342123', 'request_id': 'req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:17.520009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] The token cache is being invalidate because project 039e3178e1c54d10996ea32eb3342123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:17.520701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:17.521693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-78cfa2f2-2ec0-4ff4-a5c1-6860f8ef5cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:17.523764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2723/5422] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:17 2021] DELETE /identity/v3/projects/039e3178e1c54d10996ea32eb3342123 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:17.529603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:17.530132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:17.530132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:17.561689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:17.562918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:17.701201 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2700/5423] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:17.710001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050980c-b012-48fb-9e07-47221412e521 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:17.710328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050980c-b012-48fb-9e07-47221412e521 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:17.710611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050980c-b012-48fb-9e07-47221412e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:17.741378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e050980c-b012-48fb-9e07-47221412e521 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:17.746457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e050980c-b012-48fb-9e07-47221412e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:17.789651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2724/5424] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:17.791784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:17.806407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff146c-91f8-4a00-92e3-a135bf2aabb1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:17.820951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:17.822101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:17.822491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:17.822871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:17.823727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:17.824493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:17.830879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:17.853980 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2701/5425] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:17.858469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050980c-b012-48fb-9e07-47221412e521 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:17.875348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050980c-b012-48fb-9e07-47221412e521 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:17.883233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:17.884266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:17.884759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:17.885483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:17.887429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:17.890024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:17.929010 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2725/5426] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:17 2021] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:17.932911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:17.947810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe91d4-3077-468f-b80e-03fcb6c836d6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.074678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.075715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.076534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.077129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.079996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.084912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.131430 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2702/5427] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:17 2021] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:18.135346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:18.149859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ccad-7c2e-46e4-a145-631c300cc270 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.158868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.160668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.160977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.161506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.162296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.164095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.179901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2726/5428] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:18.183774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:18.199775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a6e4-df60-474c-8d07-77f2fd4433b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.205988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.206660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.206943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.207219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.208096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.209749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc263fb-e7e0-47be-bb5b-e6b62abe83b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.221484 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2703/5429] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:18.227748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:18.263929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4853d-557e-475c-a26c-efacb5f23349 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.271229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.274213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.274774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.275283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] PATH_INFO: `/v3/projects/d47eb524ccd44636a3dad9da0791a0b9/users/431fa5e0afa04356b9ca7129c7979e66/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.304513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47eb524ccd44636a3dad9da0791a0b9, user_id=431fa5e0afa04356b9ca7129c7979e66, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.310215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.358530 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2727/5430] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:18 2021] PUT /identity/v3/projects/d47eb524ccd44636a3dad9da0791a0b9/users/431fa5e0afa04356b9ca7129c7979e66/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:18.363734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.364029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.364317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.364591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:18.366845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:18.431072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] MFA Rules not processed for user `431fa5e0afa04356b9ca7129c7979e66`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:18.432741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:18.553981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2704/5431] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:18 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:18.678325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73249cf1-abd7-4538-a15a-5a473ca27aed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.732110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.733764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.734198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.734534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.738363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:18.773517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.776098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.791896 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2728/5432] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:18.893372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:18.916933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a759f-1efe-4ff5-969b-4db868be4c52 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:18.938653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:18.939320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:18.939984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:18.940356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:18.961556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:18.963260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3685f3-008b-4299-a37d-976924929984 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:18.987782 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2705/5433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:18 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:19.041110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:19.123836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf958-504f-4f88-8ace-807ac23aa835 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:19.133457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:19.134945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:19.135590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:19.136101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] PATH_INFO: `/v3/users/431fa5e0afa04356b9ca7129c7979e66` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:19.137634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431fa5e0afa04356b9ca7129c7979e66)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:19.140227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:19.243699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431fa5e0afa04356b9ca7129c7979e66'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:19.254438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431fa5e0afa04356b9ca7129c7979e66'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:19.255472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431fa5e0afa04356b9ca7129c7979e66'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:19.283031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431fa5e0afa04356b9ca7129c7979e66'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:19.292597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431fa5e0afa04356b9ca7129c7979e66'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:19.306644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2729/5434] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:19 2021] DELETE /identity/v3/users/431fa5e0afa04356b9ca7129c7979e66 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:19.312487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:19.313088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:19.313691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:19.358414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:19.359673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:19.424946 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2706/5435] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:19.480394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:19.486612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:19.559802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d749-3305-457f-9093-736627f2ec78 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:19.566356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:19.567380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:19.567818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:19.568363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:19.585510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:19.587376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115494d-89d5-4725-90a5-3fce340549e1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:19.626571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2730/5436] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:20.555529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:20.557090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:20.585471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f88e-bf3c-4532-9b5c-67b6408811c7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:20.601450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:20.611530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:20.611857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:20.613002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] PATH_INFO: `/v3/projects/d47eb524ccd44636a3dad9da0791a0b9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:20.616731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47eb524ccd44636a3dad9da0791a0b9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:20.619945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:20.707241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47eb524ccd44636a3dad9da0791a0b9', 'request_id': 'req-d7018f3b-a2b8-428c-b9ec-208137493369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:20.714283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47eb524ccd44636a3dad9da0791a0b9', 'request_id': 'req-d7018f3b-a2b8-428c-b9ec-208137493369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:20.722877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47eb524ccd44636a3dad9da0791a0b9', 'request_id': 'req-d7018f3b-a2b8-428c-b9ec-208137493369'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:20.741514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] The token cache is being invalidate because project d47eb524ccd44636a3dad9da0791a0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:20.741876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:20.742604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d7018f3b-a2b8-428c-b9ec-208137493369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:20.744203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2707/5437] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:20 2021] DELETE /identity/v3/projects/d47eb524ccd44636a3dad9da0791a0b9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:20.750588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:20.751680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:20.752118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:20.776772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:20.778236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:20.930534 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2731/5438] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:20.939035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:20.939316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:20.939785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:20.973328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:20.974808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:20.993476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.005621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132748-88fc-4edd-9996-0d9fe1657cc7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.005902 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2708/5439] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:21.011785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.012974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.013425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.014279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.014999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:21.015308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.017262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.033725 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2732/5440] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:21.038233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.049319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6eaf9-622c-478a-af53-14621b73f78a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.056406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.057120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.057406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.058192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.058939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.061480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.113738 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2709/5441] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:21 2021] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:21.115814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.128232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c78797-4bf2-4255-93d4-6d3a7ad20744 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.241141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.242287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.243770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.244242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.245141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.250009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.306208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2733/5442] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:21 2021] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:21.307481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.318923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5fe4f-3b03-462e-8d98-56de4f4ec0c1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.335198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.335887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.336171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.336840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.337215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.341306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.362203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2710/5443] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:21.366489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.396869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94751-4ddd-487f-8953-b4019dd1bf1b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.426397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.430192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.430663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.430951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.432295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.438001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7e677-4cb0-425e-9e20-bd9d07f67412 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.473848 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2734/5444] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:21.475065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.490495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4855b2-1dc4-4afb-9ecc-e2699a360860 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.502675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.503585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.505769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.506066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] PATH_INFO: `/v3/projects/2c202ba2db2f41bea1c279be7e208461/users/db12f7ce53e7402b85c932a08e79f707/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.544912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c202ba2db2f41bea1c279be7e208461, user_id=db12f7ce53e7402b85c932a08e79f707, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.548035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.570164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2711/5445] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:21 2021] PUT /identity/v3/projects/2c202ba2db2f41bea1c279be7e208461/users/db12f7ce53e7402b85c932a08e79f707/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:21.581690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e1e70-9958-4f2e-9c96-6b53217e405c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.582083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e1e70-9958-4f2e-9c96-6b53217e405c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.582782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e1e70-9958-4f2e-9c96-6b53217e405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.638981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7d5e1e70-9958-4f2e-9c96-6b53217e405c None None] MFA Rules not processed for user `db12f7ce53e7402b85c932a08e79f707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:21.640437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7d5e1e70-9958-4f2e-9c96-6b53217e405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:21.747539 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2735/5446] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:21 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:21.756886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:21.759199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:21.927582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526d88-fa83-403f-a525-5a0d3fa19964 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:21.939898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:21.941244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:21.942123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:21.942462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:21.955037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:21.958234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:21.973859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2712/5447] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:21 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:22.984483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:22.986059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:22.986059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:23.012724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:23.013991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:23.085895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2736/5448] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:13:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:23.100115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:23.101810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:23.214279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190fff-0f99-4a77-ad0b-6e6dd31632eb service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:23.227663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:23.228345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:23.228655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:23.228975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:23.241888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:23.243668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:23.256014 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2713/5449] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:13:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:13:25.194092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:25.198098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:25.311501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff8d26-2dca-4246-a891-58c35302eee6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:25.333267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:25.334606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:25.335196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:25.335671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:25.339182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:25.510790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:25.512871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b52e2e-2d3e-4ff8-8b36-6c67577c048d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:25.539017 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2737/5450] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:26.265053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:26.288401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63fd3c-43f4-4d3f-a784-5528ad4f4e2b service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:26.296414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:26.298375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:26.298770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:26.299136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] PATH_INFO: `/v3/users/db12f7ce53e7402b85c932a08e79f707` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:26.300520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db12f7ce53e7402b85c932a08e79f707)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:26.302534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:26.377816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db12f7ce53e7402b85c932a08e79f707'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:26.394392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db12f7ce53e7402b85c932a08e79f707'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:26.395161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db12f7ce53e7402b85c932a08e79f707'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:26.395796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db12f7ce53e7402b85c932a08e79f707'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:26.419167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db12f7ce53e7402b85c932a08e79f707'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:26.457836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:26.458444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:26.458444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:26.459904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2714/5451] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:26 2021] DELETE /identity/v3/users/db12f7ce53e7402b85c932a08e79f707 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:26.494252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:26.499890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:26.665401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2738/5452] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:26.714369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:26.716834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:26.788031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50ee1-c5f8-43a2-a0b8-b0b5f2e52f1a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:26.796446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:26.797999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:26.798432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:26.798864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:26.835267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:26.839257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b35bf-9f3a-4975-8323-b3e482ac9a06 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:26.860568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2715/5453] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:27.486618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:27.488240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:27.524495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed92c-915a-43dc-8f88-afeeeabe3483 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:27.569696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:27.570584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:27.570859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:27.574309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] PATH_INFO: `/v3/projects/2c202ba2db2f41bea1c279be7e208461` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:27.583434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c202ba2db2f41bea1c279be7e208461)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:27.588700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:27.672836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c202ba2db2f41bea1c279be7e208461', 'request_id': 'req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:27.688760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c202ba2db2f41bea1c279be7e208461', 'request_id': 'req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:27.700810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c202ba2db2f41bea1c279be7e208461', 'request_id': 'req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:27.727070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] The token cache is being invalidate because project 2c202ba2db2f41bea1c279be7e208461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:27.729150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:27.729952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3ddc7dd-7c77-4856-8ef6-508330cbfdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:27.746986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2739/5454] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:27 2021] DELETE /identity/v3/projects/2c202ba2db2f41bea1c279be7e208461 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:27.749518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:27.750669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:27.751153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:27.794047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:27.796190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:27.890524 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2716/5455] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:27.901509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:27.901881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:27.902149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:27.927817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:27.930849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:27.955600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2740/5456] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:27.960877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:27.976026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e47d4-bbe8-4476-840e-aebc4210b6ee None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:27.982670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:27.983343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:27.983634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:27.984993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:27.985757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:27.986066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:27.988205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.006935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2717/5457] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:28.011007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.028116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741a8b1-df08-432b-9efb-ac88c359d1f8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.051516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.052185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.052459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.052758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.053460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.055334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.104225 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2741/5458] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:28 2021] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:28.105375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.117265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c1634-f886-4acf-b834-0dd503d56859 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.221277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.222458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.222848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.223230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.224188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.226378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.256858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2718/5459] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:28 2021] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:28.260434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.272130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c2f3-592d-4512-9a1a-bf8f2f9ad609 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.277993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.278978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.279505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.280013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.281681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.283937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.296317 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2742/5460] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:28.301133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.320785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535457b-73c4-4d09-9f61-67e979eac4a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.333349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.336581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.338666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.339275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.341614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.343584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a1ac3-155c-4951-9611-c56fc553f23c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.359242 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2719/5461] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:28.360342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.383371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af53746-c148-4b61-af0f-9fd751364551 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.400151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.401098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.401385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.401665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] PATH_INFO: `/v3/projects/1739d6cf932445b8bcee0df4457ea1df/users/34cb1abda6e143e780e32a7f9769226b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.450643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1739d6cf932445b8bcee0df4457ea1df, user_id=34cb1abda6e143e780e32a7f9769226b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.455216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.487939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2743/5462] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:28 2021] PUT /identity/v3/projects/1739d6cf932445b8bcee0df4457ea1df/users/34cb1abda6e143e780e32a7f9769226b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:28.497824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.498109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.498439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.529730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] MFA Rules not processed for user `34cb1abda6e143e780e32a7f9769226b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:28.530954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:28.637019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2720/5463] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:28 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:28.637840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.778284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92344-5650-4d7e-8ce0-67ca2540a1d4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.785638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.786313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.786594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.786866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.787582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.789517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:28.849465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:28.850044 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2744/5464] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:28 2021] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:28.868515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f86c77-01e7-49cd-8911-027074e32fa6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:28.988522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:28.989528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:28.989973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:28.990415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:28.991299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:28.993394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.034391 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2721/5465] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:28 2021] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:29.035347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.048762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faeea7-0fc6-453e-b532-070cc3d48ce3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.070691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.074485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.074811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.075076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.081476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.083158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.122766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.132182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2745/5466] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:29.138896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077851d-6653-4467-b41e-5ad62a99fe9c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.159642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.162496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.163024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.164009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] PATH_INFO: `/v3/projects/161f148c5be941a9bde581802d3ccdfc/users/21ef589322064071b9aa2c248f851c6a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.186024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161f148c5be941a9bde581802d3ccdfc, user_id=21ef589322064071b9aa2c248f851c6a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.191528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.228678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2722/5467] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:29 2021] PUT /identity/v3/projects/161f148c5be941a9bde581802d3ccdfc/users/21ef589322064071b9aa2c248f851c6a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:29.229955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.242156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f349-da47-4e2c-b1d1-dd5766702d7e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.400248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.400517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.401062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.401591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.402920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.407125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6041e6a-2a60-4745-9a66-260666f9e0b2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.432072 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2746/5468] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:29.435995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.452294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9881caa-0bf6-4115-bcb3-ed5ac302bf22 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.466139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.467208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.467572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.467967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] PATH_INFO: `/v3/projects/161f148c5be941a9bde581802d3ccdfc/users/21ef589322064071b9aa2c248f851c6a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.476632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161f148c5be941a9bde581802d3ccdfc, user_id=21ef589322064071b9aa2c248f851c6a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.479385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.516795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.517379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.517855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.519154 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2723/5469] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:29 2021] PUT /identity/v3/projects/161f148c5be941a9bde581802d3ccdfc/users/21ef589322064071b9aa2c248f851c6a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:29.568159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] MFA Rules not processed for user `21ef589322064071b9aa2c248f851c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:29.571842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:29.709273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.711963 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2747/5470] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:29 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:29.724868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e9e0-79b7-4beb-ad7e-ee16ae24bd75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.732474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.733565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.733876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.734520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.736459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.742060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:29.781244 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2724/5471] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:13:29 2021] POST /identity/v3/domains => generated 276 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:29.784791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:29.800505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29db5e-75d1-4508-9604-b601033a87bf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:29.975282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:29.976164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:29.976454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:29.976794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:29.977518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:29.980915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.040427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2748/5472] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:29 2021] POST /identity/v3/groups => generated 279 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:30.045084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.060232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443d6d2-ba4a-4ed6-83ab-e0c40affff28 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.074621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.075810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.077037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.078197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bc815e0a20d846779546733e991a3485` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.085593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:update_group(group_id=bc815e0a20d846779546733e991a3485)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.087340 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:30.087340 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:30.087340 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:30.089580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.120168 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2725/5473] 10.222.0.13 () {60 vars in 1246 bytes} [Wed Nov 10 04:13:30 2021] PATCH /identity/v3/groups/bc815e0a20d846779546733e991a3485 => generated 291 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:30.124129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.140123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ba61c-cfcf-42e4-9981-7918df3380f8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.157607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.162527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.162822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.163107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bc815e0a20d846779546733e991a3485` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.180552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:get_group(group_id=bc815e0a20d846779546733e991a3485)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.183886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.189128 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2749/5474] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:30 2021] GET /identity/v3/groups/bc815e0a20d846779546733e991a3485 => generated 291 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:30.193064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.206217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569bf8-02db-4194-8115-023bb0eca417 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.211669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.215064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.215064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.215064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bc815e0a20d846779546733e991a3485` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.215799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:update_group(group_id=bc815e0a20d846779546733e991a3485)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.220995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.273813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2726/5475] 10.222.0.13 () {60 vars in 1245 bytes} [Wed Nov 10 04:13:30 2021] PATCH /identity/v3/groups/bc815e0a20d846779546733e991a3485 => generated 307 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:30.276028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.295265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832248f4-005b-4f57-93aa-c9ea92221931 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.318487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.318774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.319039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.319324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bc815e0a20d846779546733e991a3485` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.335563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bc815e0a20d846779546733e991a3485)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.336647 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:30.336647 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:30.336647 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:30.338062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.474664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2750/5476] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:30 2021] DELETE /identity/v3/groups/bc815e0a20d846779546733e991a3485 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:30.475761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.495291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d64e1-5f80-486e-a7b2-4c426b03cd95 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.622208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.625273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.626726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.627732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.629360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.633397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.668469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2727/5477] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:30 2021] POST /identity/v3/groups => generated 326 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:30.672177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.689229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37b01-75bb-45ef-9d67-85d7467e44e8 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.700450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.701567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.701960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.702365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.703334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.707633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.777122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.790403 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2751/5478] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:30 2021] POST /identity/v3/users => generated 323 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:30.796456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbacf7-befa-4801-a6b7-7f9ae7347b2d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:30.812227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:30.814570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:30.815077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:30.822866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:30.895778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=45769d53996a41218538119026b8f7a5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:30.897170 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:add_user_to_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:30.897170 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:30.897170 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:30.898722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:30.961265 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2728/5479] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:13:30 2021] PUT /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:30.965147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:30.979024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0032e1-49ad-42a2-b345-2ee32f8aafec tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.115543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.116231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.116514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.116820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.117532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.122449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.177494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.193810 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2752/5480] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:30 2021] POST /identity/v3/users => generated 323 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:31.198969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a285-d02e-46ae-92ff-29a41914069c tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.215627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.216530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.216848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.217131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.258774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=80da66af0c6c42a5b7e00b61cb17bd4f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.258962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.307045 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2729/5481] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:13:31 2021] PUT /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:31.311671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.335485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9638-0103-4a74-b88f-2a718b4dd4cc tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.522748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.522748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.522748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.523097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.530728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.533921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.595306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.596224 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2753/5482] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:31 2021] POST /identity/v3/users => generated 323 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:31.607234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cec0-9bf2-4f54-8745-fc0b0ee5d304 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.618292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.619510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.620376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.620852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.656074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=101a935991ed492b8cb6d972ac532b97)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.660672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.711559 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2730/5483] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:13:31 2021] PUT /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:31.713474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.726674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b6c7-1db2-468e-a366-08d68ca21365 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.796149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.797826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.798315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.798699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.806998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6f02c41902c64c6d986595e7c2f8ad97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.808562 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:31.808562 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:31.808562 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:31.810035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.843246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.847011 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2754/5484] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:13:31 2021] GET /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users => generated 1085 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:31.858884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64436-b8ea-4d11-a603-ce7adbf861e9 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.864474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.865517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.865907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.866287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.868139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=45769d53996a41218538119026b8f7a5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.869316 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_user_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:31.869316 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:31.869316 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:31.870717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.900023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.901139 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2731/5485] 10.222.0.13 () {58 vars in 1341 bytes} [Wed Nov 10 04:13:31 2021] HEAD /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:31.912952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84250b-608f-4e87-867a-b0fd20ccdb1b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:31.917886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:31.919104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:31.922688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:31.923335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:31.925993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=45769d53996a41218538119026b8f7a5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:31.928065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:31.940112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:31.983229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:31.988884 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2755/5486] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 04:13:31 2021] DELETE /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/45769d53996a41218538119026b8f7a5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.000498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8fe6c-1158-4f1f-9b78-d67885cfcfd1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.085015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.086708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.087224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.087743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.090249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=80da66af0c6c42a5b7e00b61cb17bd4f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.093562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.127813 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2732/5487] 10.222.0.13 () {58 vars in 1341 bytes} [Wed Nov 10 04:13:31 2021] HEAD /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.130652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.139759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.149410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9838f-b117-48aa-843d-c9217594eb11 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.151506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:32.172528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.173439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.173713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.173984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.177751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=80da66af0c6c42a5b7e00b61cb17bd4f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.179641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.196300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.219109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2756/5488] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 04:13:32 2021] DELETE /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/80da66af0c6c42a5b7e00b61cb17bd4f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.223678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.250380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf4624-1513-4443-8e94-d9251573d6de tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.303821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1d422-4a95-40fc-a30b-5e2e1e5e3deb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.315826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.316771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.318634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.319418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.322256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=101a935991ed492b8cb6d972ac532b97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.324498 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_user_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:32.324498 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:32.324498 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:32.325727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.351769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.353103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.353610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.354137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] PATH_INFO: `/v3/users/43457152ab024c74b5bf1b83a69aa4be` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.359704 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2757/5489] 10.222.0.13 () {58 vars in 1341 bytes} [Wed Nov 10 04:13:32 2021] HEAD /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.363793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.372992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43457152ab024c74b5bf1b83a69aa4be)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.376367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.383804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170bbf-8bd0-4339-b959-2110351b4173 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.392814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.394091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.394482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.395028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.397034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6f02c41902c64c6d986595e7c2f8ad97, user_id=101a935991ed492b8cb6d972ac532b97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.399193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.412549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.445249 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2758/5490] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 04:13:32 2021] DELETE /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users/101a935991ed492b8cb6d972ac532b97 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.449253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.457151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43457152ab024c74b5bf1b83a69aa4be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.465875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43457152ab024c74b5bf1b83a69aa4be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.466830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43457152ab024c74b5bf1b83a69aa4be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.467627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43457152ab024c74b5bf1b83a69aa4be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.478204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43457152ab024c74b5bf1b83a69aa4be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.508955 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2733/5491] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:32 2021] DELETE /identity/v3/users/43457152ab024c74b5bf1b83a69aa4be => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:32.591342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d06e-1a30-4662-91b7-84225f332187 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.716338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.717254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.717538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.717815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.721408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6f02c41902c64c6d986595e7c2f8ad97)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.726969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.748465 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2759/5492] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:13:32 2021] GET /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97/users => generated 145 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:32.751437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.753116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:32.772386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c645a63-d140-4a79-865f-61869b4807a9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:32.779504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:32.780830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:32.781362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:32.782580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users/101a935991ed492b8cb6d972ac532b97` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:32.784468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_user(user_id=101a935991ed492b8cb6d972ac532b97)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:32.786647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:32.908217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:32.911278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:32.965427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:32.999351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.000135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.001382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.024794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101a935991ed492b8cb6d972ac532b97'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.068670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2734/5493] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:32 2021] DELETE /identity/v3/users/101a935991ed492b8cb6d972ac532b97 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:33.073266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:33.078044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.105146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188479e5-e4f2-4e98-8a00-39e9b657285e tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:33.209771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41fc4-6fbb-4907-b0a5-b44d2661a2a7 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:33.222908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:33.223837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:33.225559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.225934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.226344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.226713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.227052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users/80da66af0c6c42a5b7e00b61cb17bd4f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.227416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] PATH_INFO: `/v3/projects/3444d571fcd742ef8ce43822b52d49be` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.231407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80da66af0c6c42a5b7e00b61cb17bd4f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:33.233476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:33.254976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3444d571fcd742ef8ce43822b52d49be)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:33.260824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:33.350541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.370033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.371974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.373740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.395610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3444d571fcd742ef8ce43822b52d49be', 'request_id': 'req-071acb64-6abb-4d69-98b3-acef47fc0cce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.398695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80da66af0c6c42a5b7e00b61cb17bd4f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.412872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3444d571fcd742ef8ce43822b52d49be', 'request_id': 'req-071acb64-6abb-4d69-98b3-acef47fc0cce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.431265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3444d571fcd742ef8ce43822b52d49be', 'request_id': 'req-071acb64-6abb-4d69-98b3-acef47fc0cce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.458521 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2735/5494] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:33 2021] DELETE /identity/v3/users/80da66af0c6c42a5b7e00b61cb17bd4f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:33.460015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:33.463476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.477040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] The token cache is being invalidate because project 3444d571fcd742ef8ce43822b52d49be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:33.478669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.480133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-071acb64-6abb-4d69-98b3-acef47fc0cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.493785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2760/5495] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:32 2021] DELETE /identity/v3/projects/3444d571fcd742ef8ce43822b52d49be => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:33.498343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03caf4-1682-4374-baf8-07c52121277a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.500397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03caf4-1682-4374-baf8-07c52121277a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.501181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03caf4-1682-4374-baf8-07c52121277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.561666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ea03caf4-1682-4374-baf8-07c52121277a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:33.563716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea03caf4-1682-4374-baf8-07c52121277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.591534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b2f2-d319-47a8-8ae8-72986adb3a46 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:33.600366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:33.601886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.602396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.602889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users/45769d53996a41218538119026b8f7a5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.605036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_user(user_id=45769d53996a41218538119026b8f7a5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:33.609936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:33.667852 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2761/5496] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:33.679781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.680194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.681647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.733983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:33.739460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.822974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.830050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2762/5497] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:33.831898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:33.840156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.842457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.843315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.857634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45769d53996a41218538119026b8f7a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:33.885536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4d941-52b8-46c6-a77b-86ea5006f580 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:33.896106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:33.897378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:33.898087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:33.898624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:33.899631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:33.900350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:33.902377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:33.926221 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2763/5498] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:33.932633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:33.943574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.953418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2736/5499] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:33 2021] DELETE /identity/v3/users/45769d53996a41218538119026b8f7a5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:33.961216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:33.965523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:33.979984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d86be7-fee2-49a3-b1bb-f1066993439f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.129905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.130589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.130871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.131141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.133376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.135741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.146581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d0e-bd43-4fbc-9072-8fab93b06025 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.161189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.162076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.162356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.162632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/6f02c41902c64c6d986595e7c2f8ad97` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.165128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6f02c41902c64c6d986595e7c2f8ad97)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.167032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.204679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2764/5500] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:33 2021] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:34.208661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.267723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2737/5501] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:33 2021] DELETE /identity/v3/groups/6f02c41902c64c6d986595e7c2f8ad97 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:34.273811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.353838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9524-9a48-4460-9c30-8df698f5e0cd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.401671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8976a-43f4-4dd1-9038-f05c92b83648 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.407717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.408727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.409192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.410256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.411286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.414215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192094b9-f897-440a-baab-2f1225b9413b tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.440989 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2738/5502] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/groups => generated 326 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:34.443942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.445680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.448674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.477305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] MFA Rules not processed for user `c1b28fb14ec347ce8369595664ed6d88`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:34.479403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:34.495187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.495895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.496170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.496442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.497240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.503481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.555517 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2765/5503] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:34.557405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.562859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2739/5504] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:34.564130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.606174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb8c91-0e0a-4737-b85c-38af55f34814 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.607560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35748478-2319-47a4-ac06-a4433a4a7e67 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.615101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.615530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.616314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.616445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.616813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.617113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.617244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.617652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.618510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.619020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.620794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.621133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.633685 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2740/5505] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:34.638109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.652903 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2766/5506] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/groups => generated 327 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:34.657898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.670549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba133-7f77-47cf-ad85-9bcc1acda6af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.682227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.683037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.683468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229e9a-6a99-4254-8543-e7cb664ef839 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.684934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.685653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.687244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.689150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.693745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.694683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.694792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.694987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.695709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.698558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.720846 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2741/5507] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:34.726196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.732646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2767/5508] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/groups => generated 327 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:34.737589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.762795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebab02-87b0-4b90-9ed9-2fbf03c2f1ab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.778649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.779283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141f35-5171-4c1b-bae6-390de50c7fcd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.780790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.782475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.783453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] PATH_INFO: `/v3/projects/c1641302347f4b8788361ba3c39de208/users/f4e9b78a84314e65a75fca609e13137c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.792243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:34.805461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.805461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.805461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.805461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.806019 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_groups failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:34.806019 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:34.806019 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:34.810710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.840656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2768/5509] 10.222.0.13 () {58 vars in 1124 bytes} [Wed Nov 10 04:13:34 2021] GET /identity/v3/groups => generated 1490 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:34.840656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:34.853451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1641302347f4b8788361ba3c39de208, user_id=f4e9b78a84314e65a75fca609e13137c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:34.860839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fb80-2fec-46e0-9a1f-55a8a48c541c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:34.880003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f0d1-c0f9-4f6b-9624-c7b6185e0827 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:34.917579 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2742/5510] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:34 2021] PUT /identity/v3/projects/c1641302347f4b8788361ba3c39de208/users/f4e9b78a84314e65a75fca609e13137c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:34.934802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:34.935827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:34.936366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:34.966869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:34.968621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:35.077841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.079233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.079512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.079782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/b44ce5ee1e644563bdcc37ae70a2c97b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.085525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b44ce5ee1e644563bdcc37ae70a2c97b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.087426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.096938 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2743/5511] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:35.101771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.103405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:35.199213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8de51-5b63-43a2-9f07-574905f164af None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.214900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.215476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2769/5512] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:34 2021] DELETE /identity/v3/groups/b44ce5ee1e644563bdcc37ae70a2c97b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:35.216453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.218615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.218858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.219711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.229627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:35.240776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.242188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.251914 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2744/5513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:35.252880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.267544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588421e-ede3-439d-9cb3-ec4e8d062b4e service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.331947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.333111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.333260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.333431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/739786907d6849d28a17673f48cb40ee` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.340354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=739786907d6849d28a17673f48cb40ee)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.342320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.357571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9204b68-4ae2-4b79-8a2c-a53587038af1 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.379376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.380074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.380460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.380783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.419165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2745/5514] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:35 2021] DELETE /identity/v3/groups/739786907d6849d28a17673f48cb40ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:35.423364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.528943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.532929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.566357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d74ff-90c3-4bc1-bccd-25420405224a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.567280 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2770/5515] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:35.583267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.584205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.586259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.588318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/99f862700cbd4689aee755edd2f574e6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.603617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=99f862700cbd4689aee755edd2f574e6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.605564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.701708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2746/5516] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:35 2021] DELETE /identity/v3/groups/99f862700cbd4689aee755edd2f574e6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:35.709183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.727549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d30501-f497-4f60-a194-0b8a87a2acee service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.837918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.838638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.838848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.839122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.840274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.841737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.896694 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2771/5517] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:35 2021] POST /identity/v3/users => generated 321 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:35.898689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:35.920867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ced5dc-8264-4dc3-b271-af7460f05314 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:35.946763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:35.949406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:35.949689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:35.951171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:35.954943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:35.959416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:35.997770 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2747/5518] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:35 2021] POST /identity/v3/groups => generated 326 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:36.003139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.016123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a7e6-291b-494f-a569-cc998e4dd7bb tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.035615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.037231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.037500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.037840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/a77a93620182451db0b05ed2384d1c6b/users/67214e4fd8854ba5b0d84912b4441216` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.085571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a77a93620182451db0b05ed2384d1c6b, user_id=67214e4fd8854ba5b0d84912b4441216)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.089749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.157618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2772/5519] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:13:36 2021] PUT /identity/v3/groups/a77a93620182451db0b05ed2384d1c6b/users/67214e4fd8854ba5b0d84912b4441216 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:36.161078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.183748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac661d-bfd9-4087-a68b-e600778820ad tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.307717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.308472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.308965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.309248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.310023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.312262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.334175 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2748/5520] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:13:36 2021] POST /identity/v3/groups => generated 326 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:36.338036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.367579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f6ae-3f13-4bb4-83d6-825d97844e52 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.377963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.380498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.381516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.382170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bb329b82a7f4404697574e9d3d127e0f/users/67214e4fd8854ba5b0d84912b4441216` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.397955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bb329b82a7f4404697574e9d3d127e0f, user_id=67214e4fd8854ba5b0d84912b4441216)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.400942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.456565 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2773/5521] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:13:36 2021] PUT /identity/v3/groups/bb329b82a7f4404697574e9d3d127e0f/users/67214e4fd8854ba5b0d84912b4441216 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:36.458074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.475767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627010a3-3d24-4470-8479-5c8439c74057 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.578124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.578968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.579301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.579639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users/67214e4fd8854ba5b0d84912b4441216/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.581074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=67214e4fd8854ba5b0d84912b4441216)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.583350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.606904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2749/5522] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:13:36 2021] GET /identity/v3/users/67214e4fd8854ba5b0d84912b4441216/groups => generated 838 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:36.607553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.619306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f376-a703-42b7-b5fe-45eeaa4b0091 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.635721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.636667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.636947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.637220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/bb329b82a7f4404697574e9d3d127e0f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.638603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bb329b82a7f4404697574e9d3d127e0f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.640528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.743526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2774/5523] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:36 2021] DELETE /identity/v3/groups/bb329b82a7f4404697574e9d3d127e0f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:36.748108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:36.768645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b40b-21de-4a3d-a739-846d2528fe6a tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:36.902540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:36.903907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:36.904200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:36.904478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/groups/a77a93620182451db0b05ed2384d1c6b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:36.905856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a77a93620182451db0b05ed2384d1c6b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:36.908912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:36.989748 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2750/5524] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:13:36 2021] DELETE /identity/v3/groups/a77a93620182451db0b05ed2384d1c6b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:36.994080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:37.019118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c8123-28cb-4dc9-bf3c-24bbaa1ba948 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:37.208850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:37.211483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:37.213017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:37.213169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/users/67214e4fd8854ba5b0d84912b4441216` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:37.215883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_user(user_id=67214e4fd8854ba5b0d84912b4441216)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:37.224205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:37.366185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67214e4fd8854ba5b0d84912b4441216'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.386046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67214e4fd8854ba5b0d84912b4441216'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.389511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67214e4fd8854ba5b0d84912b4441216'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.431351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67214e4fd8854ba5b0d84912b4441216'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.452907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67214e4fd8854ba5b0d84912b4441216'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.475026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:37.475572 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2775/5525] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:36 2021] DELETE /identity/v3/users/67214e4fd8854ba5b0d84912b4441216 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:37.478060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:37.502950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fba97-bc87-4f0b-9d62-4419a442b108 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:37.622708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:37.624056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:37.624572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:37.626674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/domains/7587bfe2c9d34c2f90bfc9b23c262f76` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:37.629914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7587bfe2c9d34c2f90bfc9b23c262f76)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:37.632039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:37.661857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.663096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.691681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.692711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-171ae55c-53e8-402e-99ff-a323568efe4d tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:37.695819 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2751/5526] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:13:37 2021] PATCH /identity/v3/domains/7587bfe2c9d34c2f90bfc9b23c262f76 => generated 277 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:13:37.701040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:37.718349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755b4be-a369-4680-8686-00dfab8a1bf0 tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:37.865073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef589322064071b9aa2c248f851c6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '161f148c5be941a9bde581802d3ccdfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:37.866349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:37.866878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:37.868175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] PATH_INFO: `/v3/domains/7587bfe2c9d34c2f90bfc9b23c262f76` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:37.915459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7587bfe2c9d34c2f90bfc9b23c262f76)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:37.929471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:37.955520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:37.955905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:37.956240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:38.056530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.068720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] MFA Rules not processed for user `f4e9b78a84314e65a75fca609e13137c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:38.075117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:38.077747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.190174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.199430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.217385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.242425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] The token cache is being invalidate because project 7587bfe2c9d34c2f90bfc9b23c262f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:38.242784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.244795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.249352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2752/5527] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:38.257088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:38.261493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:38.272659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.281451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.284407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7587bfe2c9d34c2f90bfc9b23c262f76', 'request_id': 'req-b22faf01-f5e4-453f-b4a5-b5acdde730bd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.299436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2776/5528] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:13:37 2021] DELETE /identity/v3/domains/7587bfe2c9d34c2f90bfc9b23c262f76 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:38.305270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:38.308456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:38.446654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83b66-b134-4e92-8e12-03bb2b866a4f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:38.472836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22faf01-f5e4-453f-b4a5-b5acdde730bd tempest-GroupsV3TestJSON-966067405 tempest-GroupsV3TestJSON-966067405-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:38.485997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:38.486889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:38.487163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:38.487434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] PATH_INFO: `/v3/users/34cb1abda6e143e780e32a7f9769226b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:38.501379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cb1abda6e143e780e32a7f9769226b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:38.506564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:38.618354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:38.621129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:38.622448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:38.622985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:38.629489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:38.687545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cb1abda6e143e780e32a7f9769226b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.722257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cb1abda6e143e780e32a7f9769226b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.725847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cb1abda6e143e780e32a7f9769226b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.744468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:38.746612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73bceb-7150-42b8-becb-8497d3eb11bd service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:38.760022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2753/5529] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:38.768864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cb1abda6e143e780e32a7f9769226b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.785701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cb1abda6e143e780e32a7f9769226b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:38.796283 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2777/5530] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:38 2021] DELETE /identity/v3/users/34cb1abda6e143e780e32a7f9769226b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:38.814591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:38.815103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:38.815453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:38.857692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:38.859061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:38.938877 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2754/5531] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:38.948582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:38.950153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:39.103224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7604-7f9a-4502-be7f-60bc895be53e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:39.111794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:39.112652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:39.113166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:39.113569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:39.128411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:39.130014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:39.149209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2778/5532] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:40.013137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:40.014625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:40.035979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f54f10-8bb8-40c1-9d7d-adcb4854c8cd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:40.042420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:40.044814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:40.045316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:40.045746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] PATH_INFO: `/v3/projects/1739d6cf932445b8bcee0df4457ea1df` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:40.048036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1739d6cf932445b8bcee0df4457ea1df)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:40.050281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:40.124048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1739d6cf932445b8bcee0df4457ea1df', 'request_id': 'req-bfc6cbc3-67ad-4cda-b532-ebe538938a17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.130461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1739d6cf932445b8bcee0df4457ea1df', 'request_id': 'req-bfc6cbc3-67ad-4cda-b532-ebe538938a17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.138352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1739d6cf932445b8bcee0df4457ea1df', 'request_id': 'req-bfc6cbc3-67ad-4cda-b532-ebe538938a17'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.158205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] The token cache is being invalidate because project 1739d6cf932445b8bcee0df4457ea1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:40.158825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.159978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bfc6cbc3-67ad-4cda-b532-ebe538938a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.162605 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2755/5533] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:40 2021] DELETE /identity/v3/projects/1739d6cf932445b8bcee0df4457ea1df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:40.166328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:40.180930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ab3a-3779-4da3-8189-84a3f41bee9f service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:40.303588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:40.304218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:40.304496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:40.304860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] PATH_INFO: `/v3/users/21ef589322064071b9aa2c248f851c6a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:40.314022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ef589322064071b9aa2c248f851c6a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:40.315958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:40.407087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ef589322064071b9aa2c248f851c6a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.424292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ef589322064071b9aa2c248f851c6a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.426267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ef589322064071b9aa2c248f851c6a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.453957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ef589322064071b9aa2c248f851c6a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.470567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ef589322064071b9aa2c248f851c6a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:40.491497 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2779/5534] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:40 2021] DELETE /identity/v3/users/21ef589322064071b9aa2c248f851c6a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:40.989873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:40.990156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:40.990478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:41.015346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] MFA Rules not processed for user `f4e9b78a84314e65a75fca609e13137c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:41.017463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:41.102561 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2756/5535] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:42.071790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.079284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:42.235980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3bb9-a2af-4979-812a-8a807a4ef996 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.241830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.242779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.243126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.243542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] PATH_INFO: `/v3/projects/161f148c5be941a9bde581802d3ccdfc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.246079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161f148c5be941a9bde581802d3ccdfc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.248267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.352747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161f148c5be941a9bde581802d3ccdfc', 'request_id': 'req-636abf7e-7f2b-4966-aa1d-d581d2e83f75'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:42.368524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161f148c5be941a9bde581802d3ccdfc', 'request_id': 'req-636abf7e-7f2b-4966-aa1d-d581d2e83f75'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:42.379162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161f148c5be941a9bde581802d3ccdfc', 'request_id': 'req-636abf7e-7f2b-4966-aa1d-d581d2e83f75'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:42.386982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.390120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:42.413718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] The token cache is being invalidate because project 161f148c5be941a9bde581802d3ccdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:42.415412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:42.417581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-636abf7e-7f2b-4966-aa1d-d581d2e83f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:42.422053 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2780/5536] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:42 2021] DELETE /identity/v3/projects/161f148c5be941a9bde581802d3ccdfc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:42.435358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6367-7a36-42dc-835a-a7c0568085ea None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.435650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6367-7a36-42dc-835a-a7c0568085ea None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.435925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6367-7a36-42dc-835a-a7c0568085ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.463414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e21d6367-7a36-42dc-835a-a7c0568085ea None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:42.464647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e21d6367-7a36-42dc-835a-a7c0568085ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:42.477441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ca2e0-7712-43f3-b0ea-bca899a522b0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.565890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.566048 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2781/5537] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:42.566854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.567141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.567414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.575150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:42.575556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.576048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.577452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.590669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.592103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.601618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:42.604203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:42.608782 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2757/5538] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:42.616538 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2782/5539] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:42.620890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.635029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f4aa-9ecc-4c57-a378-ee1a2143b590 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.639950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.641350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.641667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.641952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.642694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:42.643002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.644804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.657402 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2758/5540] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:42.662021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.672230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94ff1-d43a-4e9b-ac8c-87f7d2679964 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.680106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.681376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.681653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.681928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.682652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.684544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.719659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2783/5541] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:42 2021] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:42.723932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.748710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bdafe-6836-4330-928a-124efcd86f22 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.854980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.855943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.856372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.856746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.857879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.862884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.898685 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2759/5542] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:42 2021] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:42.899892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.914316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5202739-d798-4f83-94be-3ab42c48827c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.919114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.919769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.920108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.920393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.921161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.923903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.940277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2784/5543] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:42.941654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:42.955010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66de23c-655e-467f-9144-4970985fdfdc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:42.965396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:42.967427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:42.967789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:42.968140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:42.969559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:42.971288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f22a3-9857-4f31-83f0-8585ea9244bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:42.988817 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2760/5544] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:42.991720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.002441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed687927-36d5-47f1-bd00-03b323adf7c1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.009818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.010819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.011202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.011603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] PATH_INFO: `/v3/projects/1d12321bbc1d476ca83bfcca7a2679ff/users/b91bf87e56d04c68aeee30e15e82b6a9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.032559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d12321bbc1d476ca83bfcca7a2679ff, user_id=b91bf87e56d04c68aeee30e15e82b6a9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.035271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.053206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2785/5545] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:42 2021] PUT /identity/v3/projects/1d12321bbc1d476ca83bfcca7a2679ff/users/b91bf87e56d04c68aeee30e15e82b6a9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:43.063585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.063918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.064228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.097572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] MFA Rules not processed for user `b91bf87e56d04c68aeee30e15e82b6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:43.099018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:43.189904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2761/5546] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:43 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:43.195293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.288852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d087a-1c0d-4ae1-82df-353384966178 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.294845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.296089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.296475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.296907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.297739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.311377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.367517 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2786/5547] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:43 2021] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:43.369300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.391366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8c53-a549-4bf3-83ef-fd15fd6ce7c4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.464729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.465563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.465946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.466375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.467573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.470657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.516474 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2762/5548] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:43 2021] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:43.520426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.533420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce0f5-cb07-46c0-b2c0-023884112fac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.541417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.542156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.542445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.542717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.543658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.546174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.560867 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2787/5549] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:43.565392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.580142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527053b-12e5-4afb-b6fa-65617662db08 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.586806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.588011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.588516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.589083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] PATH_INFO: `/v3/projects/2c8f3e6a50744390afcc08394aeed686/users/e299047274b34d4bb9a0066699dff1fd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.612555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8f3e6a50744390afcc08394aeed686, user_id=e299047274b34d4bb9a0066699dff1fd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.615957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.636048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2763/5550] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:43 2021] PUT /identity/v3/projects/2c8f3e6a50744390afcc08394aeed686/users/e299047274b34d4bb9a0066699dff1fd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:43.639458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.654411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed39bd-f3f0-4a1e-81e5-c70ce3d23933 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.745506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.746387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.746655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.746990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.747751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.749425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab556de-c5a0-4f81-946a-7469f402346f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.761960 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2788/5551] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:43.766188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:43.779768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2297-b896-42f1-b3e6-5bde81a2abbf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:43.785820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:43.786822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.787202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.787578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] PATH_INFO: `/v3/projects/2c8f3e6a50744390afcc08394aeed686/users/e299047274b34d4bb9a0066699dff1fd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.789873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8f3e6a50744390afcc08394aeed686, user_id=e299047274b34d4bb9a0066699dff1fd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:43.793834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:43.806757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2764/5552] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:43 2021] PUT /identity/v3/projects/2c8f3e6a50744390afcc08394aeed686/users/e299047274b34d4bb9a0066699dff1fd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:43.817242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:43.818637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:43.818947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:43.861834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] MFA Rules not processed for user `e299047274b34d4bb9a0066699dff1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:43.863922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:43.981230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2789/5553] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:43.987654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.008022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b72b-ebce-47a5-9ca9-a3cc7d9ca771 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.021249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.022173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.022613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.023042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.023998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.025201 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.025201 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:44.025201 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:44.027343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.057779 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2765/5554] 10.222.0.13 () {60 vars in 1184 bytes} [Wed Nov 10 04:13:43 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:44.061931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.074806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273863d-fb07-4ee6-9f71-d2d72f878f27 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.085670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.086697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.087019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.087291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a50b8ab967c54f648978f5d7206244c3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.088157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a50b8ab967c54f648978f5d7206244c3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.089377 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.089377 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:44.089377 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:44.090572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.104749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2790/5555] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:13:44 2021] GET /identity/v3/OS-OAUTH1/consumers/a50b8ab967c54f648978f5d7206244c3 => generated 220 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:44.106210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.123862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf87b-9ebd-410c-9205-20b8f7ab0d27 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.131446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.132909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.133629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.134092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a50b8ab967c54f648978f5d7206244c3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.135672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a50b8ab967c54f648978f5d7206244c3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.136897 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.136897 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:44.136897 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:44.138522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.138800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer a50b8ab967c54f648978f5d7206244c3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.139080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.140144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.181062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a50b8ab967c54f648978f5d7206244c3', 'request_id': 'req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.203875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2766/5556] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/a50b8ab967c54f648978f5d7206244c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:44.209078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.211785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:44.228027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe452-866c-4445-a6df-902908a4c45e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.233770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.234778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.235213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.235667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.236569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.238483 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.238483 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:44.238483 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:44.241866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.270673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.270957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2791/5557] 10.222.0.13 () {60 vars in 1184 bytes} [Wed Nov 10 04:13:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:44.284818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12111-5a1b-4f6c-bfa4-3abb66205b7a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.297461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.298311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.298593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.298864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.300834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c5f009a5342a4ab7933a7584ef507329)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.301904 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.301904 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:44.301904 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:44.302810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.313533 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2767/5558] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:13:44 2021] GET /identity/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329 => generated 221 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:13:44.315100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.329677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f403ad-4f84-4e43-bdec-309720c0e50e tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.336146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.337203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.337650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.338125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.339222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c5f009a5342a4ab7933a7584ef507329)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.340996 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.340996 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:13:44.340996 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:13:44.342556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.343021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer c5f009a5342a4ab7933a7584ef507329 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.343469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.344877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.363527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c5f009a5342a4ab7933a7584ef507329', 'request_id': 'req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.398714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2792/5559] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:44.402996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.404964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:44.420139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc934b-a69e-4ae6-bcb4-1d2d4faef82d tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.425092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.425937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.426220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.426498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.427178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c5f009a5342a4ab7933a7584ef507329)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.428983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.442596 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 10 04:13:44.444338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2768/5560] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:13:44 2021] GET /identity/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329 => generated 74 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 04:13:44.448471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.461012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a3a57-d57a-4c4b-ab0f-0cca1525b92c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.466041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.467264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.467737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.468030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.469355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c5f009a5342a4ab7933a7584ef507329)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.471078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.471341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer c5f009a5342a4ab7933a7584ef507329 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.471617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.472347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.489872 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 10 04:13:44.491321 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2793/5561] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/c5f009a5342a4ab7933a7584ef507329 => generated 74 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 04:13:44.496220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.497986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:44.511849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d18-9cae-4296-a42d-4dafad7bb6ec tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.519074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.519752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.520208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.520812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.521567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.523157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.537148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2769/5562] 10.222.0.13 () {60 vars in 1184 bytes} [Wed Nov 10 04:13:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:44.541260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.552598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e24f9-00f8-443a-a3c2-60390f99bd79 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.558408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.560494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.560494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.560494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.560494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.561924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.577357 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2794/5563] 10.222.0.13 () {60 vars in 1184 bytes} [Wed Nov 10 04:13:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:44.582010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.594623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12f54-831e-46a0-92ac-0853557df601 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.600636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.601282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.601558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.601829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.602483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.603477 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_consumers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.603477 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:44.603477 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:44.604994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.612085 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2770/5564] 10.222.0.13 () {58 vars in 1163 bytes} [Wed Nov 10 04:13:44 2021] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:44.616214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.627970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074cb22-fa97-4597-b7d8-d994023b0f16 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.633610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.634430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.634722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.634983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a108ea396ffa493b807cf0a8bd2b2ac8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.636348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a108ea396ffa493b807cf0a8bd2b2ac8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.637998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.638244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer a108ea396ffa493b807cf0a8bd2b2ac8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.638662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.639346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.652362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a108ea396ffa493b807cf0a8bd2b2ac8', 'request_id': 'req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.666744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2795/5565] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/a108ea396ffa493b807cf0a8bd2b2ac8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:44.670918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.672795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:44.686808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9f653-36cf-48a6-b3fd-66e5b10267d8 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.692163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.693019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.693305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.693581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/198aa2ff29cd427ca5ead61e6fc20973` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.694245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=198aa2ff29cd427ca5ead61e6fc20973)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.695796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.696061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer 198aa2ff29cd427ca5ead61e6fc20973 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.696332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.697206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.715578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '198aa2ff29cd427ca5ead61e6fc20973', 'request_id': 'req-47765d9b-c77b-4355-ba39-2fd4924d0040'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.735078 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2771/5566] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/198aa2ff29cd427ca5ead61e6fc20973 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:44.740167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.751124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a614f-fa9f-4fe6-a7a8-525a19e2ed1a tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.755839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.756477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.756794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.757071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.757796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.759656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.775795 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2796/5567] 10.222.0.13 () {60 vars in 1184 bytes} [Wed Nov 10 04:13:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:44.779959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.782209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:44.799116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47765d9b-c77b-4355-ba39-2fd4924d0040 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.807834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.808725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.809008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.809282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.810113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=03ea5fb1033f43bc8351c52e692d76b5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.811140 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:13:44.811140 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:13:44.811140 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:13:44.812008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.834124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2772/5568] 10.222.0.13 () {60 vars in 1284 bytes} [Wed Nov 10 04:13:44 2021] PATCH /identity/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5 => generated 220 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:13:44.837638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.849018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af788a-869d-4734-8161-9110ea465ef5 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.853755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.854571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.854851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.855125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.855787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=03ea5fb1033f43bc8351c52e692d76b5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.857440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.862238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2797/5569] 10.222.0.13 () {58 vars in 1262 bytes} [Wed Nov 10 04:13:44 2021] GET /identity/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5 => generated 220 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:44.866424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.877142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b3a74-4160-4880-846a-d79adf37e434 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:44.881935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299047274b34d4bb9a0066699dff1fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8f3e6a50744390afcc08394aeed686', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:44.882754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:44.883033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:44.883305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:44.883969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=03ea5fb1033f43bc8351c52e692d76b5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:44.885567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:44.886102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invalidating token cache because consumer 03ea5fb1033f43bc8351c52e692d76b5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:44.886379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.887574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.899848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c718218-abdd-4b9a-939c-510a8f8e6f1c tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '03ea5fb1033f43bc8351c52e692d76b5', 'request_id': 'req-5c718218-abdd-4b9a-939c-510a8f8e6f1c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:44.928525 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2773/5570] 10.222.0.13 () {58 vars in 1265 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/03ea5fb1033f43bc8351c52e692d76b5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:44.934127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:44.936262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:45.013482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fe62-a705-4de8-8cb5-e241f6897737 tempest-OAUTHConsumersV3Test-751497438 tempest-OAUTHConsumersV3Test-751497438-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:45.018978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:45.019923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:45.020194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:45.020469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] PATH_INFO: `/v3/users/b91bf87e56d04c68aeee30e15e82b6a9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:45.021858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91bf87e56d04c68aeee30e15e82b6a9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:45.023900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:45.087303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91bf87e56d04c68aeee30e15e82b6a9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:45.094803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91bf87e56d04c68aeee30e15e82b6a9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:45.095702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91bf87e56d04c68aeee30e15e82b6a9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:45.110491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91bf87e56d04c68aeee30e15e82b6a9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:45.119189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91bf87e56d04c68aeee30e15e82b6a9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:45.128729 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2798/5571] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:44 2021] DELETE /identity/v3/users/b91bf87e56d04c68aeee30e15e82b6a9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:45.131747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:45.132040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:45.132319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:45.151395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:45.153426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:45.217210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2774/5572] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:45.230064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:45.232264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:45.319584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667fb10-6d88-4ffa-b94e-102799262816 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:45.326163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:45.327093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:45.329070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:45.329363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:45.340399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:45.341991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:45.353071 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2799/5573] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:46.075981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:46.077850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:46.092070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c518-45ed-4005-bec8-cd67e91186ea None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:46.098960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:46.100212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:46.100643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:46.101042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] PATH_INFO: `/v3/projects/1d12321bbc1d476ca83bfcca7a2679ff` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:46.102502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d12321bbc1d476ca83bfcca7a2679ff)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:46.104631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:46.169240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d12321bbc1d476ca83bfcca7a2679ff', 'request_id': 'req-0ea40e8c-6184-455f-b58a-10a0020295fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.176299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d12321bbc1d476ca83bfcca7a2679ff', 'request_id': 'req-0ea40e8c-6184-455f-b58a-10a0020295fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.182987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d12321bbc1d476ca83bfcca7a2679ff', 'request_id': 'req-0ea40e8c-6184-455f-b58a-10a0020295fb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.212491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] The token cache is being invalidate because project 1d12321bbc1d476ca83bfcca7a2679ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:46.212838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.213500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.216671 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2775/5574] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:46 2021] DELETE /identity/v3/projects/1d12321bbc1d476ca83bfcca7a2679ff => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:46.220887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:46.232838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31c52-d8b4-46ea-aebd-4b8d54249507 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:46.293229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:46.301693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:46.302734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:46.303513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] PATH_INFO: `/v3/users/e299047274b34d4bb9a0066699dff1fd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:46.306277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e299047274b34d4bb9a0066699dff1fd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:46.309297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:46.363545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e299047274b34d4bb9a0066699dff1fd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.370464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e299047274b34d4bb9a0066699dff1fd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.371164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e299047274b34d4bb9a0066699dff1fd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.384420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e299047274b34d4bb9a0066699dff1fd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.393996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f26bc9c-9cad-4285-95cb-c7bc873639db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e299047274b34d4bb9a0066699dff1fd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:46.401122 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2800/5575] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:46 2021] DELETE /identity/v3/users/e299047274b34d4bb9a0066699dff1fd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:47.064155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.065855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:47.081268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea40e8c-6184-455f-b58a-10a0020295fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.166317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.169345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.170088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.170587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] PATH_INFO: `/v3/projects/2c8f3e6a50744390afcc08394aeed686` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.173678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8f3e6a50744390afcc08394aeed686)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.176332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:47.284828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8f3e6a50744390afcc08394aeed686', 'request_id': 'req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:47.300272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8f3e6a50744390afcc08394aeed686', 'request_id': 'req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:47.313190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8f3e6a50744390afcc08394aeed686', 'request_id': 'req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:47.356978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] The token cache is being invalidate because project 2c8f3e6a50744390afcc08394aeed686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:47.358440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:47.360763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cbb17ce5-7f63-474c-8ed1-d0a559e7de6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:47.367066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2776/5576] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:47 2021] DELETE /identity/v3/projects/2c8f3e6a50744390afcc08394aeed686 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:47.372477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.372991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.373178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.408181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:47.410305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:47.497865 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2801/5577] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:47.505766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.506070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.506348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.556200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:47.557448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:47.592442 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2777/5578] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:47.596020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.611875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625162-c551-4b70-b5dd-c450ba925f90 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.621474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.622629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.623114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.623617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.625003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:47.625573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.627994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:47.655868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2802/5579] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:13:47.657183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.669295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182903-6c88-434b-9adb-39f750ac6a1c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.674903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.675533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.675816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.676094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.676920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.679136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:47.721662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2778/5580] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:47 2021] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:47.726029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.744451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b3c4-06c3-4fe8-8829-d2c19ebd445d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.824478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.825545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.825986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.826682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.827677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.830838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:47.877792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2803/5581] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:47 2021] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:47.880739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.898837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1924ca-1973-42dc-9f47-443ba835c233 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.912280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.913084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.913346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.913619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.914376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.916068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:47.944287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2779/5582] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:47 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:47.945076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:47.962828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdfd-2f0b-4bf3-98d3-cb5c95103537 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:47.977016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:47.978067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:47.978547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:47.979034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:47.979952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:47.981814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1391fa-62f6-42fd-93a3-220c312673ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:48.006575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2804/5583] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:47 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:48.014138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.031185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4abff-3aba-402c-8a93-c31aa0f3ecfd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.041881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.045894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.046136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.046256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] PATH_INFO: `/v3/projects/4238bae0af894b4ca9e80be69a8a9f6c/users/ec8e28ec9dd6491db8ab3953e132550e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.084339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4238bae0af894b4ca9e80be69a8a9f6c, user_id=ec8e28ec9dd6491db8ab3953e132550e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:48.087273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937ab2-0c77-416c-aebd-44a99c73b438 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:48.094684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.095025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.097265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.128673 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2780/5584] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:48 2021] PUT /identity/v3/projects/4238bae0af894b4ca9e80be69a8a9f6c/users/ec8e28ec9dd6491db8ab3953e132550e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:48.140225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.141295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.141510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.148922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:48.150192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:48.214588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] MFA Rules not processed for user `ec8e28ec9dd6491db8ab3953e132550e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:48.218622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:48.316527 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2805/5585] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:13:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:48.334762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.336181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:48.399709 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2781/5586] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:48 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:48.400756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.424351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262994c-8a86-425e-b69f-5681d09d391d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.440066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e28ec9dd6491db8ab3953e132550e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4238bae0af894b4ca9e80be69a8a9f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.443117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.449035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.449615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] PATH_INFO: `/v3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.453566 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2782/5587] 10.222.0.13 () {58 vars in 1103 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/v3 => generated 255 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:48.458710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.477040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f12d-229b-43f8-84f5-6aa12ee82805 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.483398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.484692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.485044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.485390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.489675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ae9cd-99ae-4ddf-8fa3-7fe8ee9c94e1 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.495317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:48.497105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:48.504129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e40b-f50a-4469-a729-5d7788fb2845 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e28ec9dd6491db8ab3953e132550e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4238bae0af894b4ca9e80be69a8a9f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.505065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e40b-f50a-4469-a729-5d7788fb2845 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.505539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e40b-f50a-4469-a729-5d7788fb2845 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.506946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e40b-f50a-4469-a729-5d7788fb2845 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] PATH_INFO: `/v3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.507776 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2806/5588] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:13:48.509458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2783/5589] 10.222.0.13 () {58 vars in 1103 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/v3 => generated 255 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:48.515805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.533142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8d0d-5d29-4345-8dc7-65134daf1ab6 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.539899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a895-4551-4495-a9c2-2a7182270625 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e28ec9dd6491db8ab3953e132550e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4238bae0af894b4ca9e80be69a8a9f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.541567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a895-4551-4495-a9c2-2a7182270625 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.542264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a895-4551-4495-a9c2-2a7182270625 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.542638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a895-4551-4495-a9c2-2a7182270625 tempest-TestApiDiscovery-1142729548 tempest-TestApiDiscovery-1142729548-project] PATH_INFO: `/v3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.544294 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2807/5590] 10.222.0.13 () {58 vars in 1103 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/v3 => generated 255 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:48.550703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05952112-2ecd-497f-941a-0e4ae743eb13 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.550990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05952112-2ecd-497f-941a-0e4ae743eb13 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.551257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05952112-2ecd-497f-941a-0e4ae743eb13 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.553481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2784/5591] 10.222.0.13 () {56 vars in 894 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:13:48.559969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2f09-0f09-4048-8e02-a148fc4fa0fb None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.560735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2f09-0f09-4048-8e02-a148fc4fa0fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.561197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2f09-0f09-4048-8e02-a148fc4fa0fb None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.564687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2808/5592] 10.222.0.13 () {56 vars in 894 bytes} [Wed Nov 10 04:13:48 2021] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:13:48.570354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05952112-2ecd-497f-941a-0e4ae743eb13 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:48.741092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05952112-2ecd-497f-941a-0e4ae743eb13 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:48.747795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:48.769495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:48.774169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:48.774581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] PATH_INFO: `/v3/users/ec8e28ec9dd6491db8ab3953e132550e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:48.776699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8e28ec9dd6491db8ab3953e132550e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:48.786027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:48.972769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8e28ec9dd6491db8ab3953e132550e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:49.023332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8e28ec9dd6491db8ab3953e132550e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:49.034085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8e28ec9dd6491db8ab3953e132550e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:49.037459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8e28ec9dd6491db8ab3953e132550e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:49.069793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8e28ec9dd6491db8ab3953e132550e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:49.115262 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2785/5593] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:48 2021] DELETE /identity/v3/users/ec8e28ec9dd6491db8ab3953e132550e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:49.119870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:49.120266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:49.120844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:49.175116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:49.180876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:49.338995 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2809/5594] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:49.349795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:49.354010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:49.533307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8de4-cc40-497d-8aad-cda8ded8757a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:49.536941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:49.537585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:49.537860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:49.538252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:49.548985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:49.552137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3cf4-dc6e-4500-a514-74a00a4e04ef service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:49.576884 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2786/5595] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:50.005039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.006633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:50.029805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794f0e2-8e03-4269-b610-dc2455edbd7d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.045181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.046545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.047169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.047800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] PATH_INFO: `/v3/projects/4238bae0af894b4ca9e80be69a8a9f6c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.050119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4238bae0af894b4ca9e80be69a8a9f6c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.052242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.167864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4238bae0af894b4ca9e80be69a8a9f6c', 'request_id': 'req-27e2c57c-1558-4998-ac9d-9d932a9b8866'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:50.179768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4238bae0af894b4ca9e80be69a8a9f6c', 'request_id': 'req-27e2c57c-1558-4998-ac9d-9d932a9b8866'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:50.188482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4238bae0af894b4ca9e80be69a8a9f6c', 'request_id': 'req-27e2c57c-1558-4998-ac9d-9d932a9b8866'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:50.220782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] The token cache is being invalidate because project 4238bae0af894b4ca9e80be69a8a9f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:50.220782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:50.221612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-27e2c57c-1558-4998-ac9d-9d932a9b8866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:50.224893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2810/5596] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:50 2021] DELETE /identity/v3/projects/4238bae0af894b4ca9e80be69a8a9f6c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:50.231034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.231500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.234940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.274461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:50.275794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:50.365568 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2787/5597] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:50.375943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687b94-5e51-4121-8780-af72aab835cb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.376421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687b94-5e51-4121-8780-af72aab835cb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.376951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687b94-5e51-4121-8780-af72aab835cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.404293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-39687b94-5e51-4121-8780-af72aab835cb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:50.405643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39687b94-5e51-4121-8780-af72aab835cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:50.418256 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2811/5598] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:50.419940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.432696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91f99-7294-4e13-8d9b-65fced204964 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.439354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.440266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.440919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.441408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.447357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:50.448053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.451099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.471321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687b94-5e51-4121-8780-af72aab835cb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.476186 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2788/5599] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:50.486088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687b94-5e51-4121-8780-af72aab835cb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.491118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.491856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.492204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.492586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.493505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.495673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.547853 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2812/5600] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:50 2021] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:50.553411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.570352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353442b-4aae-4d82-b8d6-7762cfefb8b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.656170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.656928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.657311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.657583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.658360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.661017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.692789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.699481 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2789/5601] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:50 2021] POST /identity/v3/users => generated 305 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:50.704199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde459-bdd0-426c-86c8-dd97d479fd15 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.713041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.714004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.714353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.714696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.715515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.717308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.730479 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2813/5602] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:50.735484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.746342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035cef7-ea00-492a-bc17-42a8702d0b25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.759271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.760595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.761154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.761663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] PATH_INFO: `/v3/projects/d43e03f10bbb40c49854cc4969898669/users/8cc62796e3a74a4ebf4e5d3135f11124/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.779206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43e03f10bbb40c49854cc4969898669, user_id=8cc62796e3a74a4ebf4e5d3135f11124, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.782965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.810899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2790/5603] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:50 2021] PUT /identity/v3/projects/d43e03f10bbb40c49854cc4969898669/users/8cc62796e3a74a4ebf4e5d3135f11124/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:50.815640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.831008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c500a4-e271-48d8-b539-64c2622fa82b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.900597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.901314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.901592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.901859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.902584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.905410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827aa26-9583-4431-a232-66ce60bc7ccc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.922180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2814/5604] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:50 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:50.926276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:50.939231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452db3-1a59-43b5-8d32-c6289c6ad0af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:50.945254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:50.946330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.946626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.946896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] PATH_INFO: `/v3/projects/d43e03f10bbb40c49854cc4969898669/users/8cc62796e3a74a4ebf4e5d3135f11124/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:50.949049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43e03f10bbb40c49854cc4969898669, user_id=8cc62796e3a74a4ebf4e5d3135f11124, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:50.951952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:50.969269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2791/5605] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:50 2021] PUT /identity/v3/projects/d43e03f10bbb40c49854cc4969898669/users/8cc62796e3a74a4ebf4e5d3135f11124/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:50.979451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:50.982256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:50.986214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.032987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] MFA Rules not processed for user `8cc62796e3a74a4ebf4e5d3135f11124`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:51.035194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:51.158604 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2815/5606] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:50 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:51.163014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:51.315713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decd913-faa8-4c2e-97d9-ce228768be90 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:51.331982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:51.333267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.333714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.333858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.334666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:51.338030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:51.405127 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2792/5607] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:51 2021] POST /identity/v3/projects => generated 397 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:51.410008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:51.426900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99bd75-0af8-407b-b8b7-e862b588f877 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:51.568827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:51.569774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.570506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.571228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.572849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:51.575534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:51.609066 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2816/5608] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:51 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:51.612788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:51.630142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048e4f-a570-4841-bc53-f68118d57da0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:51.636576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:51.637279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.637610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.638469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.638683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:51.640918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:51.653227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2793/5609] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:51.658121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:51.693253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87a89-8f59-4097-b3e7-d8b2cdd9a7c2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:51.704804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:51.705550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.705920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.706342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.707888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:51.711652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c2c3-4b74-4896-9311-b68c6ce5b9bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:51.731756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2817/5610] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:51.734281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:51.753487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e098-2d20-4a1e-8db8-12e1fd4d8f4d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:51.771924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:51.775663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.778503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.779266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] PATH_INFO: `/v3/projects/d8b1431903f34b2f8d18c3aad15197e5/users/72a53ee515074680998d72451e2db546/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.819367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b1431903f34b2f8d18c3aad15197e5, user_id=72a53ee515074680998d72451e2db546, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:51.822678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:51.850160 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2794/5611] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:51 2021] PUT /identity/v3/projects/d8b1431903f34b2f8d18c3aad15197e5/users/72a53ee515074680998d72451e2db546/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:51.860467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:51.861137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:51.861554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:51.896346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] MFA Rules not processed for user `72a53ee515074680998d72451e2db546`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:51.898517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:52.108841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:52.110690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:52.111514 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2818/5612] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:51 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:52.189697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bb7d8-4f27-4ea9-a912-1a77d497da0f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:52.195380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:52.196161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:52.196449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:52.196780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:52.411644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:52.413150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30093e32-28e6-4cd6-b544-19e3f82cd4c1 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:52.447037 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2795/5613] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:52 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:53.226227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:53.325703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27f4f-d4a9-4054-8c5e-771e40411fda None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:53.336780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:53.338286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:53.338633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:53.338979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] PATH_INFO: `/v3/users/8cc62796e3a74a4ebf4e5d3135f11124` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:53.341435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc62796e3a74a4ebf4e5d3135f11124)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:53.344029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:53.526575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc62796e3a74a4ebf4e5d3135f11124'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:53.545370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc62796e3a74a4ebf4e5d3135f11124'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:53.549679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc62796e3a74a4ebf4e5d3135f11124'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:53.578227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc62796e3a74a4ebf4e5d3135f11124'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:53.598188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc62796e3a74a4ebf4e5d3135f11124'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:53.612068 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2819/5614] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:53 2021] DELETE /identity/v3/users/8cc62796e3a74a4ebf4e5d3135f11124 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:53.616797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:53.617302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:53.617302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:53.664600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:53.667091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:53.775691 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2796/5615] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:53.786854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:53.788779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:53.944714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76539574-cf50-4a48-b146-9f536c0254f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:53.948978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:53.949720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:53.950066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:53.950405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:53.965645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:53.967178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:53.980945 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2820/5616] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:54.538325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:54.540416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:54.562632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07cdb1-dd5c-472b-b6f6-2e5882479ba4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:54.567683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:54.568696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:54.569196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:54.569815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] PATH_INFO: `/v3/projects/d43e03f10bbb40c49854cc4969898669` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:54.571287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43e03f10bbb40c49854cc4969898669)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:54.573293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:54.655731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43e03f10bbb40c49854cc4969898669', 'request_id': 'req-db6af62f-1319-4535-bd73-14d350b8a149'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.666163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43e03f10bbb40c49854cc4969898669', 'request_id': 'req-db6af62f-1319-4535-bd73-14d350b8a149'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.677501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43e03f10bbb40c49854cc4969898669', 'request_id': 'req-db6af62f-1319-4535-bd73-14d350b8a149'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.696576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] The token cache is being invalidate because project d43e03f10bbb40c49854cc4969898669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:54.697256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.698285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.706846 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2797/5617] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:54 2021] DELETE /identity/v3/projects/d43e03f10bbb40c49854cc4969898669 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:54.710812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:54.721490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14cad-1ac8-44e4-9d5d-fd7d43929277 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:54.818164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:54.819468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:54.819977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:54.820484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] PATH_INFO: `/v3/users/72a53ee515074680998d72451e2db546` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:54.822166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a53ee515074680998d72451e2db546)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:54.824265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:54.920739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a53ee515074680998d72451e2db546'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.940362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a53ee515074680998d72451e2db546'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.941441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a53ee515074680998d72451e2db546'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.958357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a53ee515074680998d72451e2db546'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.972347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-67ba6d67-efc2-4f48-af23-c241b10626ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a53ee515074680998d72451e2db546'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:54.988895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2821/5618] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:54 2021] DELETE /identity/v3/users/72a53ee515074680998d72451e2db546 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:55.495904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:55.497266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:55.519718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af62f-1319-4535-bd73-14d350b8a149 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:55.608161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:55.609113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:55.609397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:55.609678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] PATH_INFO: `/v3/projects/d8b1431903f34b2f8d18c3aad15197e5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:55.610915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b1431903f34b2f8d18c3aad15197e5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:55.614190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:55.694293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b1431903f34b2f8d18c3aad15197e5', 'request_id': 'req-7dd9164e-cbe0-4848-853e-0b625111ac6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:55.701944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b1431903f34b2f8d18c3aad15197e5', 'request_id': 'req-7dd9164e-cbe0-4848-853e-0b625111ac6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:55.750163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b1431903f34b2f8d18c3aad15197e5', 'request_id': 'req-7dd9164e-cbe0-4848-853e-0b625111ac6b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:55.779672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] The token cache is being invalidate because project d8b1431903f34b2f8d18c3aad15197e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:55.779955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:55.780950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7dd9164e-cbe0-4848-853e-0b625111ac6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:55.782953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2798/5619] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:55 2021] DELETE /identity/v3/projects/d8b1431903f34b2f8d18c3aad15197e5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:55.791154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:55.792291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:55.792794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:55.826893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:55.828766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:55.970085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2822/5620] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:55.972050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:55.972687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:55.973223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:55.993216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:55.994786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:56.010288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.011403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2799/5621] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:56.021927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26ae32-27b5-403c-b91c-7e70397a3ae4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.028244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.029628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.030105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.030594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.032094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:56.032642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.034581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.051718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2823/5622] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:56.052907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.062994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c7c9-0c64-47c4-a519-9322d4670140 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.075297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.075984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.076268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.076866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.077598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.080230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.114514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2800/5623] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:56 2021] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:56.118397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.129437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102d5-b932-4e1c-8ed2-0e495126e314 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.211002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.213136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.213435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.213723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.214581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.220464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.254612 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2824/5624] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:56 2021] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:56.259115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.271716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7850e-9acf-4e90-b1e1-5bf7889eda5a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.277217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.278034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.278459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.278837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.279699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.282146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.301665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2801/5625] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:56.302670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.321568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ac01-9aba-4298-9acb-16a2f0e35825 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.331729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.331729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.331729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.331729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.332847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.335601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f14aa0-62ea-4897-ad92-2c330a2cf629 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.351644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2825/5626] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:56.352886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.369605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518712-6fdf-400c-b0b0-56023691b667 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.375677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.376766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.377044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.377314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] PATH_INFO: `/v3/projects/355352fa2d7b42fbbc18b16a56be8be9/users/ac5d25bfe57b4a5cadb2157b4c9d2abf/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.394517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355352fa2d7b42fbbc18b16a56be8be9, user_id=ac5d25bfe57b4a5cadb2157b4c9d2abf, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.398043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.424681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2802/5627] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:56 2021] PUT /identity/v3/projects/355352fa2d7b42fbbc18b16a56be8be9/users/ac5d25bfe57b4a5cadb2157b4c9d2abf/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:56.431871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962194e-a42f-4bbd-b3d9-27ec3a328f99 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.432437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962194e-a42f-4bbd-b3d9-27ec3a328f99 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.433210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962194e-a42f-4bbd-b3d9-27ec3a328f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.494871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b962194e-a42f-4bbd-b3d9-27ec3a328f99 None None] MFA Rules not processed for user `ac5d25bfe57b4a5cadb2157b4c9d2abf`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:56.501006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b962194e-a42f-4bbd-b3d9-27ec3a328f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:56.602880 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2826/5628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:56 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:13:56.610214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:56.686898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43440b2-e3d0-4c00-85cb-8e1aa4f1a7e1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:56.706982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:56.711804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.712137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.713014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] PATH_INFO: `/v3/users/ac5d25bfe57b4a5cadb2157b4c9d2abf` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.714579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5d25bfe57b4a5cadb2157b4c9d2abf)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:56.718132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:56.809424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5d25bfe57b4a5cadb2157b4c9d2abf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:56.816441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5d25bfe57b4a5cadb2157b4c9d2abf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:56.817242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5d25bfe57b4a5cadb2157b4c9d2abf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:56.817863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5d25bfe57b4a5cadb2157b4c9d2abf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:56.836220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5d25bfe57b4a5cadb2157b4c9d2abf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:56.865927 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2803/5629] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:56 2021] DELETE /identity/v3/users/ac5d25bfe57b4a5cadb2157b4c9d2abf => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:56.870131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:56.871131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:56.871644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:56.927629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:56.929855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:57.033313 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2827/5630] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:57.059297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:57.061057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:57.167542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f9cb-dfa8-4fed-8666-47fb6bf8e0f3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:57.183884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:57.184724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:57.184724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:57.185061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:57.219294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:57.223209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301847-cd98-4d04-8c60-fb5c16117c5c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:57.245495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2804/5631] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:13:57.604917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:57.608371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:57.630443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5782a5-4121-4887-b9a8-a97fe87a4d30 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:57.636911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:57.638419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:57.638808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:57.639315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] PATH_INFO: `/v3/users/457cfdcbacf241dfbbe6779e298c20cb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:57.642661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=457cfdcbacf241dfbbe6779e298c20cb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:57.647051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:57.780361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457cfdcbacf241dfbbe6779e298c20cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:57.794502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457cfdcbacf241dfbbe6779e298c20cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:57.795826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457cfdcbacf241dfbbe6779e298c20cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:57.823226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457cfdcbacf241dfbbe6779e298c20cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:57.849861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457cfdcbacf241dfbbe6779e298c20cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:57.868232 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2828/5632] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:57 2021] DELETE /identity/v3/users/457cfdcbacf241dfbbe6779e298c20cb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:57.870768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:57.872213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:57.872978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:57.908647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:57.925070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.020112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.027776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.046636 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2805/5633] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:58.064728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1643f4-090a-4f7a-9f75-8210031cc8ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.080464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.080826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.081358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.083324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.085283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.085577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] PATH_INFO: `/v3/projects/355352fa2d7b42fbbc18b16a56be8be9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.090813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355352fa2d7b42fbbc18b16a56be8be9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.092763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.191116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90637a-eebf-48e5-9127-e0c563a78329 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.196851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355352fa2d7b42fbbc18b16a56be8be9', 'request_id': 'req-08c8807f-2260-46bb-93e8-74971375d1a2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.205093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355352fa2d7b42fbbc18b16a56be8be9', 'request_id': 'req-08c8807f-2260-46bb-93e8-74971375d1a2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.211876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355352fa2d7b42fbbc18b16a56be8be9', 'request_id': 'req-08c8807f-2260-46bb-93e8-74971375d1a2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.261997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] The token cache is being invalidate because project 355352fa2d7b42fbbc18b16a56be8be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:58.262250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.262962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08c8807f-2260-46bb-93e8-74971375d1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.265714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2829/5634] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:58 2021] DELETE /identity/v3/projects/355352fa2d7b42fbbc18b16a56be8be9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:58.271150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.271554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.271892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.295525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.296193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.297047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.297629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.300425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.327457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:58.333061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.386683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.388300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0160f-2d4c-4673-8306-52136ab494b8 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.399252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2806/5635] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:13:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:13:58.440211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2830/5636] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:58.447100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.447457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.447679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.480791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:58.482548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.497028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2807/5637] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:58.498449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.512326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f3837-37f7-4c07-9707-8d48ac5909eb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.519940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.520806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.523543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.523543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.523543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:13:58.523543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.525328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.539291 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2831/5638] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:13:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:13:58.543804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.555687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b36b9-baaa-484e-a5f7-36c65ca94a9f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.562066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.562442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.562738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.563086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.563851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.565994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.632826 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2808/5639] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:58 2021] POST /identity/v3/projects => generated 407 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:13:58.635615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.654199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56eb2b-b8c5-4a4e-ad32-58f29009d204 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.766761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.767362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.767642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.767923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.769155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.771563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.804392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.809305 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2832/5640] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:58 2021] POST /identity/v3/users => generated 304 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:58.822939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.825653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d946-1968-4b95-8d76-51b0dbe2955e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.825795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:58.832236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.833206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.834252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.834829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.835785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.837613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.845668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136284-e5fe-418d-98b7-f4a81ae9bd2b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.854803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.855391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.855848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.856773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] PATH_INFO: `/v3/projects/d62aa7e8f439479e9b10744d8935b20d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.858292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62aa7e8f439479e9b10744d8935b20d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.862039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.867424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2809/5641] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:13:58.871206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.884329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e158-a0ee-4527-8e79-c1cd245687a0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.898065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:58.899100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:58.899587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:58.900061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:58.901201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:58.906459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:58.929114 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2810/5642] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:13:58.930530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:58.949864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0301-9342-4d97-86d9-53db71455bb8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:58.957082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62aa7e8f439479e9b10744d8935b20d', 'request_id': 'req-49af4394-f87a-4cf2-add1-736fabb41d3c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.977384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62aa7e8f439479e9b10744d8935b20d', 'request_id': 'req-49af4394-f87a-4cf2-add1-736fabb41d3c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:58.993709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62aa7e8f439479e9b10744d8935b20d', 'request_id': 'req-49af4394-f87a-4cf2-add1-736fabb41d3c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.014449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] The token cache is being invalidate because project d62aa7e8f439479e9b10744d8935b20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:59.014821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.015423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.022267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2833/5643] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:58 2021] DELETE /identity/v3/projects/d62aa7e8f439479e9b10744d8935b20d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:59.023763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:59.027896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:59.029604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.030595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.030923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.031184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] PATH_INFO: `/v3/projects/e50d2df481434682af55e346b3145b37/users/83921a65d5c8477387c08bf704dd62d9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.051295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50d2df481434682af55e346b3145b37, user_id=83921a65d5c8477387c08bf704dd62d9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.054563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2112-cbcc-4b06-835b-3dc9bfbfcf63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.056793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4394-f87a-4cf2-add1-736fabb41d3c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:59.066688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.067712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.068166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.068572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] PATH_INFO: `/v3/users/aef8d0aa3f024ce0882548ae9024a402` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.070730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef8d0aa3f024ce0882548ae9024a402)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.072975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.088482 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2811/5644] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:13:58 2021] PUT /identity/v3/projects/e50d2df481434682af55e346b3145b37/users/83921a65d5c8477387c08bf704dd62d9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:59.090611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.090909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.091191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.155529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] MFA Rules not processed for user `83921a65d5c8477387c08bf704dd62d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:13:59.161047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:59.197609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef8d0aa3f024ce0882548ae9024a402'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.208826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef8d0aa3f024ce0882548ae9024a402'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.212061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef8d0aa3f024ce0882548ae9024a402'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.232175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef8d0aa3f024ce0882548ae9024a402'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.256854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef8d0aa3f024ce0882548ae9024a402'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.273582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2834/5645] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:13:59 2021] DELETE /identity/v3/users/aef8d0aa3f024ce0882548ae9024a402 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:13:59.315248 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2812/5646] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:59 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:13:59.321873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:59.323450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:59.492152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14661376-ad03-4a2e-acb4-5d2725533f91 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:59.497602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.498580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.499960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.500460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.501426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.503710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.543567 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2835/5647] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:13:59 2021] POST /identity/v3/projects => generated 405 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:59.544779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:59.596048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:59.598930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:13:59.704019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2763c-53bd-4c09-90d3-6986e848b8df None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:59.757661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84def6-5129-43ea-b7f8-fa8f9ce51754 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:59.769370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.771451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.771726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.783302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] PATH_INFO: `/v3/projects/473d16e063d64ce6abaef8e4f46407c2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.793500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473d16e063d64ce6abaef8e4f46407c2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.795803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.813612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.814284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.814560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.815055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.815943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.819323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.850688 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2813/5648] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:13:59 2021] POST /identity/v3/users => generated 309 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:13:59.856219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:13:59.872007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ca17f-f595-4881-8383-73a7f35c8561 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:13:59.887769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473d16e063d64ce6abaef8e4f46407c2', 'request_id': 'req-1306c726-4915-44ce-af49-19b7652c0830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.921049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473d16e063d64ce6abaef8e4f46407c2', 'request_id': 'req-1306c726-4915-44ce-af49-19b7652c0830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.935694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473d16e063d64ce6abaef8e4f46407c2', 'request_id': 'req-1306c726-4915-44ce-af49-19b7652c0830'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.957685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] The token cache is being invalidate because project 473d16e063d64ce6abaef8e4f46407c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:13:59.958114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.960023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1306c726-4915-44ce-af49-19b7652c0830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:13:59.967480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2836/5649] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:13:59 2021] DELETE /identity/v3/projects/473d16e063d64ce6abaef8e4f46407c2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:13:59.969792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2efc4-90fc-4d79-8e66-6dd015fc3c9a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.969988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2efc4-90fc-4d79-8e66-6dd015fc3c9a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.970086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2efc4-90fc-4d79-8e66-6dd015fc3c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.973877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:13:59.975998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:13:59.976223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:13:59.976466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:13:59.977331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:13:59.978813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:13:59.995689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fbe2efc4-90fc-4d79-8e66-6dd015fc3c9a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:00.000441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fbe2efc4-90fc-4d79-8e66-6dd015fc3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:00.009257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2814/5650] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:00.014975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.016821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:00.017362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2837/5651] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:13:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:00.028252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.029284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.029791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.044507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bf48-9ccb-4a5c-8423-0c44e29b16d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.052335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:00.053989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:00.057454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.059294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.060015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.060178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] PATH_INFO: `/v3/projects/fb271059976f4285983d04eb40eb7573/users/0eaeb6ea87fe48cc8a22026c9c3d894f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.068534 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2838/5652] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:00.073071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.085383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f844e3-7826-4edc-acf8-4f731a6cc2b0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.091507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.092494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.093805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.094597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.095715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:00.096291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.099340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.129278 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2839/5653] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:00.131481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.132405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb271059976f4285983d04eb40eb7573, user_id=0eaeb6ea87fe48cc8a22026c9c3d894f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.135397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.146154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a8374-18e9-49df-9cb1-c5ff52e86ccc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.160996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2815/5654] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:00 2021] PUT /identity/v3/projects/fb271059976f4285983d04eb40eb7573/users/0eaeb6ea87fe48cc8a22026c9c3d894f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:00.167744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.172169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.172872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.173159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.173434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.174657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.180262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.244065 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2840/5655] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:00 2021] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:00.247713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.314528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945337-c5b5-4d04-9c8b-5f326adf874d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.396179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e38e-b174-464a-9bf2-06ae58a5663f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.408643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.409260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.409674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.409958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.410670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.414561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.444044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.445099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.445419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.445802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.448509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.455535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.463454 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2841/5656] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:00 2021] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:14:00.465574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.486007 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2816/5657] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:00.486306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d862c2-32bc-4c55-8cfe-15b68a68d705 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.488008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.504531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.505001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.505434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.505716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.508891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64821f4-33ed-43dd-8cdf-d1bac6827933 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.509831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.512016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.523310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.524720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.525002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.525276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] PATH_INFO: `/v3/projects/fb271059976f4285983d04eb40eb7573/users/0eaeb6ea87fe48cc8a22026c9c3d894f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.531904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb271059976f4285983d04eb40eb7573, user_id=0eaeb6ea87fe48cc8a22026c9c3d894f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.537452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91224a7-f361-431f-a8f2-0127b2feed1d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.541425 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2842/5658] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:00.546654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.622038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2817/5659] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:00 2021] PUT /identity/v3/projects/fb271059976f4285983d04eb40eb7573/users/0eaeb6ea87fe48cc8a22026c9c3d894f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:00.630955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed2aea-07f4-43f9-9a6e-a1b173e55376 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.633010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.633301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.634871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.740816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] MFA Rules not processed for user `0eaeb6ea87fe48cc8a22026c9c3d894f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:00.742982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:00.834659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.837628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.837628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.837628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.837628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.839120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.863115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2843/5660] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:00.866500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.883290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f9c0-6cff-4a43-bf79-a46fd30c3279 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:00.901682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:00.902646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:00.902945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:00.903196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] PATH_INFO: `/v3/projects/342e290b041140ea8af4dba4e03e569f/users/46fe83bca8fb48278256ed2ec606b784/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:00.919781 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2818/5661] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:00 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:00.942419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342e290b041140ea8af4dba4e03e569f, user_id=46fe83bca8fb48278256ed2ec606b784, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:00.966385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47a2c-08c5-4f13-a2a1-4f3e697b9074 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:00.979918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:00.981741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:00.995295 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2844/5662] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:00 2021] PUT /identity/v3/projects/342e290b041140ea8af4dba4e03e569f/users/46fe83bca8fb48278256ed2ec606b784/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:01.006682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.009702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.010105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.085463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] MFA Rules not processed for user `46fe83bca8fb48278256ed2ec606b784`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:01.090500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:01.113270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e84c3-77e8-4a7e-bd20-4fdfff25a86e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.226926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.227991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.228480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.228976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.231107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:01.263379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2845/5663] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:01 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:01.268821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.335582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.338006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.361165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6da58f-3dee-45e9-a8ca-cbbffa0c054d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.364860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2819/5664] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:00 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:01.368505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.369212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.369664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.369923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.370710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.372866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.410947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.416677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2846/5665] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:01 2021] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:01.424217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977eb2-61d9-4728-a049-b5325296f60b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.566411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.568375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.568646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.569006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.569730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.572599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.638620 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2820/5666] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:01 2021] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:14:01.643060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.663293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd96e5-356b-4853-8a59-513cf54c4776 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.673662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.674341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.674619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.674885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.676098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.678342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.701288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.711511 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2847/5667] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:01.715766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eee41-a911-4705-86b0-95a94216499e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.733193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.735052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.735335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.735827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] PATH_INFO: `/v3/projects/d7a81957d3cc4708909ba7b629601d35/users/4f0487a5cdf048beab05e4822f69e8f5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.766850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a81957d3cc4708909ba7b629601d35, user_id=4f0487a5cdf048beab05e4822f69e8f5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.769754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.800011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.804766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2821/5668] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:01 2021] PUT /identity/v3/projects/d7a81957d3cc4708909ba7b629601d35/users/4f0487a5cdf048beab05e4822f69e8f5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:01.832362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.836634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91607a5-d38e-41b3-9534-aa4f773f98d4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:01.838283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:01.947841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:01.948636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:01.949012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:01.949361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:01.950312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:01.952239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:01.965364 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2848/5669] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:01.975858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:01.990980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e86af5-2a83-4355-81f3-1e821ff9a154 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:02.004842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:02.005771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:02.006051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:02.006329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] PATH_INFO: `/v3/projects/d7a81957d3cc4708909ba7b629601d35/users/4f0487a5cdf048beab05e4822f69e8f5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:02.009384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a81957d3cc4708909ba7b629601d35, user_id=4f0487a5cdf048beab05e4822f69e8f5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:02.012401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c2b0d-98a6-4f91-8780-2625e5f54375 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:02.023800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911ef4-faaf-4518-90c0-aa306b380ba4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:02.025353 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2849/5670] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:01 2021] PUT /identity/v3/projects/d7a81957d3cc4708909ba7b629601d35/users/4f0487a5cdf048beab05e4822f69e8f5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:02.037155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:02.037517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:02.037716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:02.069124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] MFA Rules not processed for user `4f0487a5cdf048beab05e4822f69e8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:02.071205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:02.151375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:02.152231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:02.154587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:02.154587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:02.168369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2850/5671] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:02 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:02.195669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:02.197136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:02.252732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:02.254314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:02.282527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf37d65-db71-49d5-b365-f3a7570a9d75 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:02.283229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2822/5672] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:01 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:02.290343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:02.291816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:02.292104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:02.292381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:02.305040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:02.306490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:02.324677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2851/5673] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:02 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:04.251547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:04.253071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:04.437112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c25f0-2234-4b88-af63-14a14f671d47 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:04.449529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:04.450891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:04.451355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:04.452075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] PATH_INFO: `/v3/users/c1b28fb14ec347ce8369595664ed6d88` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:04.457446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b28fb14ec347ce8369595664ed6d88)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:04.459627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:04.571186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b28fb14ec347ce8369595664ed6d88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:04.582747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b28fb14ec347ce8369595664ed6d88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:04.584155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b28fb14ec347ce8369595664ed6d88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:04.585042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b28fb14ec347ce8369595664ed6d88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:04.599170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-064602b8-cea6-4191-9065-80a76377182d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b28fb14ec347ce8369595664ed6d88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:04.634000 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2823/5674] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:04 2021] DELETE /identity/v3/users/c1b28fb14ec347ce8369595664ed6d88 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:05.027607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.053081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77ff5-0386-4ad4-99e0-74a056806603 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.182841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.183954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.184410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.185040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] PATH_INFO: `/v3/projects/86321f398a2f4013915e01d7352f33b5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.186600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86321f398a2f4013915e01d7352f33b5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.189556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.267212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86321f398a2f4013915e01d7352f33b5', 'request_id': 'req-5b3619aa-15af-43cb-bd36-cb31f3e41a51'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:05.276472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86321f398a2f4013915e01d7352f33b5', 'request_id': 'req-5b3619aa-15af-43cb-bd36-cb31f3e41a51'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:05.293406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86321f398a2f4013915e01d7352f33b5', 'request_id': 'req-5b3619aa-15af-43cb-bd36-cb31f3e41a51'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:05.334795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] The token cache is being invalidate because project 86321f398a2f4013915e01d7352f33b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:05.335316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:05.336252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5b3619aa-15af-43cb-bd36-cb31f3e41a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:05.343480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2852/5675] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:05 2021] DELETE /identity/v3/projects/86321f398a2f4013915e01d7352f33b5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:05.345759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.346576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.347018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.389779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:05.391586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:05.493963 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2824/5676] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:05.494403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.494711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.495155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.523590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:05.525341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:05.535495 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2853/5677] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:05.542037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.567138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287486c-aeb6-4011-a066-6a6df2ad46c5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.576093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.578133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.578662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.579356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.580799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:05.581542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.583711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.623991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.625369 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2825/5678] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:05.635349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57891b-d4bb-4d52-87fe-cc6ba18b4e8e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.641160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.642067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.642343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.642611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.643336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.645440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.681794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2854/5679] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:05 2021] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:05.687463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.703730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1eac2-22eb-40cc-bc23-78ba0dccbc70 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.816783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.818681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.819556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.820462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.821712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.827195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.860096 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2826/5680] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:05 2021] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:05.861581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.877217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef831b-e62e-4b80-a25f-7dc77af0afcd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.882676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.883511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.884517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.884517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.885390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.887534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.900723 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2855/5681] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:14:05.906180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.919755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9ba0b-455f-4020-a38d-7156abd3b4ba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.926469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.927341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.927341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.927625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.928386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.930155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5693-10eb-48ec-8250-ed87d3975163 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:05.943371 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2827/5682] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:05.947268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:05.957649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b329a-70bc-40e0-b9a8-66c1ddb37bd3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:05.962759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:05.963644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:05.963924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:05.964196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] PATH_INFO: `/v3/projects/47f9e14c6ad9417985c8ed5d4a42b760/users/2661f2ce4f0244828bc22394695dde24/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:05.979574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f9e14c6ad9417985c8ed5d4a42b760, user_id=2661f2ce4f0244828bc22394695dde24, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:05.982253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:06.000587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2856/5683] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:05 2021] PUT /identity/v3/projects/47f9e14c6ad9417985c8ed5d4a42b760/users/2661f2ce4f0244828bc22394695dde24/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:06.006396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:06.006907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:06.007192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:06.039436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:06.041806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:06.134504 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2828/5684] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:06.148762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:06.153780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:06.167704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:06.172430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:06.207750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d9fc-a965-4835-a36e-19b0edb0878f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:06.228108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:06.229711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:06.230345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:06.230345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] PATH_INFO: `/v3/users/f4e9b78a84314e65a75fca609e13137c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:06.231775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e9b78a84314e65a75fca609e13137c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:06.240192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:06.293460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbedc5-3a70-4c6b-9b24-7dd7407a6994 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:06.304958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:06.307989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:06.308276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:06.308554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:06.325976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e9b78a84314e65a75fca609e13137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:06.330201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:06.340239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adc4f8-fa59-455e-9417-ecff688ed16a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:06.347762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e9b78a84314e65a75fca609e13137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:06.348736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e9b78a84314e65a75fca609e13137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:06.349520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e9b78a84314e65a75fca609e13137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:06.362144 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2857/5685] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:06.366421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e9b78a84314e65a75fca609e13137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:06.392535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:06.392849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:06.393124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:06.419108 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2829/5686] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:06 2021] DELETE /identity/v3/users/f4e9b78a84314e65a75fca609e13137c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:06.420745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:06.422836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:06.485207 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2858/5687] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:14:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:06.503898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:06.506084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:06.605761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644865e-06a7-4091-891e-774f3f3a9aed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:06.612994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:06.614114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:06.614114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:06.616160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:06.625274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:06.627357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196de2c2-8fd9-4957-b04a-ef996960ff88 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:06.636004 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2830/5688] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:14:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:14:07.061448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.064405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.158146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4b233-c874-4eaa-a78d-e13e4c98a557 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.162754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.163849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.164380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.164750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] PATH_INFO: `/v3/projects/c1641302347f4b8788361ba3c39de208` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.166071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1641302347f4b8788361ba3c39de208)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.168162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.226366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1641302347f4b8788361ba3c39de208', 'request_id': 'req-6ce2e7cf-d408-4045-82ca-14627759f262'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:07.243953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1641302347f4b8788361ba3c39de208', 'request_id': 'req-6ce2e7cf-d408-4045-82ca-14627759f262'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:07.257978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1641302347f4b8788361ba3c39de208', 'request_id': 'req-6ce2e7cf-d408-4045-82ca-14627759f262'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:07.278776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] The token cache is being invalidate because project c1641302347f4b8788361ba3c39de208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:07.279076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:07.280031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ce2e7cf-d408-4045-82ca-14627759f262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:07.283642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2859/5689] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:07 2021] DELETE /identity/v3/projects/c1641302347f4b8788361ba3c39de208 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:07.289709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.290109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.290477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.309922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:07.312401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.392364 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2831/5690] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:07.400255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.400541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.400849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.425764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:07.427369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.443420 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2860/5691] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:07.447683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.458103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27048b-c194-4920-9479-b9b2a81b2161 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.463116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.463853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.464359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.464742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.465781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:07.466303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.468174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.483269 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2832/5692] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:07.488267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.498201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3beece-1232-4d43-94cd-d83b3e3a2ccc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.503971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.504759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.505247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.505730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.506565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.508505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d275d2-188a-4289-a338-96e9d987717a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.537809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2861/5693] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:14:07.541977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.560481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632c24-cc90-4916-8eed-d5fef5dce22f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.624561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3974c9-35ad-4608-99f1-41aa91fe7efc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.624783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3974c9-35ad-4608-99f1-41aa91fe7efc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.624993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3974c9-35ad-4608-99f1-41aa91fe7efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.668232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.668950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.669227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.669497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.669778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe3974c9-35ad-4608-99f1-41aa91fe7efc None None] MFA Rules not processed for user `2661f2ce4f0244828bc22394695dde24`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:07.670202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.672146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe3974c9-35ad-4608-99f1-41aa91fe7efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.672943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.699972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2833/5694] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:07.704254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.722608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddda0-52bc-410f-ab03-7236acc78345 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.729214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.730506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.730763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.731031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.732654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.735977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.759072 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2834/5695] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:07.764656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.773807 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2862/5696] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:07.779065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48369ece-53f5-422d-b9bc-5daf195b9326 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.784527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.784996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.786028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.786546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.787647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.788163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.788689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.789658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.791453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.812809 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2835/5697] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:07.816801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.839230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eae94-61a0-4715-aac0-8adfd4dc56ed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:07.845167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:07.846052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.846328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.846640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] PATH_INFO: `/v3/projects/fd815b8b2d9c426a81237a9121798c37/users/b5527134411047aa9da658da2c5a6bda/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.850131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] MFA Rules not processed for user `2661f2ce4f0244828bc22394695dde24`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:07.854057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.872828 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2863/5698] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:07.881844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd815b8b2d9c426a81237a9121798c37, user_id=b5527134411047aa9da658da2c5a6bda, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:07.885702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082406-bef9-4ecf-9a29-7a2f539e1034 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:07.891286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:07.893174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:07.921235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2836/5699] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:07 2021] PUT /identity/v3/projects/fd815b8b2d9c426a81237a9121798c37/users/b5527134411047aa9da658da2c5a6bda/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:07.924536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:07.925533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:07.926952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:07.958849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:07.960466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:08.026230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7d14a-b7a6-4b1e-b376-2c5b9f6ca22b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:08.048982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2837/5700] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:08.055796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:08.057190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:08.107034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:08.107928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:08.108275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:08.108685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:08.128137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b03326-ffd6-4132-8b92-08ea9ffddb22 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:08.132182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:08.132870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:08.133152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:08.133426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:08.145518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:08.147139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57b67a-e179-4744-9d13-921bd3d84872 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:08.159690 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2838/5701] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:14:08.168043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:08.170326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:08.182591 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2864/5702] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:07 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:08.681359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b554-9286-4bb8-8fe4-ac904c9ba09d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:08.681866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b554-9286-4bb8-8fe4-ac904c9ba09d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:08.682549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b554-9286-4bb8-8fe4-ac904c9ba09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:08.712665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8375b554-9286-4bb8-8fe4-ac904c9ba09d None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:08.715063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8375b554-9286-4bb8-8fe4-ac904c9ba09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:08.783517 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2839/5703] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:14:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:08.800739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:08.802665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:08.909494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd96da-4c48-4e3c-b51e-1aebb897212e service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:08.917506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:08.918257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:08.918605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:08.918946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:08.928641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:08.930318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:08.940094 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2865/5704] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:14:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:14:09.642679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786d50-33c2-4fda-a945-32c3640725f7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:09.643255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786d50-33c2-4fda-a945-32c3640725f7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:09.643722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786d50-33c2-4fda-a945-32c3640725f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:09.683769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-06786d50-33c2-4fda-a945-32c3640725f7 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:09.687353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06786d50-33c2-4fda-a945-32c3640725f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:09.714951 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2840/5705] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:14:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:09.730931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:09.748276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685db93-b2c7-462e-9f27-24f0d51c87ce service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:09.764431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:09.765674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:09.765953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:09.766226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:09.784514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:09.789203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf8d4-ca48-4726-8d87-565ceba0f277 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:09.815226 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2866/5706] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:14:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:14:09.891739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:09.892018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:09.892309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:09.965324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:09.970170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:10.110017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2841/5707] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:09 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:10.121049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:10.121667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:10.122138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:10.153427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:10.155203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:10.183953 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2867/5708] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:10 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:10.199362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:10.200917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:10.243212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d29b6-c06a-4184-ac3d-cff752488404 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:10.270825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:10.271568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:10.273881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:10.274438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:10.307664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:10.309545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:10.344552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2842/5709] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:10 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:12.194834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:12.196394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:12.272419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea214-dffc-43a4-a82e-24c6f0956646 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:12.277620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f0487a5cdf048beab05e4822f69e8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a81957d3cc4708909ba7b629601d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:12.278592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:12.279175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:12.279626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:12.281187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:12.281684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:12.283598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:12.302781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2868/5710] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:12.307836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:12.329091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1a87-4f42-488c-a9eb-5fce334414f0 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:12.336570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f0487a5cdf048beab05e4822f69e8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a81957d3cc4708909ba7b629601d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:12.337513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:12.337978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:12.338435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:12.339338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:12.341505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a963124-cb93-49a5-bfa8-d56816d03e6d tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:12.386865 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2843/5711] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:12 2021] POST /identity/v3/projects => generated 348 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:12.392208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:12.407511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf5b-cbfa-45a3-a54c-4f705cb05f42 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:12.545815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f0487a5cdf048beab05e4822f69e8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a81957d3cc4708909ba7b629601d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:12.548545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:12.549052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:12.549620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:12.550667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:12.553296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:12.555164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:12.575751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2869/5712] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:12.790551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:12.791217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:12.791656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:12.841770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:12.843730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:12.976871 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2844/5713] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:12.995029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:13.068072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e01c-a22f-44be-99c7-b7eec1d56ef3 tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:13.074082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:13.074735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:13.075010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:13.075282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:13.084929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:13.086528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:13.096501 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2870/5714] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:14:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:14:13.972354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:14.000770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec1d76-4f54-400a-b3a0-ccaa97934661 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:14.022057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f0487a5cdf048beab05e4822f69e8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a81957d3cc4708909ba7b629601d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:14.025854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:14.026138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:14.026419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] PATH_INFO: `/v3/projects/119c0fe8ff184e52ad576484b0733872` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:14.030789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorizing `identity:delete_project(project_id=119c0fe8ff184e52ad576484b0733872)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:14.035827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:14.166834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119c0fe8ff184e52ad576484b0733872', 'request_id': 'req-8c77bc60-c999-4caa-863a-6383014ff32c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:14.189171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119c0fe8ff184e52ad576484b0733872', 'request_id': 'req-8c77bc60-c999-4caa-863a-6383014ff32c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:14.203656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119c0fe8ff184e52ad576484b0733872', 'request_id': 'req-8c77bc60-c999-4caa-863a-6383014ff32c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:14.233651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] The token cache is being invalidate because project 119c0fe8ff184e52ad576484b0733872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:14.234281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:14.235647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8c77bc60-c999-4caa-863a-6383014ff32c tempest-RoutersIpV6AdminTest-92489935 tempest-RoutersIpV6AdminTest-92489935-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:14.239471 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2845/5715] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:13 2021] DELETE /identity/v3/projects/119c0fe8ff184e52ad576484b0733872 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:14.262436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:14.342895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541260fc-9b5a-4007-bea4-34dbbafc7a6f service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:14.413032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:14.413977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:14.414545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:14.415006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:14.417142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:14.545751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:14.548371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:14.563867 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2871/5716] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:14 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:16.135707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b98f-4c1d-42f8-9aab-6f9b1bca455c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:16.136553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b98f-4c1d-42f8-9aab-6f9b1bca455c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:16.137019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b98f-4c1d-42f8-9aab-6f9b1bca455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:16.173270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9734b98f-4c1d-42f8-9aab-6f9b1bca455c None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:16.174576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9734b98f-4c1d-42f8-9aab-6f9b1bca455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:16.294533 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2846/5717] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:17.940575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:17.942654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:18.078134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de439-ca80-44b8-a0c4-37eff945c8c3 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:18.097651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:18.098509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:18.098738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:18.099168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] PATH_INFO: `/v3/users/83921a65d5c8477387c08bf704dd62d9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:18.100550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=83921a65d5c8477387c08bf704dd62d9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:18.102468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:18.190698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83921a65d5c8477387c08bf704dd62d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:18.210391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83921a65d5c8477387c08bf704dd62d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:18.211372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83921a65d5c8477387c08bf704dd62d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:18.225929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83921a65d5c8477387c08bf704dd62d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:18.238101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83921a65d5c8477387c08bf704dd62d9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:18.257264 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2872/5718] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:17 2021] DELETE /identity/v3/users/83921a65d5c8477387c08bf704dd62d9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:18.262482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:18.263065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:18.263065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:18.290391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:18.292706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:18.454935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2847/5719] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:18.481015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:18.482897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:18.611815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d58b0-3aad-4f8e-aa83-ddfaff40f6bd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:18.631041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:18.633044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:18.634841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:18.635168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:18.653304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:18.655051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:18.678688 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2873/5720] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:19.445075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:19.446540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:19.475788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c4df-c517-44ee-adc2-bd3575e00e27 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:19.490709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:19.491585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:19.491970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:19.492101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] PATH_INFO: `/v3/projects/e50d2df481434682af55e346b3145b37` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:19.493419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50d2df481434682af55e346b3145b37)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:19.495330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:19.579444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50d2df481434682af55e346b3145b37', 'request_id': 'req-1d1e91c6-7ad5-452a-84b8-715bc91737e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.586272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50d2df481434682af55e346b3145b37', 'request_id': 'req-1d1e91c6-7ad5-452a-84b8-715bc91737e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.593431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50d2df481434682af55e346b3145b37', 'request_id': 'req-1d1e91c6-7ad5-452a-84b8-715bc91737e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.616014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] The token cache is being invalidate because project e50d2df481434682af55e346b3145b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:19.616574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.619618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.622205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2848/5721] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:19 2021] DELETE /identity/v3/projects/e50d2df481434682af55e346b3145b37 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:14:19.626462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:19.640738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1cbe-09dd-4603-9c91-e91c2d4b8a32 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:19.814783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:19.815978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:19.816443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:19.816899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] PATH_INFO: `/v3/users/0eaeb6ea87fe48cc8a22026c9c3d894f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:19.818312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaeb6ea87fe48cc8a22026c9c3d894f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:19.824943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:19.973348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaeb6ea87fe48cc8a22026c9c3d894f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.986906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaeb6ea87fe48cc8a22026c9c3d894f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:19.989723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaeb6ea87fe48cc8a22026c9c3d894f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:20.018966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaeb6ea87fe48cc8a22026c9c3d894f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:20.041277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3c97bf3a-9207-42b3-9a4d-29f73309b890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaeb6ea87fe48cc8a22026c9c3d894f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:20.051758 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2874/5722] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:19 2021] DELETE /identity/v3/users/0eaeb6ea87fe48cc8a22026c9c3d894f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:20.867688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:20.869601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:20.893879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e91c6-7ad5-452a-84b8-715bc91737e7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.067164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:21.068581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.069138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.069411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] PATH_INFO: `/v3/projects/fb271059976f4285983d04eb40eb7573` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.070634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb271059976f4285983d04eb40eb7573)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:21.072516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:21.147481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb271059976f4285983d04eb40eb7573', 'request_id': 'req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:21.159411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb271059976f4285983d04eb40eb7573', 'request_id': 'req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:21.166741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb271059976f4285983d04eb40eb7573', 'request_id': 'req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:21.185822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] The token cache is being invalidate because project fb271059976f4285983d04eb40eb7573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:21.187541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:21.188541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be077713-cfdf-4e6a-9ffb-5f4af0d809d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:21.192969 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2849/5723] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:20 2021] DELETE /identity/v3/projects/fb271059976f4285983d04eb40eb7573 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:21.200250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.200836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.200836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.234850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:21.236399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:21.355256 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2875/5724] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:21.364463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.365195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.365725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.396287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:21.398229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:21.411250 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2850/5725] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:21.415297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:21.453261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287bcc-ab9a-43fe-9fd0-e114e451ba1e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.470960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:21.471802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.472087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.472360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.473121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:21.475632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:21.477624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:21.512108 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2876/5726] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:21.513678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:21.535467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf6054-b79a-4666-82ce-23e29104b3b5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.546999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:21.548063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.551875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.553534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.555004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:21.562029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:21.627556 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2851/5727] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:21 2021] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:21.629989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:21.650028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f9905-fa18-428d-a746-56a437b264b1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.766226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:21.766962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.767624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.767964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.768865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:21.771629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:21.847120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2877/5728] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:21 2021] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:21.847884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:21.863227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a545-d443-4c6c-aef0-24c7b41cbc82 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.876068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:21.879312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:21.879858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:21.880433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:21.881450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:21.885327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:21.915072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:21.915952 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2852/5729] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:21 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:14:21.966844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c544def-933a-46db-b232-43d086d955f7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:21.997726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:22.001360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:22.007959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:22.008936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:22.009886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:22.013576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ed63c-19a7-4776-b849-535daa1ecce5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:22.055037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:22.061939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2878/5730] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:21 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:22.081858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4902a-536f-49b3-b46e-f71d9e47712a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:22.108820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:22.112480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:22.112799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:22.113086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] PATH_INFO: `/v3/projects/32939d26f7eb4a9c8a2280407b557d39/users/b618f6c67878426dad79658b3a1052a9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:22.178875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32939d26f7eb4a9c8a2280407b557d39, user_id=b618f6c67878426dad79658b3a1052a9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:22.184853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:22.225324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2f11-8e40-40e1-97ef-fa87bfc2b2c5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:22.226749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2853/5731] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:22 2021] PUT /identity/v3/projects/32939d26f7eb4a9c8a2280407b557d39/users/b618f6c67878426dad79658b3a1052a9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:22.228730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2f11-8e40-40e1-97ef-fa87bfc2b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:22.229325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2f11-8e40-40e1-97ef-fa87bfc2b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:22.298530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4eeb2f11-8e40-40e1-97ef-fa87bfc2b2c5 None None] MFA Rules not processed for user `b618f6c67878426dad79658b3a1052a9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:22.300118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4eeb2f11-8e40-40e1-97ef-fa87bfc2b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:22.472450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2879/5732] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:22 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:22.497531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:22.501470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:22.646224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba72bd-c510-4b8e-b7c0-fe26a885dd93 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:22.651507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:22.652177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:22.652461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:22.652764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:22.664825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:22.666823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa149c-a49a-4e34-b5c8-c703804c3518 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:22.683322 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2854/5733] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:22 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:27.581863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aca65-114b-4c18-a48f-7c4a6e7d1492 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:27.582729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aca65-114b-4c18-a48f-7c4a6e7d1492 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:27.583189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aca65-114b-4c18-a48f-7c4a6e7d1492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:27.648784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7a0aca65-114b-4c18-a48f-7c4a6e7d1492 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:27.650362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a0aca65-114b-4c18-a48f-7c4a6e7d1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:27.923459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2880/5734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:27 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:28.282898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9800-11cd-474a-a0fe-0a47ccd860c3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:28.284079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9800-11cd-474a-a0fe-0a47ccd860c3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:28.285034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9800-11cd-474a-a0fe-0a47ccd860c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:28.321265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4e1b9800-11cd-474a-a0fe-0a47ccd860c3 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:28.325047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e1b9800-11cd-474a-a0fe-0a47ccd860c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:28.352145 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2855/5735] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:28 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:28.563975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407095-cf11-4ee2-848f-124d907b3080 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:28.564301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407095-cf11-4ee2-848f-124d907b3080 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:28.564544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407095-cf11-4ee2-848f-124d907b3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:28.612182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d407095-cf11-4ee2-848f-124d907b3080 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:28.626110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d407095-cf11-4ee2-848f-124d907b3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:28.650721 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2881/5736] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:28 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:29.005398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:29.005810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:29.006187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:29.058713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:29.071124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:29.112452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2856/5737] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:29 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:29.647945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0049d0-ed88-4d90-8eb4-ca52409d07ee None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:29.648975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0049d0-ed88-4d90-8eb4-ca52409d07ee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:29.649477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0049d0-ed88-4d90-8eb4-ca52409d07ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:29.699102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ed0049d0-ed88-4d90-8eb4-ca52409d07ee None None] MFA Rules not processed for user `b5527134411047aa9da658da2c5a6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:29.702980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ed0049d0-ed88-4d90-8eb4-ca52409d07ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:29.735300 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2882/5738] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:29 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:34.110578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:34.227028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c1ce-a791-4d21-8988-b2efba647cf9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:34.232328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:34.234016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:34.234279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:34.234557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] PATH_INFO: `/v3/users/b618f6c67878426dad79658b3a1052a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:34.236428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b618f6c67878426dad79658b3a1052a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:34.242049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:34.367843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b618f6c67878426dad79658b3a1052a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.383685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b618f6c67878426dad79658b3a1052a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.384493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b618f6c67878426dad79658b3a1052a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.385156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b618f6c67878426dad79658b3a1052a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.403671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b618f6c67878426dad79658b3a1052a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.446954 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2857/5739] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:34 2021] DELETE /identity/v3/users/b618f6c67878426dad79658b3a1052a9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:34.452000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:34.452655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:34.452655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:34.484362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:34.486019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:34.632915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2883/5740] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:34.647916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:34.649691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:34.780881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:34.784658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:34.791159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3ee1-d4dc-46b1-b4d9-c2ad2bcb8017 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:34.801227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:34.809498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:34.810052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:34.811120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:34.824286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:34.828868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748646e4-6610-4ea6-a48e-50363273bd3c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:34.834986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:34.847343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:34.849945 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2858/5741] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:34.850099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:34.850334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:34.850592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] PATH_INFO: `/v3/users/2661f2ce4f0244828bc22394695dde24` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:34.853664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2661f2ce4f0244828bc22394695dde24)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:34.856063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:34.968092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2661f2ce4f0244828bc22394695dde24'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.978823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2661f2ce4f0244828bc22394695dde24'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:34.980435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2661f2ce4f0244828bc22394695dde24'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.010919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2661f2ce4f0244828bc22394695dde24'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.021473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b8e4918a-0ddb-441a-9aff-bfcd88d08c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2661f2ce4f0244828bc22394695dde24'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.028931 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2884/5742] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:34 2021] DELETE /identity/v3/users/2661f2ce4f0244828bc22394695dde24 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:35.315073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:35.329613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4328-6948-470c-871d-1285a461454b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:35.395218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:35.396079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.396357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.396659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] PATH_INFO: `/v3/projects/47f9e14c6ad9417985c8ed5d4a42b760` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.397839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f9e14c6ad9417985c8ed5d4a42b760)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:35.399777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:35.445855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f9e14c6ad9417985c8ed5d4a42b760', 'request_id': 'req-de34e434-fd12-46cf-ac5b-386f16fce8b9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.454685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f9e14c6ad9417985c8ed5d4a42b760', 'request_id': 'req-de34e434-fd12-46cf-ac5b-386f16fce8b9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.463248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f9e14c6ad9417985c8ed5d4a42b760', 'request_id': 'req-de34e434-fd12-46cf-ac5b-386f16fce8b9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.481737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] The token cache is being invalidate because project 47f9e14c6ad9417985c8ed5d4a42b760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:35.482126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.483577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.485511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2859/5743] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:35 2021] DELETE /identity/v3/projects/47f9e14c6ad9417985c8ed5d4a42b760 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:14:35.491270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6583c3b-7fbd-47f6-afa6-92cec72e6edd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.491816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6583c3b-7fbd-47f6-afa6-92cec72e6edd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.491816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6583c3b-7fbd-47f6-afa6-92cec72e6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.513810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d6583c3b-7fbd-47f6-afa6-92cec72e6edd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:35.515921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d6583c3b-7fbd-47f6-afa6-92cec72e6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:35.615884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:35.617600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:35.661834 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2885/5744] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:35.674519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.674944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.675697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.740268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:35.742022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:35.758509 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2886/5745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:35.761191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:35.774168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a6905-7ffd-4e22-926e-aa0d6682bf5d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:35.785505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:35.786299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.787237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.788690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.791124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:35.791544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:35.797067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:35.799427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e434-fd12-46cf-ac5b-386f16fce8b9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:35.814793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:35.816580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.816980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.817351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] PATH_INFO: `/v3/projects/32939d26f7eb4a9c8a2280407b557d39` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.820729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=32939d26f7eb4a9c8a2280407b557d39)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:35.822866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:35.823230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2887/5746] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:35.828089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:35.860795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41819-6a05-42fe-abc8-9536d5a5adde admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:35.872822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:35.873751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.875619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.876012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.876959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:35.887325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32939d26f7eb4a9c8a2280407b557d39', 'request_id': 'req-b6102e95-0c28-45a8-b769-b103b5df46ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.894296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:35.899631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32939d26f7eb4a9c8a2280407b557d39', 'request_id': 'req-b6102e95-0c28-45a8-b769-b103b5df46ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.917900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32939d26f7eb4a9c8a2280407b557d39', 'request_id': 'req-b6102e95-0c28-45a8-b769-b103b5df46ce'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.937997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2888/5747] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:35 2021] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:35.942500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] The token cache is being invalidate because project 32939d26f7eb4a9c8a2280407b557d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:35.943189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:35.943749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.944581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6102e95-0c28-45a8-b769-b103b5df46ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:35.947463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2860/5748] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:35 2021] DELETE /identity/v3/projects/32939d26f7eb4a9c8a2280407b557d39 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:14:35.952844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b478-ef45-46a6-9797-a862ca8059cf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:35.953338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b478-ef45-46a6-9797-a862ca8059cf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:35.953720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b478-ef45-46a6-9797-a862ca8059cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:35.983728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f6d4b478-ef45-46a6-9797-a862ca8059cf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:35.985344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f6d4b478-ef45-46a6-9797-a862ca8059cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.079876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451721e-3163-4c94-b710-71abb0855ff7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.099877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.100133 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2861/5749] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:36.101089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.101533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.101678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.101900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.102172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.102450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.103318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.106385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.123931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:36.125192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.141116 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2862/5750] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:36.147796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.162328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a963ee8-6e92-471c-8ea0-88b1d9ac3451 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.169085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2889/5751] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:35 2021] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:36.169571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.170129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.171315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.171679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.172027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.173008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:36.173452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.175819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.177637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.196575 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2863/5752] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:36.197839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.200917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.214890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7a46-b091-4229-ada7-862f74a9df6d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.224556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.225253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.225535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.225803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.226533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.228114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.245570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558196c-4ae3-43cf-af0e-0fae19de2318 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.261637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.262536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.262820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.263101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] PATH_INFO: `/v3/users/b5527134411047aa9da658da2c5a6bda` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.264443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5527134411047aa9da658da2c5a6bda)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.270596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.277358 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2890/5753] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:36.278380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.306365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355267-56c1-4b81-8a1e-b32b5d2f3e9e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.311875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.312537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.312865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.313139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.313837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.316683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.360171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2891/5754] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:36 2021] POST /identity/v3/projects => generated 361 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:36.364878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.367761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5527134411047aa9da658da2c5a6bda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:36.381949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5527134411047aa9da658da2c5a6bda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:36.382885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5527134411047aa9da658da2c5a6bda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:36.386539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5527134411047aa9da658da2c5a6bda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:36.408651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5527134411047aa9da658da2c5a6bda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:36.473367 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2864/5755] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:14:36 2021] DELETE /identity/v3/users/b5527134411047aa9da658da2c5a6bda => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:36.474435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.476430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.480389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6627c-c193-4e2e-99d4-6afd19bf4614 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.565078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.565793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.566037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.567198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.567945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.569581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.581214 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2892/5756] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:36.586891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.588668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02c2d-4c4e-4a67-8b12-14daf7439ee9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.589095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.594721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.595295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.595578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.595850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.597268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.599288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.608266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a58cc-a21f-4a98-86a6-412c5f41bb56 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.616062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.617133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.617473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.617989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] PATH_INFO: `/v3/projects/307b0b91d7b2449db46aa8f4a47830c9/users/435b8c8a17de402b8e2c7f64e802867c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.629563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2865/5757] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:36 2021] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:36.634011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.645566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=307b0b91d7b2449db46aa8f4a47830c9, user_id=435b8c8a17de402b8e2c7f64e802867c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.648665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.652814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4cee1-73fe-4c3d-b1ca-a821d937e23f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.665089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.666316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.666581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.666784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.668848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.675079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda58a9-605f-488f-a056-179902d871a1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.682889 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2893/5758] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:36 2021] PUT /identity/v3/projects/307b0b91d7b2449db46aa8f4a47830c9/users/435b8c8a17de402b8e2c7f64e802867c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:14:36.691553 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2866/5759] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:14:36.692856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.694428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6084-9141-4cec-95d2-e62240666769 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.694886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6084-9141-4cec-95d2-e62240666769 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.695167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6084-9141-4cec-95d2-e62240666769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.739161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2fef6084-9141-4cec-95d2-e62240666769 None None] MFA Rules not processed for user `435b8c8a17de402b8e2c7f64e802867c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:36.740548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fef6084-9141-4cec-95d2-e62240666769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.856480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fc279-bd2f-4fec-9fbb-79d708cc449d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.882980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.885877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.886560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.887222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.890935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.896154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:36.925193 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2867/5760] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:36.927362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.927798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.928897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.940972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2894/5761] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:36.946633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.952477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] MFA Rules not processed for user `435b8c8a17de402b8e2c7f64e802867c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:36.953739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.961557 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2868/5762] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:36.971423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dda3e-5cf2-4f96-8fde-c4ee05fa4de6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:36.974730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:36.976446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:36.976963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:36.978891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:36.978891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:36.978891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] PATH_INFO: `/v3/projects/4b506e3d8223426e8ce6df278556f03a/users/67c6fd5e302b4cc8994252aafda89b92/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:36.995323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b506e3d8223426e8ce6df278556f03a, user_id=67c6fd5e302b4cc8994252aafda89b92, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:36.998048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5cdee-6fa0-449c-b845-0362646ce4b9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.015375 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2895/5763] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:36 2021] PUT /identity/v3/projects/4b506e3d8223426e8ce6df278556f03a/users/67c6fd5e302b4cc8994252aafda89b92/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:37.026175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.026736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.027209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.067163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] MFA Rules not processed for user `67c6fd5e302b4cc8994252aafda89b92`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:37.069166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.120429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2a4a8-f1b7-4dcc-9c51-34e8165924ed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:37.236342 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2896/5764] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:37.236342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:37.246786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.254545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:37.255399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.255777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.256151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.345307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:37.346997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.370398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05432e81-ab81-4cd2-8d70-48023afee792 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:37.371053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2869/5765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:36 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:37.373429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:37.376937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:37.378260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.379005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.379458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.379910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] PATH_INFO: `/v3/projects/fd815b8b2d9c426a81237a9121798c37` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.381457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd815b8b2d9c426a81237a9121798c37)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:37.383931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.467581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd815b8b2d9c426a81237a9121798c37', 'request_id': 'req-7b420e61-998a-4029-be89-fef67f364f27'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:37.481363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd815b8b2d9c426a81237a9121798c37', 'request_id': 'req-7b420e61-998a-4029-be89-fef67f364f27'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:37.490117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd815b8b2d9c426a81237a9121798c37', 'request_id': 'req-7b420e61-998a-4029-be89-fef67f364f27'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:37.491554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564105-49bb-400f-b63b-576f3458269f service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:37.514943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] The token cache is being invalidate because project fd815b8b2d9c426a81237a9121798c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:14:37.515277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:37.517080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7b420e61-998a-4029-be89-fef67f364f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:14:37.521332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2897/5766] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:14:37 2021] DELETE /identity/v3/projects/fd815b8b2d9c426a81237a9121798c37 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:37.528254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ccd3-bb07-4ca9-a70f-dcbb7d5b70a2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.528548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ccd3-bb07-4ca9-a70f-dcbb7d5b70a2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.528904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ccd3-bb07-4ca9-a70f-dcbb7d5b70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.553036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:37.553684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.553956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.554464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.556641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.566311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1842ccd3-bb07-4ca9-a70f-dcbb7d5b70a2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:37.569415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1842ccd3-bb07-4ca9-a70f-dcbb7d5b70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.710584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2898/5767] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:37.719119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.719719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.720001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.743308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:37.745553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263349c-2336-4b8c-a0ad-9a35a4eb70aa service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.761553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:37.762655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.776416 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2899/5768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:37.781727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:37.782260 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2870/5769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:37 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:37.793361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bd5b-998e-4e63-9140-c942cdef5c87 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:37.804843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:37.805508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.806103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.806540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.807460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:14:37.807933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:37.809724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.812104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.814484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.814484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.833136 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2900/5770] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:14:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:14:37.842972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:37.850857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] MFA Rules not processed for user `435b8c8a17de402b8e2c7f64e802867c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:37.852283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:37.860964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8468-0ed5-4430-ba99-5b6d669c70d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:37.871980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:37.873010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:37.873420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:37.873814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:37.875081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:37.877470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:37.913331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2901/5771] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:37.918820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:37.959381 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2871/5772] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:14:38.008005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4332-c727-4798-bc0e-cf0c4de5393f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:38.014689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:38.015496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.015838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.016177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.017034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:38.019146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:38.059980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2902/5773] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:14:37 2021] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:14:38.062276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:38.078842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d3664-1b97-4fcb-8ed5-6bc32ebf6b34 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:38.086045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:38.087100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.087828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.088307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.089362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:38.091569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:38.121455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2872/5774] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:14:38.122347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:38.137879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f07f-b914-4688-b634-d1412a0c0f92 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:38.150718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:38.152505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.153331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.153759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.155505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:38.157818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838703aa-35ff-441b-93e9-750cd115da31 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:38.201039 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2903/5775] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:14:38.206677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:38.238106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e7de7-f93e-493b-9c00-9ea353ee947f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:38.255991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:38.256985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.257613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.257894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] PATH_INFO: `/v3/projects/26827b5258ad40dfae9a961a5dda3346/users/2b67e06516e746ceb504984154c8ef11/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.331727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26827b5258ad40dfae9a961a5dda3346, user_id=2b67e06516e746ceb504984154c8ef11, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:38.337506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:38.356040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2873/5776] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:14:38 2021] PUT /identity/v3/projects/26827b5258ad40dfae9a961a5dda3346/users/2b67e06516e746ceb504984154c8ef11/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:14:38.361733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.362020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.362299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.396305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:38.397882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:38.558156 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2904/5777] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:38.571314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:38.574571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:38.691472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776700-87f1-4bfd-a7de-f241322f1343 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:38.695802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:38.697632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:38.698069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:38.698369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:38.717931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:38.719733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:38.734309 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2874/5778] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:40.469953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:40.471579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:40.544451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee179-9e6b-4471-bc1f-2cb8f8eb7fa3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:40.549278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:40.549917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:40.550429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:40.550705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:40.553034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:40.641290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:40.642719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e7fa-5319-40e8-ba06-17eeb320a48e service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:40.657327 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2905/5779] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:40.818207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:40.819711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:40.842728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd918-da19-4161-9c5b-00a044c2b265 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:40.846631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:40.847377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:40.847854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:40.848221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:40.850317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:40.863390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:40.864975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:40.874621 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2875/5780] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:14:45.303005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccdc50-046a-4114-9e0e-a061592da728 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:45.303540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccdc50-046a-4114-9e0e-a061592da728 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:45.303540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccdc50-046a-4114-9e0e-a061592da728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:45.321556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-86ccdc50-046a-4114-9e0e-a061592da728 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:45.322760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-86ccdc50-046a-4114-9e0e-a061592da728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:45.387910 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2906/5781] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:14:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:45.446831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:45.448999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:45.613356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c099b-80a0-462e-9015-e34bcd9073ea service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:45.621003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:45.623779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:45.624499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:45.625039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:45.646469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:45.648071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aab80-5dca-4db6-bb94-39b743521a37 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:45.674122 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2876/5782] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:14:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:14:47.962645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b492cd-b8c7-4760-bdab-a7734302e631 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:47.963617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b492cd-b8c7-4760-bdab-a7734302e631 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:47.964153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b492cd-b8c7-4760-bdab-a7734302e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:48.003059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-88b492cd-b8c7-4760-bdab-a7734302e631 None None] MFA Rules not processed for user `b14e52c2dee142bb896f6e0e61e52426`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:48.004873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88b492cd-b8c7-4760-bdab-a7734302e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:48.155921 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2907/5783] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:48.834708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:48.836308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:48.836965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:48.939317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] MFA Rules not processed for user `2b67e06516e746ceb504984154c8ef11`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:48.940704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:49.280771 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2877/5784] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:48 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:49.306916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e235a-80d9-46ff-85be-bc2283802e25 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:49.309142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e235a-80d9-46ff-85be-bc2283802e25 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:49.309142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e235a-80d9-46ff-85be-bc2283802e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:49.376334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ba0e235a-80d9-46ff-85be-bc2283802e25 None None] MFA Rules not processed for user `2b67e06516e746ceb504984154c8ef11`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:14:49.378055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ba0e235a-80d9-46ff-85be-bc2283802e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:49.389033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2908/5785] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:14:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:14:49.400824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:14:49.402572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:14:49.435322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc773fa9-8065-467e-86c4-1855e88cd9b0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:14:49.446371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:14:49.447753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:14:49.448279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:14:49.448935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:14:49.461855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:14:49.463992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:14:49.478084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2878/5786] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:14:49 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:05.554574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daece08-d084-45a1-a11f-c04c69b7efb1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:05.555216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daece08-d084-45a1-a11f-c04c69b7efb1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:05.555344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daece08-d084-45a1-a11f-c04c69b7efb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:05.574837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8daece08-d084-45a1-a11f-c04c69b7efb1 None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:05.576338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8daece08-d084-45a1-a11f-c04c69b7efb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:05.641560 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2909/5787] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:05 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:06.123605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:06.125151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:06.243013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699a47c-1af8-498c-bce4-8deb45e717d4 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:06.248737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09114-e200-4456-9093-6655547dd579 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:06.249402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09114-e200-4456-9093-6655547dd579 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:06.249679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09114-e200-4456-9093-6655547dd579 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:06.249952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09114-e200-4456-9093-6655547dd579 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:06.251762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-37e09114-e200-4456-9093-6655547dd579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:06.266053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09114-e200-4456-9093-6655547dd579 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:06.267639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09114-e200-4456-9093-6655547dd579 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:06.280379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2879/5788] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:10.397334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:10.398243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:10.398836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:10.431219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:10.435838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:10.467721 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2910/5789] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:15:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:10.476575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09114-e200-4456-9093-6655547dd579 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:10.506137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09114-e200-4456-9093-6655547dd579 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:10.524543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:10.526550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:10.527725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:10.529303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:10.555259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:10.561004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:10.588321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2880/5790] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:15:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:15:15.476869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:15.479283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:15.520116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01ba6-70e7-4cf5-b0d5-e10cd4c57839 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:15.526244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:15.527160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:15.527673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:15.528193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:15.530903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:15.547020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:15.548796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f29acf-f69f-4c0f-8d74-dee94949d393 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:15.574550 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2911/5791] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:16.457245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:16.458783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:16.478978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842de6-86c1-49a9-8b9c-f488a52fdc24 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:16.484302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:16.485325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:16.485630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:16.485955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] PATH_INFO: `/v3/users/46fe83bca8fb48278256ed2ec606b784` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:16.487202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fe83bca8fb48278256ed2ec606b784)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:16.489196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:16.615662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fe83bca8fb48278256ed2ec606b784'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:16.628885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fe83bca8fb48278256ed2ec606b784'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:16.633158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fe83bca8fb48278256ed2ec606b784'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:16.634484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fe83bca8fb48278256ed2ec606b784'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:16.647025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fe83bca8fb48278256ed2ec606b784'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:16.678081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2881/5792] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:15:16 2021] DELETE /identity/v3/users/46fe83bca8fb48278256ed2ec606b784 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:16.682723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:16.683361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:16.683575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:16.716733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:16.731275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:16.853916 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2912/5793] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:15:16.861633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:16.867132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:16.961631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fc607-873f-4bb3-af38-d3ea6de502d2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:16.978443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:16.980182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:16.980857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:16.981364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:17.005077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:17.007166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:17.020873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2882/5794] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:17.396855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:17.398593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:17.413288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6055-8d57-4951-9bec-e25038f40f52 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:17.418648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:17.419633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:17.420281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:17.421289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] PATH_INFO: `/v3/projects/342e290b041140ea8af4dba4e03e569f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:17.422802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] RBAC: Authorizing `identity:delete_project(project_id=342e290b041140ea8af4dba4e03e569f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:17.425278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:17.478082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342e290b041140ea8af4dba4e03e569f', 'request_id': 'req-70519d3f-e991-410e-aff4-94a11820519d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.483917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342e290b041140ea8af4dba4e03e569f', 'request_id': 'req-70519d3f-e991-410e-aff4-94a11820519d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.490812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342e290b041140ea8af4dba4e03e569f', 'request_id': 'req-70519d3f-e991-410e-aff4-94a11820519d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.506004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] The token cache is being invalidate because project 342e290b041140ea8af4dba4e03e569f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:15:17.506303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.506959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.508499 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2913/5795] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:15:17 2021] DELETE /identity/v3/projects/342e290b041140ea8af4dba4e03e569f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:17.512506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:17.524426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678e9c-c74a-4bd3-a27a-d429516b1273 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:17.609324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:17.610305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:17.610583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:17.611057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] PATH_INFO: `/v3/users/4f0487a5cdf048beab05e4822f69e8f5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:17.612427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0487a5cdf048beab05e4822f69e8f5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:17.614628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:17.713296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0487a5cdf048beab05e4822f69e8f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.728195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0487a5cdf048beab05e4822f69e8f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.731019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0487a5cdf048beab05e4822f69e8f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.735122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0487a5cdf048beab05e4822f69e8f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.763509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0372f7e4-0d02-49ce-9c6b-cd862f7bdc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0487a5cdf048beab05e4822f69e8f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:17.802358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2883/5796] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:15:17 2021] DELETE /identity/v3/users/4f0487a5cdf048beab05e4822f69e8f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:15:18.010054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.012442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:18.029924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70519d3f-e991-410e-aff4-94a11820519d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.130975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.131910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.132281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.132648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] PATH_INFO: `/v3/projects/d7a81957d3cc4708909ba7b629601d35` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.134053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a81957d3cc4708909ba7b629601d35)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.136140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.197115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a81957d3cc4708909ba7b629601d35', 'request_id': 'req-d940e539-dc53-4c6d-b759-30a8ec2cd046'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:18.204576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a81957d3cc4708909ba7b629601d35', 'request_id': 'req-d940e539-dc53-4c6d-b759-30a8ec2cd046'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:18.212882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a81957d3cc4708909ba7b629601d35', 'request_id': 'req-d940e539-dc53-4c6d-b759-30a8ec2cd046'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:18.230097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] The token cache is being invalidate because project d7a81957d3cc4708909ba7b629601d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:15:18.230709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:18.232593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d940e539-dc53-4c6d-b759-30a8ec2cd046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:18.234499 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2914/5797] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:15:18 2021] DELETE /identity/v3/projects/d7a81957d3cc4708909ba7b629601d35 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:18.239990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.240271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.240636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.260637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:18.261962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:18.322733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2884/5798] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:18.333115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.333550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.333891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.354108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:18.355297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:18.363121 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2915/5799] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:15:18.367367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.377464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff685e9-de61-4add-b5a9-775d240e1946 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.382063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.382722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.383004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.383281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.384101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:15:18.384321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.385940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.398495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2885/5800] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:15:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:18.402864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.412417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ea84-647b-427e-aeba-31124e9ee8dc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.417016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.417679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.417955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.418228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.419507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.421637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.449048 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2916/5801] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:15:18 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:15:18.453546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.464226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb62e-413b-48af-b8b1-651049604c56 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.532368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.533074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.533381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.533687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.534527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.536437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.559108 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2886/5802] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:15:18 2021] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:18.563800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.575408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15d38-e9a2-4f25-ae28-152cb666414f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.580872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.582177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.582666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.583037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.584034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.585762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.598249 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2917/5803] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:18 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:18.602425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.614037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9075-5901-4607-be34-2fe6a1680c18 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.619095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.620013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.620551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.620945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.621834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.624349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba0717-81ea-4f27-9a2c-e5a6e54d177f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.636985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2887/5804] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:18 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:15:18.641825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.663658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7fc8-b08a-4a12-9864-58d428db4bc0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.670868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.671826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.672134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.672546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] PATH_INFO: `/v3/projects/f681d249be244c568d49890773eb9090/users/23be25820abb4f2a94acb971671217ca/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.688741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f681d249be244c568d49890773eb9090, user_id=23be25820abb4f2a94acb971671217ca, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.694489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.707582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2918/5805] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:15:18 2021] PUT /identity/v3/projects/f681d249be244c568d49890773eb9090/users/23be25820abb4f2a94acb971671217ca/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:18.717847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.718133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.718410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.747767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] MFA Rules not processed for user `23be25820abb4f2a94acb971671217ca`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:18.749721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:18.842243 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2888/5806] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:18.853936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:18.855823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:18.937743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43cac-1245-437c-ab94-aedfe1d13ff9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:18.941649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:18.942615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:18.942972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:18.943320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:18.954226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:18.955802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3a432-9806-4e1d-81f6-d28d0f58db42 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:18.967986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2919/5807] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:18 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:20.100988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:20.103208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:20.219595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346655-3449-4a8c-8cf4-44318a6ca40d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:20.225925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:20.227194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:20.227639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:20.228133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] PATH_INFO: `/v3/users/435b8c8a17de402b8e2c7f64e802867c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:20.229630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=435b8c8a17de402b8e2c7f64e802867c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:20.236947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:20.314575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435b8c8a17de402b8e2c7f64e802867c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:20.331344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435b8c8a17de402b8e2c7f64e802867c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:20.332533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435b8c8a17de402b8e2c7f64e802867c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:20.333402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435b8c8a17de402b8e2c7f64e802867c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:20.350967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435b8c8a17de402b8e2c7f64e802867c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:20.391300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2889/5808] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:15:20 2021] DELETE /identity/v3/users/435b8c8a17de402b8e2c7f64e802867c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:20.398518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:20.399450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:20.399937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:20.421796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:20.423588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:20.519298 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2920/5809] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:20.537639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:20.544431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:20.670878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296612-2d80-4724-b1ba-c6ed67c993cc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:20.674707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:20.675352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:20.675851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:20.676293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:20.688237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:20.690035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216e59-b61d-4f10-84dd-b0a8bd621052 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:20.704164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2890/5810] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:21.267503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.268979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:21.303730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da374e4-033e-4eed-afef-c9a29a28fbac None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.313909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.314883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.315277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.315673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] PATH_INFO: `/v3/projects/307b0b91d7b2449db46aa8f4a47830c9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.317006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=307b0b91d7b2449db46aa8f4a47830c9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.335973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.418666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307b0b91d7b2449db46aa8f4a47830c9', 'request_id': 'req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:21.424312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307b0b91d7b2449db46aa8f4a47830c9', 'request_id': 'req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:21.432412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307b0b91d7b2449db46aa8f4a47830c9', 'request_id': 'req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:21.448159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] The token cache is being invalidate because project 307b0b91d7b2449db46aa8f4a47830c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:15:21.448820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:21.449687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aee1bbb7-fcbe-4698-a0fd-fbf70ad0d30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:21.452936 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2921/5811] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:15:21 2021] DELETE /identity/v3/projects/307b0b91d7b2449db46aa8f4a47830c9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:21.459826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.460380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.460380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.480975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:21.482263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:21.551101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2891/5812] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:21.558510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.558895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.559344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.583015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:21.584634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:21.595980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2922/5813] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:21.600108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.610949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4dbcb-78ae-4976-8d7b-13599710921b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.615579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.616236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.616517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.616825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.617567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:15:21.617870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.619446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.633087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2892/5814] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:15:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:21.637892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.651322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b62910-9c8f-4639-ae31-5780b2c34168 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.661123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.662137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.662512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.662878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.666303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.668507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.708786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2923/5815] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:15:21 2021] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:15:21.712479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.728030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa0bac-aabe-4671-ad66-1137029130dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.806415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.807426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.807702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.808150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.809744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.811636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.836690 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2893/5816] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:15:21 2021] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:21.840520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.851552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c3e-44b4-4684-904e-803db2bc47b5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.856902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.857785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.858247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.858589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.859393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.861148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.876121 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2924/5817] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:21.877396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.889270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466a905-202b-4b8f-a3f3-9ffb2c3de57a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.895324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.896554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.897673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.897673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.898277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.900402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed428a0-aeeb-4181-86c4-df08af61d399 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.913191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2894/5818] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:21.917455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:21.927794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b47c-54a7-4aa7-a74e-d844d2d6dd34 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:21.932761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:21.933842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.934855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.935436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b/users/bcd8c789606348a48a5dc5838f2c9c65/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:21.953135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70abde73403402aa1816f725a94769b, user_id=bcd8c789606348a48a5dc5838f2c9c65, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:21.956158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:21.972420 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2925/5819] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:15:21 2021] PUT /identity/v3/projects/c70abde73403402aa1816f725a94769b/users/bcd8c789606348a48a5dc5838f2c9c65/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:15:21.981930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54ded-4b67-4b02-b40c-aaf09a0cd66a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:21.982215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54ded-4b67-4b02-b40c-aaf09a0cd66a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:21.982490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54ded-4b67-4b02-b40c-aaf09a0cd66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.015622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-52e54ded-4b67-4b02-b40c-aaf09a0cd66a None None] MFA Rules not processed for user `bcd8c789606348a48a5dc5838f2c9c65`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:22.017286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-52e54ded-4b67-4b02-b40c-aaf09a0cd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:22.101291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2895/5820] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:21 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:22.112888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.115925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:22.221407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349da34-bf10-42a4-b54a-2a775063b83d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.238864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.240551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.240883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.241156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.252117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.255737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.272333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2926/5821] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:22.289814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d2f6-9526-48da-9980-e530d8d6aad3 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.290105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d2f6-9526-48da-9980-e530d8d6aad3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.290385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d2f6-9526-48da-9980-e530d8d6aad3 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.292474 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2896/5822] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:15:22.299693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:15:22.322485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.334035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03110-2900-4f1f-96e6-a01740c815e8 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.341857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd8c789606348a48a5dc5838f2c9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70abde73403402aa1816f725a94769b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.342850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.343230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.343613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.345322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorizing `identity:get_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.347560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.350467 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2927/5823] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 363 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:22.435366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774142b2-ee88-4de3-9930-9e83ebff22b7 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.435762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774142b2-ee88-4de3-9930-9e83ebff22b7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.436133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774142b2-ee88-4de3-9930-9e83ebff22b7 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.438408 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2897/5824] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:15:22.444173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:15:22.461230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.471253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0516-3d0c-4f58-96b7-868a5d2f657d tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.476219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd8c789606348a48a5dc5838f2c9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70abde73403402aa1816f725a94769b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.477258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.477538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.477809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.479028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorizing `identity:get_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.480833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.482781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2928/5825] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 363 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:22.520352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861908c-9666-4c05-9cbb-5e46ba29781a None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.521245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861908c-9666-4c05-9cbb-5e46ba29781a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.521726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861908c-9666-4c05-9cbb-5e46ba29781a None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.523660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2898/5826] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:15:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:15:22.530395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:15:22.550027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.561746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041b54-b1d8-4536-ad69-20e15153e1fd tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.576649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd8c789606348a48a5dc5838f2c9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70abde73403402aa1816f725a94769b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.576649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.576649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.577432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.578078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorizing `identity:get_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.580206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.583086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2929/5827] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 363 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:22.631138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c1ab-4232-4c92-8872-650309f36737 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.631642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c1ab-4232-4c92-8872-650309f36737 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.632100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c1ab-4232-4c92-8872-650309f36737 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.634619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2899/5828] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:15:22.640456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:15:22.643338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:22.690921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.714523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba6300-e3d4-49c9-9c01-b0c083f485da tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.719807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd8c789606348a48a5dc5838f2c9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70abde73403402aa1816f725a94769b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.720797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.721075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.721346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.722597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorizing `identity:get_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.724500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.726820 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2930/5829] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 363 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:15:22.777237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1261-90db-4ad2-95e7-c1f49ce89fb6 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.777870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1261-90db-4ad2-95e7-c1f49ce89fb6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.778252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1261-90db-4ad2-95e7-c1f49ce89fb6 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.780393 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2900/5830] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 04:15:22.785909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:15:22.804995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.815663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bef39-93ca-4cd0-96e9-5894ca584671 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.832132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd8c789606348a48a5dc5838f2c9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70abde73403402aa1816f725a94769b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.833157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.833561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.834366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.836207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorizing `identity:get_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.838426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65346904-6520-4daf-8103-c20ed56c23f7 tempest-QuotasTestJSON-653092129 tempest-QuotasTestJSON-653092129-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:22.850337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2931/5831] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:15:22 2021] GET /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 363 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:15:22.874019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d1261-90db-4ad2-95e7-c1f49ce89fb6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:22.974910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d1261-90db-4ad2-95e7-c1f49ce89fb6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:22.979817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:22.980990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:22.981977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:22.982558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] PATH_INFO: `/v3/users/bcd8c789606348a48a5dc5838f2c9c65` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:22.984089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd8c789606348a48a5dc5838f2c9c65)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:22.986770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:23.068723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd8c789606348a48a5dc5838f2c9c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:23.077682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd8c789606348a48a5dc5838f2c9c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:23.078933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd8c789606348a48a5dc5838f2c9c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:23.079568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd8c789606348a48a5dc5838f2c9c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:23.089058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd8c789606348a48a5dc5838f2c9c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:23.110578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2901/5832] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:15:22 2021] DELETE /identity/v3/users/bcd8c789606348a48a5dc5838f2c9c65 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:23.114906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:23.115206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:23.115450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:23.134831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:23.136312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:23.209006 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2932/5833] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:23.219988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:23.221612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:23.289108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48339c-8c9b-42b7-9235-4dd22c9717d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:23.293394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:23.294809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:23.295210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:23.295600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:23.308579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:23.310347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a375408-4bbb-4ef4-a58b-fdcd58412fe4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:23.322042 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2902/5834] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:23.915503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:23.916949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:23.933044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10833e-ea79-4fad-a3c3-194e89576873 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:23.939763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:23.940800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:23.941504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:23.942038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] PATH_INFO: `/v3/projects/c70abde73403402aa1816f725a94769b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:23.943319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70abde73403402aa1816f725a94769b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:23.945427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.006217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70abde73403402aa1816f725a94769b', 'request_id': 'req-a4d4028a-9d91-4a40-b528-acf9afb07130'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:24.011928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70abde73403402aa1816f725a94769b', 'request_id': 'req-a4d4028a-9d91-4a40-b528-acf9afb07130'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:24.019439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70abde73403402aa1816f725a94769b', 'request_id': 'req-a4d4028a-9d91-4a40-b528-acf9afb07130'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:24.036903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] The token cache is being invalidate because project c70abde73403402aa1816f725a94769b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:15:24.037329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:24.038220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a4d4028a-9d91-4a40-b528-acf9afb07130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:24.048387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.049056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.049749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.051471 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2933/5835] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:15:23 2021] DELETE /identity/v3/projects/c70abde73403402aa1816f725a94769b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:24.070631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:24.073697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:24.162859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2903/5836] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:24.173755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.174141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.174516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.197499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:24.199271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:24.212279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2934/5837] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:24.217255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.227415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ee27c-a429-420e-834b-2f86278d58aa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.236146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.237304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.237775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.238090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.238925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:15:24.239232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.242469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.257457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2904/5838] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:15:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:15:24.261778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.271443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718fee6-5a06-46bc-bf9c-f5d77b7072c3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.276929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.277747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.278623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.279398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.280385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.282493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.351164 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2935/5839] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:15:24 2021] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:24.355031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.367203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc6e5-ee7b-4b0f-8dab-cedec81c216e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.456276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.457576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.459914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.460418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.461432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.463536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.496229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2905/5840] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:15:24 2021] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:24.496863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.520587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b81d-d57e-4229-ae1d-7721c3c8e76b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.536667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.537450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.537826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.538193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.539022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.541462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.559153 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2936/5841] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:15:24.560370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.573130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68eb36-b705-489a-83cf-e73c4c3ab366 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.579238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.580094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.580514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.581033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.582002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.583871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15e77d-3d8e-4923-abaa-90053f79dac4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.604952 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2906/5842] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:24.608559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.625830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2d29-2b50-4ec2-acb8-dd5679ab84f7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.631511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.633402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.633912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.634402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] PATH_INFO: `/v3/projects/a7a2ec0afddf403183d9d44778510b6e/users/694bd6d882cd4099b51d58a50f6f1ebd/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.652646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a2ec0afddf403183d9d44778510b6e, user_id=694bd6d882cd4099b51d58a50f6f1ebd, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.655904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.670194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2937/5843] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:15:24 2021] PUT /identity/v3/projects/a7a2ec0afddf403183d9d44778510b6e/users/694bd6d882cd4099b51d58a50f6f1ebd/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:24.675441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6820-d534-4f35-bd38-9bdd614a5fce None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.675930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6820-d534-4f35-bd38-9bdd614a5fce None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.676387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6820-d534-4f35-bd38-9bdd614a5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.696406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-01cd6820-d534-4f35-bd38-9bdd614a5fce None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:24.698886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01cd6820-d534-4f35-bd38-9bdd614a5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:24.795959 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2907/5844] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:15:24.806587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:24.808557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:24.921544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d5db-9d71-479c-b6f2-1b782e4b79d4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:24.927201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:24.928066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:24.928521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:24.929917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:24.944246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:24.945975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:24.967993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2938/5845] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:31.699171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:31.700049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:31.700707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:31.756485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] MFA Rules not processed for user `694bd6d882cd4099b51d58a50f6f1ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:31.757450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:31.875128 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2908/5846] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:31.889417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:31.890974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:32.029931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8da63-bb10-41d6-8176-74659aee0b63 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:32.043458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:32.044545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:32.045057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:32.045543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:32.057732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:32.061997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6945-9ea6-480a-8dd8-87fd639a6240 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:32.084024 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2939/5847] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:34.085573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:34.087159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:34.111173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13f5c-7851-4778-b28e-89e5b95e89d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:34.116010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:34.117208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:34.117559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:34.119351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] PATH_INFO: `/v3/users/23be25820abb4f2a94acb971671217ca` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:34.122330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=23be25820abb4f2a94acb971671217ca)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:34.129762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:34.254125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23be25820abb4f2a94acb971671217ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:34.269402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23be25820abb4f2a94acb971671217ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:34.276258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23be25820abb4f2a94acb971671217ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:34.278106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23be25820abb4f2a94acb971671217ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:34.298174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23be25820abb4f2a94acb971671217ca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:34.340897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2909/5848] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:15:34 2021] DELETE /identity/v3/users/23be25820abb4f2a94acb971671217ca => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:34.344407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:34.344975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:34.345094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:34.378508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:34.379750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:34.522801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2940/5849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:34.533696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:34.535322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:34.638450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8545-f9e2-4b52-abd4-921b48f354ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:34.643216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:34.644077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:34.644464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:34.644884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:34.663712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:34.665335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414b92-5efb-421b-9c68-46c9fdd79352 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:34.686456 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2910/5850] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:35.172636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:35.176016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:35.198891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c285d-89d0-4943-98d9-26584b3daacb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:35.212510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:35.213982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.214489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.215013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] PATH_INFO: `/v3/projects/f681d249be244c568d49890773eb9090` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.216706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f681d249be244c568d49890773eb9090)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:35.218843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:35.307448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f681d249be244c568d49890773eb9090', 'request_id': 'req-3b07cef4-6dba-470a-a444-7929994b86a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:35.321810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f681d249be244c568d49890773eb9090', 'request_id': 'req-3b07cef4-6dba-470a-a444-7929994b86a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:35.338978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f681d249be244c568d49890773eb9090', 'request_id': 'req-3b07cef4-6dba-470a-a444-7929994b86a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:35.369773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] The token cache is being invalidate because project f681d249be244c568d49890773eb9090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:15:35.370956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:35.372214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b07cef4-6dba-470a-a444-7929994b86a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:15:35.374469 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2941/5851] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:15:35 2021] DELETE /identity/v3/projects/f681d249be244c568d49890773eb9090 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:35.380118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.380677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.380817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.409597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:35.412186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:35.575864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2911/5852] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:35.584077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.584671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.585206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.624114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:35.626757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:35.641905 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2942/5853] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:35.642752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:35.671827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d956b-19ca-4742-9558-ca77dcf7fbc9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:35.681863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:35.682987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.690967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.692105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.693858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:15:35.694415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:35.696258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:35.716036 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2912/5854] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:15:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:15:35.719886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:35.732103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40f84-7ef7-4fa3-8ed0-319d1c368600 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:35.737848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:35.738746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.739342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.739880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.740990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:35.743194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:35.795912 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2943/5855] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:15:35 2021] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:35.799605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:35.819665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4625-6484-4a62-8d67-0decda481cff admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:35.930850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:35.932191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:35.933179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:35.934737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:35.935658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:35.948502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:36.003270 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2913/5856] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:15:35 2021] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:15:36.004527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:36.032810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3428f-1d8d-4806-893a-68628ad399b4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:36.042426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:36.043943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.044322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.044692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.053736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:36.056574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:36.069577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2944/5857] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:36.073953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:36.091349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d84570-cad5-4e9a-8bc2-82435c595ed2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:36.098811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:36.102043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.102396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.102737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.106421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:36.111568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aed0a2-1962-41d2-acff-4fdeb7143db9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:36.142856 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2914/5858] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:15:36.146682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:36.171576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a61f-6d60-4068-b044-2876ef067aa8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:36.177367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:36.178508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.178991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.179483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] PATH_INFO: `/v3/projects/48997a13698b49a6b4447a1dc8850898/users/182924a824b746da8b99d09939ceb5d8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.211948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48997a13698b49a6b4447a1dc8850898, user_id=182924a824b746da8b99d09939ceb5d8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:36.216172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3415d-8fdf-4aa8-ab65-5c16839ab583 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:36.248732 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2945/5859] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:15:36 2021] PUT /identity/v3/projects/48997a13698b49a6b4447a1dc8850898/users/182924a824b746da8b99d09939ceb5d8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:15:36.259198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.259494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.259749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.333004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] MFA Rules not processed for user `182924a824b746da8b99d09939ceb5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:36.335052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:36.424987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef9a5-8dad-420a-8fe2-8c1108f78edf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.426270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef9a5-8dad-420a-8fe2-8c1108f78edf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.426726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef9a5-8dad-420a-8fe2-8c1108f78edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.459685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e7ef9a5-8dad-420a-8fe2-8c1108f78edf None None] MFA Rules not processed for user `694bd6d882cd4099b51d58a50f6f1ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:36.460916 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2915/5860] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:36.462989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e7ef9a5-8dad-420a-8fe2-8c1108f78edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:36.474703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:36.477338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:36.557345 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2946/5861] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:15:36.607050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a616e5-36ff-4ca4-96d5-7e7b899dde5f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:36.611469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:36.612143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:36.612421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:36.612737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:36.626466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:36.629318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:36.655792 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2916/5862] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:15:36 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:15:46.666968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296831da-dd38-4326-b01d-58b5ccc9122e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:46.667572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296831da-dd38-4326-b01d-58b5ccc9122e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:46.667840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296831da-dd38-4326-b01d-58b5ccc9122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:46.698445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-296831da-dd38-4326-b01d-58b5ccc9122e None None] MFA Rules not processed for user `2b67e06516e746ceb504984154c8ef11`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:15:46.701181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-296831da-dd38-4326-b01d-58b5ccc9122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:46.826580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2947/5863] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:15:53.453524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:15:53.480975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd974e-3eaf-4500-9570-cc393ba09f94 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:15:53.490255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:15:53.492281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:15:53.498257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:15:53.499401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:15:53.510931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:15:53.702839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:15:53.704298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:15:53.719453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2917/5864] 10.222.0.13 () {60 vars in 1396 bytes} [Wed Nov 10 04:15:53 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:04.744128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b55a-cce6-43a8-a989-40c7b3127166 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:04.744862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b55a-cce6-43a8-a989-40c7b3127166 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:04.744862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b55a-cce6-43a8-a989-40c7b3127166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:04.772236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c277b55a-cce6-43a8-a989-40c7b3127166 None None] MFA Rules not processed for user `704f4755d3f446429725f2b66cd8a672`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:04.773706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c277b55a-cce6-43a8-a989-40c7b3127166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:04.858297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2948/5865] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:04 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:11.490511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:11.493592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:11.594596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f4c3b-d557-4aa4-8d55-31b6149acd5f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:11.601570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:11.602815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:11.603310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:11.604093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] PATH_INFO: `/v3/users/67c6fd5e302b4cc8994252aafda89b92` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:11.605718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c6fd5e302b4cc8994252aafda89b92)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:11.607965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:11.680404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c6fd5e302b4cc8994252aafda89b92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:11.693577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c6fd5e302b4cc8994252aafda89b92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:11.694813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c6fd5e302b4cc8994252aafda89b92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:11.695667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c6fd5e302b4cc8994252aafda89b92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:11.706198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c6fd5e302b4cc8994252aafda89b92'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:11.734411 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2918/5866] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:11 2021] DELETE /identity/v3/users/67c6fd5e302b4cc8994252aafda89b92 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:11.738863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:11.739406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:11.739406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:11.764134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:11.765552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:11.875589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2949/5867] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:11.907450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:11.909891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:11.996688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dae773-c422-4c13-b7b7-8001c3726f9e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.000767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.001742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.002202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.002571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.013952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.015491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f758-f5b6-49ad-b714-c88c8db0eb66 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.027664 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2919/5868] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:12.337428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.339033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:12.355086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2b1a-2cd8-469f-abe4-2028dd5d9584 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.359895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.361048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.361421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.361879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] PATH_INFO: `/v3/projects/4b506e3d8223426e8ce6df278556f03a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.363206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b506e3d8223426e8ce6df278556f03a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.365231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.414744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b506e3d8223426e8ce6df278556f03a', 'request_id': 'req-fe68b324-0da0-40eb-a70a-cb9455fa5508'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:12.421357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b506e3d8223426e8ce6df278556f03a', 'request_id': 'req-fe68b324-0da0-40eb-a70a-cb9455fa5508'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:12.427456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b506e3d8223426e8ce6df278556f03a', 'request_id': 'req-fe68b324-0da0-40eb-a70a-cb9455fa5508'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:12.440155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] The token cache is being invalidate because project 4b506e3d8223426e8ce6df278556f03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:12.440423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:12.441164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe68b324-0da0-40eb-a70a-cb9455fa5508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:12.442954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2950/5869] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:12 2021] DELETE /identity/v3/projects/4b506e3d8223426e8ce6df278556f03a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:12.511502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.512721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.513259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.531754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:12.533198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:12.602749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2920/5870] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:12.611209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.612043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.612535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.636089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:12.637632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:12.647527 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2951/5871] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:12.652063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.661745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355a20-056d-4ac6-96f9-237e93701c76 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.667678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.668938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.669429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.669928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.670886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:12.671403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.673520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.691415 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2921/5872] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:12.692016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.701490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9d51-dafd-4daf-91e9-73131a11f8c1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.711336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.712405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.712961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.713475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.714453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.718255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.747805 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2952/5873] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:12 2021] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:12.752105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.763129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc051d-37e5-4a0f-9f25-d3d5ca241a75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.849991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.850737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.851087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.851431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.852211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.854424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.876596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2922/5874] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:12 2021] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:12.880956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.891560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c206f-3e08-4468-a8c4-3dfdbb9821b1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.896931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.897901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.898426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.898950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.901243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.903623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.921172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2953/5875] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:12.927064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.939446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6374-8972-4f3d-a54e-422ef1e4b7ea admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.945737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.946541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.946898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.947271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:12.948097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:12.949888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecd86d-9862-4bf6-a7dc-0a92d745539a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:12.965011 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2923/5876] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:12.972586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:12.983103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477566f2-ddfc-4594-8300-d564e6897796 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:12.993834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:12.994990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:12.995618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:12.996118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] PATH_INFO: `/v3/projects/43e8c44c4fc148d3bf00be4c3013b5d0/users/ef159dfb13e146489cd53b05390ef1af/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:13.018914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e8c44c4fc148d3bf00be4c3013b5d0, user_id=ef159dfb13e146489cd53b05390ef1af, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:13.021575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:13.039012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2954/5877] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:12 2021] PUT /identity/v3/projects/43e8c44c4fc148d3bf00be4c3013b5d0/users/ef159dfb13e146489cd53b05390ef1af/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:13.049447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:13.049914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:13.050420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:13.088030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] MFA Rules not processed for user `ef159dfb13e146489cd53b05390ef1af`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:13.090361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:13.170035 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2924/5878] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:13 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:13.195325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:13.197978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:13.268798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc0679-1e45-4406-8736-02b86eb7819f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:13.273572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:13.275092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:13.275659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:13.276366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:13.290357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:13.292580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7214b4-947c-42a2-b1d7-1a60d6754bc0 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:13.304413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2955/5879] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:13 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:19.610650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:19.612308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:19.683381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ea749-2cfa-432b-85a2-8c11ec872a94 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:19.687836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:19.688732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:19.689011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:19.689282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] PATH_INFO: `/v3/users/182924a824b746da8b99d09939ceb5d8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:19.690495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182924a824b746da8b99d09939ceb5d8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:19.692642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:19.749626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182924a824b746da8b99d09939ceb5d8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:19.756778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182924a824b746da8b99d09939ceb5d8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:19.758132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182924a824b746da8b99d09939ceb5d8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:19.762632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182924a824b746da8b99d09939ceb5d8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:19.777699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182924a824b746da8b99d09939ceb5d8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:19.834471 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2925/5880] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:19 2021] DELETE /identity/v3/users/182924a824b746da8b99d09939ceb5d8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:19.838671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:19.839167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:19.839314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:19.858134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:19.859646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:19.926983 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2956/5881] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:19.960546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:19.962111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:20.057056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bf69-2da2-4c4a-b7e3-8bf484b07e42 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.065041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.065717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.066003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.066885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.085638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.087096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccfe31-cd49-4451-8837-8582db1672f1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.103522 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2926/5882] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:20.305984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.307562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:20.323241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283d580-85f3-4d5f-a4de-85b9b25f31f4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.328562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.329448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.329724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.329992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] PATH_INFO: `/v3/projects/48997a13698b49a6b4447a1dc8850898` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.331357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48997a13698b49a6b4447a1dc8850898)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.333363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.393872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48997a13698b49a6b4447a1dc8850898', 'request_id': 'req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:20.414930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48997a13698b49a6b4447a1dc8850898', 'request_id': 'req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:20.422329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48997a13698b49a6b4447a1dc8850898', 'request_id': 'req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:20.441032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] The token cache is being invalidate because project 48997a13698b49a6b4447a1dc8850898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:20.441454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:20.442645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1693fa5c-d197-4f67-a0d6-2bcd75c05ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:20.445124 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2957/5883] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:20 2021] DELETE /identity/v3/projects/48997a13698b49a6b4447a1dc8850898 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:20.451286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.451566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.451835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.471464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:20.471766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:20.535357 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2927/5884] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:20.543512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.543802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.544080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.563099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:20.564324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:20.576982 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2958/5885] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:20.578906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.589354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d4d7-3301-4db0-8cf1-520c5c338559 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.596099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.596880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.597194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.597443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.598198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:20.598492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.601002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.615766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2928/5886] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:16:20.616969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.627239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266ef8c-53f5-40ae-8837-b021908ec717 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.634816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.636883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.638055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.638055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.638778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.640780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.677244 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2959/5887] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:20 2021] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:20.679183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.689952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f026f5-51ca-44f8-9467-6efa6153d8f3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.760351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.761587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.761867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.762137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.762849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.764926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.797080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2929/5888] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:20 2021] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:20.798798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.832633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a264a7-8f8c-4525-a080-d73dfe09b6b4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.841523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.842209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.842488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.842761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.843533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.845201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.857640 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2960/5889] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:20.861769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.876154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc89b-ac85-4095-aa68-e5e3bf1b12bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.883365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.884501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.884695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.884996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.886298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.887938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc99719-1d19-449a-ac98-13cca2842d53 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.910153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2930/5890] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:20.914420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:20.924482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a48d-ba88-4c63-b3f4-ad3f6849db6e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:20.929307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:20.930178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.930451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.930719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] PATH_INFO: `/v3/projects/78f8dca8f0d74c96a72b9634b04c9e1c/users/ab32b9b6a0dd49b9bda632a04e67c94e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:20.948966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f8dca8f0d74c96a72b9634b04c9e1c, user_id=ab32b9b6a0dd49b9bda632a04e67c94e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:20.951783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:20.971349 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2961/5891] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:20 2021] PUT /identity/v3/projects/78f8dca8f0d74c96a72b9634b04c9e1c/users/ab32b9b6a0dd49b9bda632a04e67c94e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:20.981269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:20.981641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:20.982011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.020233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] MFA Rules not processed for user `ab32b9b6a0dd49b9bda632a04e67c94e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:21.024085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:21.114574 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2931/5892] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:20 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:21.126333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:21.127971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:21.195208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd392-61ed-47ea-af80-59b3db4ac1d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:21.199964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:21.201156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:21.201540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:21.201918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.211341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:21.213119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eec71-74dd-4b39-8b22-c3dcd3257692 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:21.223070 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2962/5893] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:21 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:21.241794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:21.311682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbb34-6a87-4b08-b5ac-25ac81c80d3b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:21.321487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:21.322622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:21.323619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:21.324003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] PATH_INFO: `/v3/users/ab32b9b6a0dd49b9bda632a04e67c94e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.325564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab32b9b6a0dd49b9bda632a04e67c94e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:21.328681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:21.384870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab32b9b6a0dd49b9bda632a04e67c94e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:21.392111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab32b9b6a0dd49b9bda632a04e67c94e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:21.392879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab32b9b6a0dd49b9bda632a04e67c94e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:21.393504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab32b9b6a0dd49b9bda632a04e67c94e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:21.401109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab32b9b6a0dd49b9bda632a04e67c94e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:21.419256 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2932/5894] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:21 2021] DELETE /identity/v3/users/ab32b9b6a0dd49b9bda632a04e67c94e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:21.423976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:21.424438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:21.424745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.443368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:21.444797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:21.506305 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2963/5895] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:21.517260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:21.518677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:21.579222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c5184-a1f8-4065-a3d2-27ec740c19b7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:21.585830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:21.586477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:21.586752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:21.587022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.597051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:21.598488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d81f6-5ce4-4bff-af03-439904ee2fbf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:21.609222 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2933/5896] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:21.930409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:21.932015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:21.945213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a208-9319-49d8-8a59-6713570d61c7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:21.951167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:21.953081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:21.953878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:21.954327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] PATH_INFO: `/v3/projects/78f8dca8f0d74c96a72b9634b04c9e1c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:21.955754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f8dca8f0d74c96a72b9634b04c9e1c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:21.957777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.011148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f8dca8f0d74c96a72b9634b04c9e1c', 'request_id': 'req-a26eade3-10e3-4d68-a082-467ac504d458'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.017085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f8dca8f0d74c96a72b9634b04c9e1c', 'request_id': 'req-a26eade3-10e3-4d68-a082-467ac504d458'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.023412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f8dca8f0d74c96a72b9634b04c9e1c', 'request_id': 'req-a26eade3-10e3-4d68-a082-467ac504d458'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.056338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] The token cache is being invalidate because project 78f8dca8f0d74c96a72b9634b04c9e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:22.056338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.059015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a26eade3-10e3-4d68-a082-467ac504d458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.064997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2964/5897] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:21 2021] DELETE /identity/v3/projects/78f8dca8f0d74c96a72b9634b04c9e1c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:22.066692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.067463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.067907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.086842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:22.089707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.162250 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2934/5898] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:22.171227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.171510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.171934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.199394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:22.200572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.208884 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2965/5899] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:22.213436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.224782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af044-93d6-4345-8308-fcdc16dd1530 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.229636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.230298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.230578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.230903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.231772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:22.232076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.233846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.247907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2935/5900] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:22.250743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.263296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a9d1-8f24-4ea4-b1b4-e4b55952039b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.268174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.268862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.269174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.269416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.270122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.272058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.300288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2966/5901] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:22.304396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.314601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fe1d8-98db-4b91-b250-d95323293848 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.377590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.378692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.378937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.379211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.380046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.382041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.408642 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2936/5902] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:22.410739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.421346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d096-78d6-4aec-8775-4acdd8b0c3d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.426004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.426652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.426927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.427196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.427922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.429547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.440101 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2967/5903] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:22.443907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.454740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba980032-5207-443a-b31d-27e8a773ad43 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.459393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.460050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.460329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.460620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.461366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.462933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b205488-32b6-4467-827b-38b5f730ef3b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.476783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2937/5904] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:22.477940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.488232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdce4-1d88-4aea-83c3-26a23cc4335d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.493122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.493993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.494270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.494544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] PATH_INFO: `/v3/projects/46474dbd2edc4efc97078c5be41d5c33/users/181b80962fdd4a8da809a44ba7e02fe7/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.509040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46474dbd2edc4efc97078c5be41d5c33, user_id=181b80962fdd4a8da809a44ba7e02fe7, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.511875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.524813 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2968/5905] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:22 2021] PUT /identity/v3/projects/46474dbd2edc4efc97078c5be41d5c33/users/181b80962fdd4a8da809a44ba7e02fe7/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:22.535297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.535579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.535923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.563969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] MFA Rules not processed for user `181b80962fdd4a8da809a44ba7e02fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:22.565240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.637133 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2938/5906] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:22.647612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.649346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.665047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.666647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.709426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a87f-bee0-4750-9e34-d0724c7d1e51 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.718761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.719406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.719685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.719954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.728664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.730120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786e00-e4d9-48b5-9e61-7577f5d39332 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.736507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e173b-e1c3-49e8-ab78-8c4e6d4485bf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:22.738899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2969/5907] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:22.741933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:22.742847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.743189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.743453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] PATH_INFO: `/v3/users/ef159dfb13e146489cd53b05390ef1af` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.745932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef159dfb13e146489cd53b05390ef1af)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:22.748763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:22.794994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef159dfb13e146489cd53b05390ef1af'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.801770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef159dfb13e146489cd53b05390ef1af'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.805091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef159dfb13e146489cd53b05390ef1af'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.805709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef159dfb13e146489cd53b05390ef1af'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.814128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef159dfb13e146489cd53b05390ef1af'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:22.833044 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2939/5908] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:22 2021] DELETE /identity/v3/users/ef159dfb13e146489cd53b05390ef1af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:22.837811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:22.838132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:22.838392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:22.856890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:22.858095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.919279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2970/5909] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:22.929918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:22.931345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:22.997710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac11b0-5504-42ff-bdb6-4c76d9c456ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.002043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.003117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.003117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.003555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.014978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.016681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021b78-abaa-4eb1-8e2c-091c669b0a9c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.026797 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2940/5910] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:23.255352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.256875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:23.269341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e979-8f83-40ee-890f-fdfa66c479d1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.275766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.277276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.277711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.277986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] PATH_INFO: `/v3/projects/43e8c44c4fc148d3bf00be4c3013b5d0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.279194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e8c44c4fc148d3bf00be4c3013b5d0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.281271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.332435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e8c44c4fc148d3bf00be4c3013b5d0', 'request_id': 'req-ad127020-e9ff-4820-8dba-d255e19d5fa0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:23.337797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e8c44c4fc148d3bf00be4c3013b5d0', 'request_id': 'req-ad127020-e9ff-4820-8dba-d255e19d5fa0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:23.344472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e8c44c4fc148d3bf00be4c3013b5d0', 'request_id': 'req-ad127020-e9ff-4820-8dba-d255e19d5fa0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:23.359601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] The token cache is being invalidate because project 43e8c44c4fc148d3bf00be4c3013b5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:23.359889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:23.360506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ad127020-e9ff-4820-8dba-d255e19d5fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:23.362242 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2971/5911] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:23 2021] DELETE /identity/v3/projects/43e8c44c4fc148d3bf00be4c3013b5d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:23.367942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.368464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.368742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.392120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:23.393380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:23.468895 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2941/5912] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:23.471786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.472179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.472578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.494906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:23.496221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:23.505085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2972/5913] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:23.517366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.527456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde1652-ca13-4360-aff2-ba968d96a7ed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.532258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.532949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.533240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.533552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.534239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:23.534531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.536134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.549689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2942/5914] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:23.553100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.562463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebbb6f-abf1-4710-8802-622ac2bc545e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.567422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.568072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.568350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.568658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.569401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.571362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.597855 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2973/5915] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:23 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:23.602269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.613035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb14fd-f73a-40ba-b4ac-b0da4777ea37 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.671114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.671938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.672218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.672492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.673366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.675330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.696509 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2943/5916] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:23 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:23.701180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.711619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53bbae-f626-4c51-8ac9-d6499a35e543 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.716908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.717633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.717980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.718346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.719174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.720904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.731973 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2974/5917] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:23.735770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.746203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e5a9-c5fe-401d-b598-284a49892b7a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.751112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.751784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.752068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.752851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.753145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.754727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb67b4-fa53-4f54-8549-c7e6ad633adf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.768502 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2944/5918] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:23.769670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.780258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5ba2f-ccf2-4fb9-9470-b93f553bec6e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:23.785510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:23.786433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.786713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.787009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] PATH_INFO: `/v3/projects/6ccd791c57f74314a42db37535e1c576/users/c33f2e03ba4742118232857ee7d48ab1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.809670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccd791c57f74314a42db37535e1c576, user_id=c33f2e03ba4742118232857ee7d48ab1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:23.812320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:23.829903 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2975/5919] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:23 2021] PUT /identity/v3/projects/6ccd791c57f74314a42db37535e1c576/users/c33f2e03ba4742118232857ee7d48ab1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:23.842345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793856-a681-4038-9505-1bea9b299fed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:23.842653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793856-a681-4038-9505-1bea9b299fed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:23.842925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793856-a681-4038-9505-1bea9b299fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:23.869336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9f793856-a681-4038-9505-1bea9b299fed None None] MFA Rules not processed for user `c33f2e03ba4742118232857ee7d48ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:23.870537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9f793856-a681-4038-9505-1bea9b299fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:23.935383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2945/5920] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:23.946324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:23.948716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:24.012555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349809-7f77-4539-92c5-2b4a217b9f5d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:24.016210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:24.017022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:24.017284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:24.017550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:24.026529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:24.027979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4b23b-f972-4f7e-9d6d-440f701181a7 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:24.036823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2976/5921] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:24.460181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f793856-a681-4038-9505-1bea9b299fed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:24.525124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f793856-a681-4038-9505-1bea9b299fed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:24.532725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:24.533768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:24.534059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:24.534335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] PATH_INFO: `/v3/users/c33f2e03ba4742118232857ee7d48ab1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:24.535684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33f2e03ba4742118232857ee7d48ab1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:24.537887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:24.593040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33f2e03ba4742118232857ee7d48ab1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:24.602950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33f2e03ba4742118232857ee7d48ab1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:24.603526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33f2e03ba4742118232857ee7d48ab1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:24.604899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33f2e03ba4742118232857ee7d48ab1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:24.615376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33f2e03ba4742118232857ee7d48ab1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:24.642695 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2946/5922] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:24 2021] DELETE /identity/v3/users/c33f2e03ba4742118232857ee7d48ab1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:24.647355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:24.647826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:24.647914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:24.664907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:24.666093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:24.727674 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2977/5923] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:24.738410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:24.739893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:24.809901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7594d0-8213-4c25-a8fa-a7d6126e612e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:24.813993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:24.814624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:24.814909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:24.815178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:24.825469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:24.826927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773276-1838-414f-823f-38576c4bee55 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:24.837554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2947/5924] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:25.120952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.122717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:25.134832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0c72-c2a4-4817-b3ae-a1b0305473c5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.139952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.140846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.141126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.141395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] PATH_INFO: `/v3/projects/6ccd791c57f74314a42db37535e1c576` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.143286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccd791c57f74314a42db37535e1c576)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.145449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.194538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccd791c57f74314a42db37535e1c576', 'request_id': 'req-cb8fe84b-08c6-495e-a814-d37d4524f448'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:25.200413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccd791c57f74314a42db37535e1c576', 'request_id': 'req-cb8fe84b-08c6-495e-a814-d37d4524f448'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:25.207692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccd791c57f74314a42db37535e1c576', 'request_id': 'req-cb8fe84b-08c6-495e-a814-d37d4524f448'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:25.220497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] The token cache is being invalidate because project 6ccd791c57f74314a42db37535e1c576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:25.220691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:25.221305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb8fe84b-08c6-495e-a814-d37d4524f448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:25.228348 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2978/5925] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:25 2021] DELETE /identity/v3/projects/6ccd791c57f74314a42db37535e1c576 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:25.234309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.234597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.234873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.253384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:25.254965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:25.324653 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2948/5926] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:25.332978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.333259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.333696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.355463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:25.357250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:25.366363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2979/5927] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:25.370604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.382559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce7b8b-fb32-487e-9064-9c59d1cd2089 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.388246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.389231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.389511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.389786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.390646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:25.391085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.392653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.408686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2949/5928] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:25.410126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.420995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60090263-fbfb-4851-9ab7-e89ecbc0845d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.429968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.430859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.431201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.431536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.432389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.434347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.466646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2980/5929] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:25 2021] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:25.470550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.481485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57deeb8-d65b-49f7-bfaf-83eb77aaf43f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.539387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.540057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.540338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.540660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.541345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.543259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.566599 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2950/5930] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:25 2021] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:25.568012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.578775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61df8-e084-4703-93a2-a8ba14022d30 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.583644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.584513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.584818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.585199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.586028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.587617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.598398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2981/5931] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:25.602405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.612455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656cd76-4623-4912-bb6d-f964c0af8339 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.617002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.617653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.617933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.618204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.618932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.621057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679f6f3-5d6e-4111-b4d8-ebb33e6ef82c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.634081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2951/5932] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:25.635129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.645962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06829d3-ce36-4cea-b092-8f0bef6c44a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.651009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.652016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.652357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.652884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] PATH_INFO: `/v3/projects/cbdbd72d42e849bd8272f287debc7ffe/users/794b2e21fad146e2934b086296318fb8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.680651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdbd72d42e849bd8272f287debc7ffe, user_id=794b2e21fad146e2934b086296318fb8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.686853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.712600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2982/5933] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:25 2021] PUT /identity/v3/projects/cbdbd72d42e849bd8272f287debc7ffe/users/794b2e21fad146e2934b086296318fb8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:25.720760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.721047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.721319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.751285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] MFA Rules not processed for user `794b2e21fad146e2934b086296318fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:25.752730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:25.836266 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2952/5934] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:25 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:25.847259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:25.849113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:25.910786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440f62-8cad-48bc-8081-2ceee7fc9fb8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:25.914376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:25.915015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:25.915292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:25.915565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:25.924268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:25.925711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a43d9-cb3f-4480-ba3b-7f399c609f17 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:25.935055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2983/5935] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:25 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:27.943213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:27.944874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:28.012255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39295942-1024-4b74-ab53-0ed6baf5fa01 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:28.017446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:28.018356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:28.018643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:28.019006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] PATH_INFO: `/v3/users/181b80962fdd4a8da809a44ba7e02fe7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:28.020444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=181b80962fdd4a8da809a44ba7e02fe7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:28.022689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:28.088244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181b80962fdd4a8da809a44ba7e02fe7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:28.097455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181b80962fdd4a8da809a44ba7e02fe7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:28.098982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181b80962fdd4a8da809a44ba7e02fe7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:28.099702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181b80962fdd4a8da809a44ba7e02fe7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:28.114800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181b80962fdd4a8da809a44ba7e02fe7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:28.134518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2953/5936] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:27 2021] DELETE /identity/v3/users/181b80962fdd4a8da809a44ba7e02fe7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:28.140077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:28.141095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:28.141451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:28.159312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:28.160661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:28.263126 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2984/5937] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:28.288567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:28.290128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:28.389341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6810b-7a7c-4841-8136-5f134738b58f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:28.393623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:28.394942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:28.395574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:28.396240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:28.411245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:28.413629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5f54-9708-46e0-9e20-f56bc39cd1c2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:28.433950 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2954/5938] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:28.931233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:28.933303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:28.947839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8d9b-10dd-4919-a4df-b6a534f0f91b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:28.956979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:28.957851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:28.958128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:28.958401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] PATH_INFO: `/v3/projects/46474dbd2edc4efc97078c5be41d5c33` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:28.961300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46474dbd2edc4efc97078c5be41d5c33)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:28.963385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.029676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46474dbd2edc4efc97078c5be41d5c33', 'request_id': 'req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:29.036511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46474dbd2edc4efc97078c5be41d5c33', 'request_id': 'req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:29.052078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46474dbd2edc4efc97078c5be41d5c33', 'request_id': 'req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:29.068297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] The token cache is being invalidate because project 46474dbd2edc4efc97078c5be41d5c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:29.068918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:29.069644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e6f676d-f1cc-45b6-baac-b76f15ef3ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:29.072657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2985/5939] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:28 2021] DELETE /identity/v3/projects/46474dbd2edc4efc97078c5be41d5c33 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:29.077630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.078122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.078291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.099897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:29.101172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:29.166296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2955/5940] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:29.174921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.175382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.175526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.196101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:29.197170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:29.206373 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2986/5941] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:29.210482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.220341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db06ffd-0a2f-49fc-861e-31adb35cfe50 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.225238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.225935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.226216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.226495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.227243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:29.227547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.229771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.242723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2956/5942] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:29.247660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.258712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277b19-e3ec-46ec-a981-47d78c25f2a5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.264120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.264814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.265746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.266033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.267093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.269234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.301993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2987/5943] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:29 2021] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:29.306072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.317526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51ea7-159d-4874-a4e6-277652211908 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.384086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.385385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.386286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.386676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.387492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.389673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.443004 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2957/5944] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:29 2021] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:29.446643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.459814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b343-3a35-4cc1-8712-eea82feae8f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.465825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.466791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.467256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.467710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.468660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.470491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.483914 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2988/5945] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:29 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:29.487863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.502748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86a2a-b8ef-4a7b-9c01-4749af96e8eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.509539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.510576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.510957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.511337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.512395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.514146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10628e7f-1eb4-4b3a-a51e-2bbbb982eb09 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.536475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2958/5946] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:29 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:29.540430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.552850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5360f-9a2c-42fe-a7af-dacfc0ca2952 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.575988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.577462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.577743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.578016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] PATH_INFO: `/v3/projects/5d1f6b5153824fa8b43159c4a0da3017/users/f071c20a1c31423bbbfadae645b1f4cf/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.607517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1f6b5153824fa8b43159c4a0da3017, user_id=f071c20a1c31423bbbfadae645b1f4cf, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.611735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.646192 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2989/5947] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:29 2021] PUT /identity/v3/projects/5d1f6b5153824fa8b43159c4a0da3017/users/f071c20a1c31423bbbfadae645b1f4cf/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:29.657697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.657988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.658270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.693700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] MFA Rules not processed for user `f071c20a1c31423bbbfadae645b1f4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:29.695020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:29.772346 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2959/5948] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:29.783348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.785513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:29.862954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a4c4-9790-4f53-896d-aeff00ce80e9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.866606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.867241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.867518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.867786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.876100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.877541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603d36-a5b7-4070-83d5-85bfaaf6344e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:29.886797 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2990/5949] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:29 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:29.900601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:29.961255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607465a-d26b-4239-a112-2fd306ff4c71 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:29.966440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:29.967297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:29.967574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:29.967845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] PATH_INFO: `/v3/users/f071c20a1c31423bbbfadae645b1f4cf` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:29.969098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f071c20a1c31423bbbfadae645b1f4cf)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:29.971014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:30.022430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f071c20a1c31423bbbfadae645b1f4cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.032144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f071c20a1c31423bbbfadae645b1f4cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.032888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f071c20a1c31423bbbfadae645b1f4cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.033521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f071c20a1c31423bbbfadae645b1f4cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.041891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f071c20a1c31423bbbfadae645b1f4cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.063228 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2960/5950] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:29 2021] DELETE /identity/v3/users/f071c20a1c31423bbbfadae645b1f4cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:30.067434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.067793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.068133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.088413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:30.089735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:30.157794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2991/5951] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:30.167357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:30.168899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:30.235938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227fae-a314-4b84-a3ad-aa6241a817fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:30.239565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:30.240212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.240514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.240821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.251885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:30.253352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72f73-bfbd-4dba-83c2-3c525b6a29c8 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:30.263507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2961/5952] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:30.545523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:30.547547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:30.560850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744db3e-ac27-4fb9-941c-7d868f10a86a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:30.565755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:30.566659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.566939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.567211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] PATH_INFO: `/v3/projects/5d1f6b5153824fa8b43159c4a0da3017` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.568472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1f6b5153824fa8b43159c4a0da3017)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:30.570715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:30.632296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1f6b5153824fa8b43159c4a0da3017', 'request_id': 'req-ada19000-8fd1-4b15-a669-e8e8cae003cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.639058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1f6b5153824fa8b43159c4a0da3017', 'request_id': 'req-ada19000-8fd1-4b15-a669-e8e8cae003cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.645992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1f6b5153824fa8b43159c4a0da3017', 'request_id': 'req-ada19000-8fd1-4b15-a669-e8e8cae003cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.660359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] The token cache is being invalidate because project 5d1f6b5153824fa8b43159c4a0da3017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:30.660667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.661335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ada19000-8fd1-4b15-a669-e8e8cae003cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:30.662895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2992/5953] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:30 2021] DELETE /identity/v3/projects/5d1f6b5153824fa8b43159c4a0da3017 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:30.669586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.669867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.670140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.689090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:30.690335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:30.756750 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2962/5954] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:30.765107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.765305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.765764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.788071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:30.789482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:30.799365 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2993/5955] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:30.803632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:30.815102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88469a6-5885-40c9-a9c8-cefc5905d325 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:30.819834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:30.820573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.820951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.821642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.822598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:30.822989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:30.824674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:30.838872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2963/5956] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:30.843822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:30.854890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f90af0-d2e4-488d-b23e-4133c1bd1d15 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:30.859711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:30.861373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.861718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.862279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.863059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:30.865260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:30.893934 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2994/5957] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:30 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:30.898132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:30.908779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ec99-acca-4a98-964b-98da8b36ffaa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:30.977087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:30.977765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:30.978043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:30.978318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:30.979628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:30.981547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.007858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2964/5958] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:30 2021] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:31.009201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.019513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724013-30f6-4693-a54f-492353956aa6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.024494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.025224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.025485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.026286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.027026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.028828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.040015 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2995/5959] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:31.044381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.055172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5803d-fae8-493d-8417-ca595ff9a6f9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.060647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.061308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.061585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.061872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.062609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.064185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6647-a909-419e-b2db-24d0a821df1d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.079721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2965/5960] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:31.081421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.091762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a07d-8352-4692-b191-9823666996ab admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.096405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.097304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.097584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.097860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] PATH_INFO: `/v3/projects/f06db6111f004dc79fac8e3e5d36e18f/users/3a078298ffaa403eb3b8563a4ca5953b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.112557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06db6111f004dc79fac8e3e5d36e18f, user_id=3a078298ffaa403eb3b8563a4ca5953b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.115303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.129428 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2996/5961] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:31 2021] PUT /identity/v3/projects/f06db6111f004dc79fac8e3e5d36e18f/users/3a078298ffaa403eb3b8563a4ca5953b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:31.140212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.140974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.141330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.170895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] MFA Rules not processed for user `3a078298ffaa403eb3b8563a4ca5953b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:31.172296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:31.237386 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2966/5962] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:31.241783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.301585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e7a0-48cb-43be-8eac-174549112148 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.306253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.306907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.307760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.308031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.308766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.310700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.336257 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2997/5963] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:31 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:31.340825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.351554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa44a-f660-459d-b042-264b0399f9fb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.407395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.408063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.408338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.408630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.409342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.411244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.434479 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2967/5964] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:31 2021] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:31.435666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.446351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0e984-5873-4c27-a1b3-77de59b5dc59 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.450928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.451582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.451859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.452434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.453261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.454979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.466905 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2998/5965] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:31.473360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.482070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb49e3b-b049-4056-aa69-3987903f9b29 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.487584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.488508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.488814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.489090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] PATH_INFO: `/v3/projects/6199ae95cbe844b9a179a61ceca44131/users/e5207e9dde5546a9bdae88168dd81fdd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.504695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6199ae95cbe844b9a179a61ceca44131, user_id=e5207e9dde5546a9bdae88168dd81fdd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.508899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.523956 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2968/5966] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:31 2021] PUT /identity/v3/projects/6199ae95cbe844b9a179a61ceca44131/users/e5207e9dde5546a9bdae88168dd81fdd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:31.528538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.538704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841b68f-28e4-49a9-84a2-cd4f459fc19c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.597450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.598312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.598596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.598971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.599830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.601543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bbd3-10a0-4aa7-8340-8277eeda8603 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.612227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 2999/5967] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:31.616878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.627254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395335-1be9-41b8-843f-b10a97595bd9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.632345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.633265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.633546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.633820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] PATH_INFO: `/v3/projects/6199ae95cbe844b9a179a61ceca44131/users/e5207e9dde5546a9bdae88168dd81fdd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.635898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6199ae95cbe844b9a179a61ceca44131, user_id=e5207e9dde5546a9bdae88168dd81fdd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.638504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.649396 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2969/5968] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:31 2021] PUT /identity/v3/projects/6199ae95cbe844b9a179a61ceca44131/users/e5207e9dde5546a9bdae88168dd81fdd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:31.661044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.661329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.661604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.688138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] MFA Rules not processed for user `e5207e9dde5546a9bdae88168dd81fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:31.689382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:31.772781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3000/5969] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:31 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:31.782547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:31.784856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:31.850742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386caf-caeb-4711-88a1-aa24e81afb7b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:31.855465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:31.856274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:31.856869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:31.857282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:31.868396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:31.870233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:31.881270 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2970/5970] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:31.987479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:32.000669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d346c-c9da-41dc-b858-d63a21f86a08 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:32.004248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:32.004949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:32.005225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:32.005495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:32.086642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:32.088073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:32.098701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3001/5971] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:31 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:34.798072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:34.849880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:34.851306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:34.866682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ed7b5-2694-493f-b46b-25a0442d2337 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:34.872102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:34.873013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:34.873291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:34.873563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] PATH_INFO: `/v3/users/3a078298ffaa403eb3b8563a4ca5953b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:34.874763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a078298ffaa403eb3b8563a4ca5953b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:34.876682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:34.917346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba548-58e7-4729-84f5-ccdd362b5e79 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:34.922083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:34.922987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:34.923387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:34.923646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] PATH_INFO: `/v3/users/794b2e21fad146e2934b086296318fb8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:34.924214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a078298ffaa403eb3b8563a4ca5953b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.924917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794b2e21fad146e2934b086296318fb8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:34.926835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:34.930848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a078298ffaa403eb3b8563a4ca5953b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.931515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a078298ffaa403eb3b8563a4ca5953b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.932175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a078298ffaa403eb3b8563a4ca5953b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.939462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-815b9771-d50c-41c4-8683-2f71fa569b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a078298ffaa403eb3b8563a4ca5953b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.959125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2971/5972] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:34 2021] DELETE /identity/v3/users/3a078298ffaa403eb3b8563a4ca5953b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:34.963771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d270-ad36-4a7c-a553-503956974692 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:34.964061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d270-ad36-4a7c-a553-503956974692 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:34.964335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d270-ad36-4a7c-a553-503956974692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:34.980636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794b2e21fad146e2934b086296318fb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.981760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b201d270-ad36-4a7c-a553-503956974692 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:34.983043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b201d270-ad36-4a7c-a553-503956974692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:34.987641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794b2e21fad146e2934b086296318fb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:34.988488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794b2e21fad146e2934b086296318fb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.001719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794b2e21fad146e2934b086296318fb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.012795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-dc7ef110-fae9-419f-86b7-0dfd534dba08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794b2e21fad146e2934b086296318fb8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.018984 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3002/5973] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:34 2021] DELETE /identity/v3/users/794b2e21fad146e2934b086296318fb8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:35.023242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.023520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.023824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.040186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:35.042065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.052664 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2972/5974] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:35.059997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201d270-ad36-4a7c-a553-503956974692 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.061318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b201d270-ad36-4a7c-a553-503956974692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.107037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3003/5975] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:35.116383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.124704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201d270-ad36-4a7c-a553-503956974692 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.170119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3499d1-da72-4d43-bcc8-b2ea1504d235 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.171828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.172522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.172835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.173114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.173816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.174444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.174715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.174982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.183165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.184575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.184831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.186239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.194034 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2973/5976] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:35.195561 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3004/5977] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:35.395577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.401916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.421226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc199a5-de01-437c-9fe4-c12895119f8b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.428533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.429553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.429832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.430107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] PATH_INFO: `/v3/projects/cbdbd72d42e849bd8272f287debc7ffe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.431378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdbd72d42e849bd8272f287debc7ffe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.434056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.491172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdbd72d42e849bd8272f287debc7ffe', 'request_id': 'req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.498415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdbd72d42e849bd8272f287debc7ffe', 'request_id': 'req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.507401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdbd72d42e849bd8272f287debc7ffe', 'request_id': 'req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.512956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.514485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.526423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] The token cache is being invalidate because project cbdbd72d42e849bd8272f287debc7ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:35.526423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.527149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8fe5e98a-c38c-4628-b031-5ccf41f2bad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.532746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2974/5978] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:35 2021] DELETE /identity/v3/projects/cbdbd72d42e849bd8272f287debc7ffe => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:35.532894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04421-b86a-42a4-a5f2-e5f0a7e1f258 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.534663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea13e0f-1023-44a2-b269-bfa1c7b06baf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.534948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea13e0f-1023-44a2-b269-bfa1c7b06baf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.535272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea13e0f-1023-44a2-b269-bfa1c7b06baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.562141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3ea13e0f-1023-44a2-b269-bfa1c7b06baf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:35.563346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ea13e0f-1023-44a2-b269-bfa1c7b06baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.599179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.600037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.601277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.601277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] PATH_INFO: `/v3/projects/f06db6111f004dc79fac8e3e5d36e18f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.602203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06db6111f004dc79fac8e3e5d36e18f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.605198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.629136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2975/5979] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:35.638458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.638743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.639018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.653111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06db6111f004dc79fac8e3e5d36e18f', 'request_id': 'req-8e6510d3-3972-455a-87a7-86a5ed61c995'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.656970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:35.658141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.658639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06db6111f004dc79fac8e3e5d36e18f', 'request_id': 'req-8e6510d3-3972-455a-87a7-86a5ed61c995'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.664777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06db6111f004dc79fac8e3e5d36e18f', 'request_id': 'req-8e6510d3-3972-455a-87a7-86a5ed61c995'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.677154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] The token cache is being invalidate because project f06db6111f004dc79fac8e3e5d36e18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:35.677440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.678098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.679623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3005/5980] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:35 2021] DELETE /identity/v3/projects/f06db6111f004dc79fac8e3e5d36e18f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:35.683415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.684744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:35.720450 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2976/5981] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:35.724579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.733579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647c97-2ac5-44ac-bc11-cad1da42d718 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.738255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.738917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.739168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.739462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.740189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:35.740487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.742079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.752190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6510d3-3972-455a-87a7-86a5ed61c995 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.756589 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2977/5982] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:16:35.757601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.758795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.759077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.759348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] PATH_INFO: `/v3/users/e5207e9dde5546a9bdae88168dd81fdd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.761409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5207e9dde5546a9bdae88168dd81fdd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.762506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.763515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.774324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7208733-9b10-4162-b1a5-4d26e007c94b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.779849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.780507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.780877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.781150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.781855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.783985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.818722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5207e9dde5546a9bdae88168dd81fdd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.819233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2978/5983] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:35 2021] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:35.820567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.827950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5207e9dde5546a9bdae88168dd81fdd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.828679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5207e9dde5546a9bdae88168dd81fdd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.844702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5207e9dde5546a9bdae88168dd81fdd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.853560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5207e9dde5546a9bdae88168dd81fdd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:35.860165 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3006/5984] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:35 2021] DELETE /identity/v3/users/e5207e9dde5546a9bdae88168dd81fdd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:35.894880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306de0-d233-4e96-8b0f-77223c4ed49e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:35.958195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:35.959092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:35.959369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:35.959636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:35.960332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:35.962260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:35.986535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2979/5985] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:35 2021] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:35.987681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:35.989212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.002040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d24d0-8967-4881-bb75-c2e4a7d89f73 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.006629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.007279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.007556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.007827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.011506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.011506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.021986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3007/5986] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:36.031695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.046913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1712f-a5ba-4321-9d9a-caff7479beb7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.052683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.053673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.054156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.054621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.055743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.059159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ff2c1-7ace-4359-8f1f-cb16260a5d29 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.075973 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2980/5987] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:36.080655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.094981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b00350-c7f3-4b67-bd42-d39b97622498 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.099831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.100855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.101201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.101561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] PATH_INFO: `/v3/projects/bc6b1134706148cbb354177984fec26c/users/46a37302f4fc4799abe0c16d76d4ca14/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.123661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6b1134706148cbb354177984fec26c, user_id=46a37302f4fc4799abe0c16d76d4ca14, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.126442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.143105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3008/5988] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:36 2021] PUT /identity/v3/projects/bc6b1134706148cbb354177984fec26c/users/46a37302f4fc4799abe0c16d76d4ca14/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:36.149919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.150100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.150613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.175480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:36.176861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.189039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.191327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.239035 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2981/5989] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:36.249659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.251163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.262823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc36202-de1a-4503-b46f-ea7f72b6ac3a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.269067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.269977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.270251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.270519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] PATH_INFO: `/v3/projects/6199ae95cbe844b9a179a61ceca44131` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.271699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6199ae95cbe844b9a179a61ceca44131)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.273599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.309845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8403f-23ac-45ad-a43b-fc07247f1798 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.318441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6199ae95cbe844b9a179a61ceca44131', 'request_id': 'req-74fce67d-57f8-41f9-99ac-ddeb236556c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:36.324850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6199ae95cbe844b9a179a61ceca44131', 'request_id': 'req-74fce67d-57f8-41f9-99ac-ddeb236556c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:36.331012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6199ae95cbe844b9a179a61ceca44131', 'request_id': 'req-74fce67d-57f8-41f9-99ac-ddeb236556c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:36.343452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] The token cache is being invalidate because project 6199ae95cbe844b9a179a61ceca44131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:36.343899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:36.344553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74fce67d-57f8-41f9-99ac-ddeb236556c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:36.346184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3009/5990] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:36 2021] DELETE /identity/v3/projects/6199ae95cbe844b9a179a61ceca44131 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:36.351559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338507c-cb39-40cb-818e-2807ac293294 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.351843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338507c-cb39-40cb-818e-2807ac293294 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.352114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338507c-cb39-40cb-818e-2807ac293294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.358903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.360917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.361194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.361465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.363340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.370488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a338507c-cb39-40cb-818e-2807ac293294 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:36.371828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a338507c-cb39-40cb-818e-2807ac293294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.423951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.425400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.428644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3010/5991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:36.436135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2982/5992] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:36.437218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.437578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.437925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.456130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:36.457487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.465922 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3011/5993] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:36.470657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.483310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3991f-f061-43fd-8d4b-fc98d91e81c6 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.490766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.491442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.491727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.492000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.492936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:36.493110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.495356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.511642 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2983/5994] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:36.513009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.523808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba834bf-3b5a-40c4-9adc-aaf34a4b122e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.529371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.530152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.530417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.530691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.531413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.533321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.576290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3012/5995] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:36.578057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.590265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a90f-657d-48d0-b1a0-53efcaba10f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.651812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.652653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.653061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.653166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.654057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.655807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.677246 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2984/5996] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:36.681059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.691848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164dcaa-0393-4d2d-9613-f5028d723785 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.696880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.697598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.697891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.698251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.698858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.700443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.711265 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3013/5997] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:36.715959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.726087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589652-482e-427e-bb40-67694219c30d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.731268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.731925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.732205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.732480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.733251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.734819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f9ff3-ad10-4db8-827d-99364b3c09b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.746086 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2985/5998] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:36.752102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.766737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6e7-0e25-45e0-b7e7-1f98a6442d74 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:36.773452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:36.774503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.774722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.775011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] PATH_INFO: `/v3/projects/dac8c622c5e44556b123f0c76f41e8c2/users/5726a431e6ec4dcc90bae2ec9cd07bd2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.793712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac8c622c5e44556b123f0c76f41e8c2, user_id=5726a431e6ec4dcc90bae2ec9cd07bd2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:36.796399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:36.835627 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3014/5999] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:36 2021] PUT /identity/v3/projects/dac8c622c5e44556b123f0c76f41e8c2/users/5726a431e6ec4dcc90bae2ec9cd07bd2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:36.841342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fe02-ac62-4152-b81a-eb6e4624bb04 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:36.841793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fe02-ac62-4152-b81a-eb6e4624bb04 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:36.842024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fe02-ac62-4152-b81a-eb6e4624bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:36.863649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5e88fe02-ac62-4152-b81a-eb6e4624bb04 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:36.865102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5e88fe02-ac62-4152-b81a-eb6e4624bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:36.928789 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2986/6000] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:36.938696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:36.940397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:37.001305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c78cd-56bd-4267-9069-8788a85e8e2a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.006085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.007037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.007500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.007955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.018947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.020400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.032018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3015/6001] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:37.130440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.131408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.131696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.163651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] MFA Rules not processed for user `46a37302f4fc4799abe0c16d76d4ca14`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:37.164985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:37.245394 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2987/6002] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:37 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:37.249488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.252180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:37.266617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572f1d-bc9d-44d8-97f2-e9c8ac3c3c44 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.276263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.277262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.277751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.278169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.278936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.280941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.310362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3016/6003] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:37 2021] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:37.314226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.326710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636024-0681-49bc-8c14-8c0d6062d815 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.389416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.390262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.390545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.390819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.391539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.393470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.418913 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2988/6004] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:37 2021] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:37.420774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.430873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79194d40-2bf8-4420-b84f-1b067c65f346 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.435701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.436459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.436772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.437126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.438033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.439686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.461509 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3017/6005] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:37.462822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.474528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20ff2-1fa0-40a6-8d7c-abd4c6ab5600 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.479082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.479956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.480227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.480678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] PATH_INFO: `/v3/projects/943998130bbb48df9661e24833579981/users/a8780e76d4494c5c91a5aa16a8753b69/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.502348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943998130bbb48df9661e24833579981, user_id=a8780e76d4494c5c91a5aa16a8753b69, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.504982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.524210 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2989/6006] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:37 2021] PUT /identity/v3/projects/943998130bbb48df9661e24833579981/users/a8780e76d4494c5c91a5aa16a8753b69/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:37.529095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.543003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eef75-6bf5-4371-bec3-de220e3b9202 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.626752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.627602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.627973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.628346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.629201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.631567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcd00b-b335-4718-b0f7-a98736a0e191 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.642825 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3018/6007] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:37.646843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:37.658390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138533-b7c0-422d-90de-d865270dca37 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:37.663982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:37.665000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:37.665353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:37.665697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] PATH_INFO: `/v3/projects/943998130bbb48df9661e24833579981/users/a8780e76d4494c5c91a5aa16a8753b69/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:37.667870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] RBAC: Authorizing `identity:create_grant(project_id=943998130bbb48df9661e24833579981, user_id=a8780e76d4494c5c91a5aa16a8753b69, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:37.671183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:37.682815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2990/6008] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:37 2021] PUT /identity/v3/projects/943998130bbb48df9661e24833579981/users/a8780e76d4494c5c91a5aa16a8753b69/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:38.594641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b8af-d582-45f0-a1f5-98101c09dc12 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:38.595146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b8af-d582-45f0-a1f5-98101c09dc12 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:38.595263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b8af-d582-45f0-a1f5-98101c09dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:38.623905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d8a6b8af-d582-45f0-a1f5-98101c09dc12 None None] MFA Rules not processed for user `5726a431e6ec4dcc90bae2ec9cd07bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:38.625696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d8a6b8af-d582-45f0-a1f5-98101c09dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:38.696526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3019/6009] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:38 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:38.701118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:38.782913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa406cc-ecda-4125-8133-91600ec9824b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:38.789677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:38.790880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:38.791751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:38.792157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:38.793095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:38.795543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:38.858963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:38.859275 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2991/6010] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:38 2021] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:38.861007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:38.861578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:38.863005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:38.891517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] MFA Rules not processed for user `a8780e76d4494c5c91a5aa16a8753b69`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:38.893119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:38.944669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a22738-39c8-4ee4-a4ce-478d8843725d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:38.952772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:38.953607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:38.954435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:38.954714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:38.955427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:38.958769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:38.978086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3020/6011] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:38 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:38.986859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2992/6012] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:38 2021] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:38.990329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:39.007587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8e3b6-8974-4637-bba2-a66807e34605 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:39.012761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:39.013505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:39.013786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:39.014058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:39.014790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:39.016546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:39.031582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3021/6013] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:38 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:39.035246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:39.047943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54076bf3-a619-4498-bfe2-7af2425d8d65 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:39.053094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:39.054134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:39.054512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:39.054798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] PATH_INFO: `/v3/projects/0200cbe944aa4a1eb45231a99d411fcc/users/a2ca2d206ec64e71a9191a37f0dbc855/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:39.070822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0200cbe944aa4a1eb45231a99d411fcc, user_id=a2ca2d206ec64e71a9191a37f0dbc855, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:39.073518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:39.089571 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2993/6014] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:39 2021] PUT /identity/v3/projects/0200cbe944aa4a1eb45231a99d411fcc/users/a2ca2d206ec64e71a9191a37f0dbc855/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:39.093656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:39.103480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21804d7-24c2-4a3c-9b6b-49f10020c199 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:39.160562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:39.161271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:39.161550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:39.161820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:39.162555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:39.164115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05129b-5c9e-4720-963f-6897f2bb00c8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:39.175436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3022/6015] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:39.179629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:39.190453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf8663-2c52-417b-a201-1a7d339daeca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:39.195281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:39.196166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:39.196523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:39.196779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] PATH_INFO: `/v3/projects/0200cbe944aa4a1eb45231a99d411fcc/users/a2ca2d206ec64e71a9191a37f0dbc855/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:39.198824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0200cbe944aa4a1eb45231a99d411fcc, user_id=a2ca2d206ec64e71a9191a37f0dbc855, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:39.201485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09b1ab-abc0-4188-9d85-7ed1f2228334 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:39.212291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2994/6016] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:39 2021] PUT /identity/v3/projects/0200cbe944aa4a1eb45231a99d411fcc/users/a2ca2d206ec64e71a9191a37f0dbc855/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:40.136455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:40.137038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:40.137325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:40.179197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] MFA Rules not processed for user `a2ca2d206ec64e71a9191a37f0dbc855`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:40.180701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:40.265713 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3023/6017] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:40 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:40.276134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:40.278583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:40.278939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:40.298775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] MFA Rules not processed for user `5726a431e6ec4dcc90bae2ec9cd07bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:40.299983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:40.356644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:40.364276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2995/6018] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:40 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:40.381133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:40.382601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:40.437220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784effa-c64a-416b-afeb-6116fc5f1fe9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:40.443583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:40.444960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:40.445245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:40.445522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] PATH_INFO: `/v3/users/46a37302f4fc4799abe0c16d76d4ca14` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:40.446995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a37302f4fc4799abe0c16d76d4ca14)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:40.449018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:40.464156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30c11-0bc3-4b27-801b-f011808ee627 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:40.470516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:40.471182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:40.471676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:40.471936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:40.482593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:40.484204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:40.493969 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2996/6019] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:40 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:40.506781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a37302f4fc4799abe0c16d76d4ca14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:40.513608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a37302f4fc4799abe0c16d76d4ca14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:40.514364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a37302f4fc4799abe0c16d76d4ca14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:40.527121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a37302f4fc4799abe0c16d76d4ca14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:40.535184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a37302f4fc4799abe0c16d76d4ca14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:40.542599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3024/6020] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:40 2021] DELETE /identity/v3/users/46a37302f4fc4799abe0c16d76d4ca14 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:40.893921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:40.905785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e128-d129-426e-913a-ffe062a470c1 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:40.974891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:40.975735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:40.976011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:40.976284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] PATH_INFO: `/v3/projects/bc6b1134706148cbb354177984fec26c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:40.977495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6b1134706148cbb354177984fec26c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:40.979452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.026918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6b1134706148cbb354177984fec26c', 'request_id': 'req-8091d212-a9c6-47ef-adcd-0ce40ddb4349'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.033086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6b1134706148cbb354177984fec26c', 'request_id': 'req-8091d212-a9c6-47ef-adcd-0ce40ddb4349'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.040173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6b1134706148cbb354177984fec26c', 'request_id': 'req-8091d212-a9c6-47ef-adcd-0ce40ddb4349'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.053709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] The token cache is being invalidate because project bc6b1134706148cbb354177984fec26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:41.054172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.054850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.056488 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2997/6021] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:40 2021] DELETE /identity/v3/projects/bc6b1134706148cbb354177984fec26c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:41.060730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.062240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:41.075933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d1b2f-bb77-485f-99a8-976b12de897c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.133643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.134544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.135401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.135678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] PATH_INFO: `/v3/users/a8780e76d4494c5c91a5aa16a8753b69` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.136935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8780e76d4494c5c91a5aa16a8753b69)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.138853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.189000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8780e76d4494c5c91a5aa16a8753b69'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.194525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8780e76d4494c5c91a5aa16a8753b69'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.195399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8780e76d4494c5c91a5aa16a8753b69'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.209210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8780e76d4494c5c91a5aa16a8753b69'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.218879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e78766b-079a-4d0d-8a12-0184ac093ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8780e76d4494c5c91a5aa16a8753b69'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.225419 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3025/6022] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:41 2021] DELETE /identity/v3/users/a8780e76d4494c5c91a5aa16a8753b69 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:41.402593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.404030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:41.418799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091d212-a9c6-47ef-adcd-0ce40ddb4349 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.499349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.501888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.501888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.501888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] PATH_INFO: `/v3/projects/943998130bbb48df9661e24833579981` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.502384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943998130bbb48df9661e24833579981)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.504375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.561234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943998130bbb48df9661e24833579981', 'request_id': 'req-439e39e9-44e7-44b4-9767-01feda0b12e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.567122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943998130bbb48df9661e24833579981', 'request_id': 'req-439e39e9-44e7-44b4-9767-01feda0b12e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.573837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943998130bbb48df9661e24833579981', 'request_id': 'req-439e39e9-44e7-44b4-9767-01feda0b12e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.590018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] The token cache is being invalidate because project 943998130bbb48df9661e24833579981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:41.590584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.591534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-439e39e9-44e7-44b4-9767-01feda0b12e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:41.593138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2998/6023] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:41 2021] DELETE /identity/v3/projects/943998130bbb48df9661e24833579981 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:41.600819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.601378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.601835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.630387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:41.631791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:41.692791 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3026/6024] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:41.700807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.701095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.701372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.727895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:41.729482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:41.740395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 2999/6025] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:41.745080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.760348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e44a-7c4a-4926-9ac2-ac83b96450b3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.765438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.766166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.766451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.766838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.767467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:41.767773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.769996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.783051 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3027/6026] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:41.787600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.797216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6736d3-07ca-4c40-8f53-123f387752c8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.802811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.803349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.803647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.803927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.804678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.806588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.834419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3000/6027] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:41 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:41.839226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.849134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6cb76-b931-4f09-840c-c563abcd9e11 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.905182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.905887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.906168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.906433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.907129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.909036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.931425 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3028/6028] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:41 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:41.935525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.946470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5875-ddad-4aca-bb59-281524913789 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.952119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.953064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.953342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.953611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.954343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.955900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.967085 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3001/6029] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:41.971019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:41.980962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ac04-7b90-4d32-93a5-45b1401350a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:41.985487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:41.986129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:41.986407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:41.986677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:41.987394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:41.989016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac4da3-e838-42ae-b337-165073bf87b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:41.998639 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3029/6030] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:42.002462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.012648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344813cf-cdfe-42cb-aaa8-d53d372f5543 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.017192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.018062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.018346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.018621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] PATH_INFO: `/v3/projects/340d893fd41a45a3b7c69dbefb6dc480/users/00c0ec71ad2b47bd832a0cb8cd718bf3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.034226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340d893fd41a45a3b7c69dbefb6dc480, user_id=00c0ec71ad2b47bd832a0cb8cd718bf3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.036946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.049531 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3002/6031] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:42 2021] PUT /identity/v3/projects/340d893fd41a45a3b7c69dbefb6dc480/users/00c0ec71ad2b47bd832a0cb8cd718bf3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:42.061094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.061386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.061664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.089025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] MFA Rules not processed for user `00c0ec71ad2b47bd832a0cb8cd718bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:42.090268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:42.155487 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3030/6032] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:42.159683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.240114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b58e-35b7-403c-b1ed-4751cebf8527 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.249130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.250092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.250514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.250941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.251806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.254192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.294396 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3003/6033] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:42 2021] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:42.296074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.309557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63cec-faa6-4351-8f00-730bea2aa67d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.368898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.370249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.370533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.370806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.371514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.373464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.397418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3031/6034] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:42 2021] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:42.398664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.409283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffe1b-cce2-4610-b58c-25104fb3edec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.413962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.414634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.414914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.415190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.416463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.418085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.432953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3004/6035] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:42.434573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.444782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8966-acb9-4799-9b0c-cd1413872aaa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.449980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.450860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.451161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.451430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] PATH_INFO: `/v3/projects/82abf090ca5b475b877f20f1503f848e/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.467836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82abf090ca5b475b877f20f1503f848e, user_id=8ddce9b2ef5b4d14bdec4f2d32b6e22f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.470572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.484939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3032/6036] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:42 2021] PUT /identity/v3/projects/82abf090ca5b475b877f20f1503f848e/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:42.489056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.499445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697c0a-0e09-439c-8903-9e80f209be25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.559537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.560434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.560924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.561357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.562094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.563864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa862-2f2b-4311-8d20-a9b2399adb35 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.578686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3005/6037] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:42.579810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.593607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77477c-7f4e-4950-8015-b2fd00fc9366 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.598522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.599490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.599925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.600262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] PATH_INFO: `/v3/projects/82abf090ca5b475b877f20f1503f848e/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.602447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82abf090ca5b475b877f20f1503f848e, user_id=8ddce9b2ef5b4d14bdec4f2d32b6e22f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.605691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.626791 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3033/6038] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:42 2021] PUT /identity/v3/projects/82abf090ca5b475b877f20f1503f848e/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:42.636806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.637098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.637368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.666983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] MFA Rules not processed for user `8ddce9b2ef5b4d14bdec4f2d32b6e22f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:42.668187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:42.753527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3006/6039] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:42.763885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.765841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:42.823396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6f0d-9a1b-4833-aee1-e492d40e4e4c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.833357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.834017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.834297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.834570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.844557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.846025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf22e-a596-4c76-8551-259153c7443f service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:42.856211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3034/6040] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:42 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:42.919228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:42.983253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c63a-c7e5-48d4-b398-daede63d04ff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:42.988432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:42.989521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:42.989996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:42.990318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] PATH_INFO: `/v3/users/00c0ec71ad2b47bd832a0cb8cd718bf3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:42.991833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c0ec71ad2b47bd832a0cb8cd718bf3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:42.993973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:43.051908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c0ec71ad2b47bd832a0cb8cd718bf3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.058490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c0ec71ad2b47bd832a0cb8cd718bf3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.059148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c0ec71ad2b47bd832a0cb8cd718bf3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.059766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c0ec71ad2b47bd832a0cb8cd718bf3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.066919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c0ec71ad2b47bd832a0cb8cd718bf3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.085733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3007/6041] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:42 2021] DELETE /identity/v3/users/00c0ec71ad2b47bd832a0cb8cd718bf3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:43.090780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:43.091071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:43.091348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:43.109916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:43.111200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:43.174157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3035/6042] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:43.185018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:43.186443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:43.253119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7265-a1b3-42fe-9e14-3b2cd2b9f362 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:43.253119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:43.253119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:43.253119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:43.253459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:43.262327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:43.263759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:43.274184 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3008/6043] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:43.593282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:43.595844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:43.634071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10931a-36f9-4cc2-9b01-9b7dc87ee6c9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:43.643700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:43.644778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:43.645059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:43.645383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] PATH_INFO: `/v3/projects/340d893fd41a45a3b7c69dbefb6dc480` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:43.647075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340d893fd41a45a3b7c69dbefb6dc480)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:43.649366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:43.715862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340d893fd41a45a3b7c69dbefb6dc480', 'request_id': 'req-93b61daf-7498-442e-9297-e9761993fa68'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.728284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340d893fd41a45a3b7c69dbefb6dc480', 'request_id': 'req-93b61daf-7498-442e-9297-e9761993fa68'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.739464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340d893fd41a45a3b7c69dbefb6dc480', 'request_id': 'req-93b61daf-7498-442e-9297-e9761993fa68'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.758134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] The token cache is being invalidate because project 340d893fd41a45a3b7c69dbefb6dc480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:43.758565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.759309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.762439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3036/6044] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:43 2021] DELETE /identity/v3/projects/340d893fd41a45a3b7c69dbefb6dc480 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:43.766635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:43.777820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec027-a51a-4d6b-9969-a5ba11404733 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:43.843291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:43.844164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:43.844439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:43.844747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] PATH_INFO: `/v3/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:43.846022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddce9b2ef5b4d14bdec4f2d32b6e22f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:43.847914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:43.899874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddce9b2ef5b4d14bdec4f2d32b6e22f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.908898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddce9b2ef5b4d14bdec4f2d32b6e22f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.910346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddce9b2ef5b4d14bdec4f2d32b6e22f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.910965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddce9b2ef5b4d14bdec4f2d32b6e22f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.925642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96a8ec84-3285-45ad-8197-a8a30d2fe988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddce9b2ef5b4d14bdec4f2d32b6e22f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:43.945486 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3009/6045] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:43 2021] DELETE /identity/v3/users/8ddce9b2ef5b4d14bdec4f2d32b6e22f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:44.217729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.219362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:44.249073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61daf-7498-442e-9297-e9761993fa68 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.308487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.309410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.309685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.309978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] PATH_INFO: `/v3/projects/82abf090ca5b475b877f20f1503f848e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.311196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82abf090ca5b475b877f20f1503f848e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.313165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.366595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82abf090ca5b475b877f20f1503f848e', 'request_id': 'req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:44.372330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82abf090ca5b475b877f20f1503f848e', 'request_id': 'req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:44.379088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82abf090ca5b475b877f20f1503f848e', 'request_id': 'req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:44.396332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] The token cache is being invalidate because project 82abf090ca5b475b877f20f1503f848e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:44.396880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:44.397539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f762fbd-63fd-49f0-a6a5-65a2b3b959b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:44.399082 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3037/6046] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:44 2021] DELETE /identity/v3/projects/82abf090ca5b475b877f20f1503f848e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:44.405507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.405800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.406073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.439095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:44.439095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:44.492787 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3010/6047] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:44.500389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.500695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.501060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.518951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:44.520152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:44.528876 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3038/6048] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:44.533254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.543487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755143-ad61-41f9-aeca-3f2b201d3c92 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.548071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.548807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.549178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.549359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.550089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:44.550389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.551958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.567029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3011/6049] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:44.568167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.577893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc4a04-60fd-4399-a774-cadbd0f162e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.582598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.583271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.583617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.583887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.584648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.586511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.613824 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3039/6050] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:44.618162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.628867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5d4fc-cce5-4b63-8653-e7113d399236 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.683899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.684562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.684885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.685160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.685882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.687795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.713802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3012/6051] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:44.714987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.728684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e953b-078e-4ab1-adab-75f0fa3f412a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.736988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.737827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.738340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.738619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.739450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.741236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.756648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3040/6052] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:44.760378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.774214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2916d9-e992-449b-b37d-9d31a19f3f61 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.779611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.780299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.780578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.780890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.781928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.783210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8cdc-73fa-4c85-a427-35d5ca1e4405 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.793503 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3013/6053] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:44.797432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:44.813506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f3f8-6ba9-4f77-b0f1-49aa929a2993 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:44.819009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:44.820165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.820322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.820653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] PATH_INFO: `/v3/projects/215f9787f505417c9bb36344fdd9845c/users/489dec3278cb42f898e3fd510d5e65a7/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.852005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215f9787f505417c9bb36344fdd9845c, user_id=489dec3278cb42f898e3fd510d5e65a7, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:44.854687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:44.872406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3041/6054] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:44 2021] PUT /identity/v3/projects/215f9787f505417c9bb36344fdd9845c/users/489dec3278cb42f898e3fd510d5e65a7/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:44.883506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:44.885194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:44.885646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:44.915305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] MFA Rules not processed for user `489dec3278cb42f898e3fd510d5e65a7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:44.916634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:44.981870 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3014/6055] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:44.986522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.053661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5e56-d0d8-4adf-8729-62613341ed33 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.059137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.059795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.060072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.060347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.061089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.062959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.098706 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3042/6056] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:44 2021] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:45.099827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.110281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64268b-57a5-459a-8eea-2eb8e026ea7b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.166036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.166702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.166981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.167253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.167949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.169852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.191887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3015/6057] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:45 2021] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:45.193151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.204143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516cdf-2a6b-441d-bdd9-5c38fa8ca00d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.208762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.209394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.209675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.209954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.210656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.212220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.222616 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3043/6058] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:45.226645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.236455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800b6d9-556d-47bc-ab01-29cae32b31bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.241105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.242114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.242394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.242666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] PATH_INFO: `/v3/projects/1758fab713fa44f0a9e774aa81c061e1/users/c7f448c685de46f59f15e144779378b5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.258664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1758fab713fa44f0a9e774aa81c061e1, user_id=c7f448c685de46f59f15e144779378b5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.261891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.274928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3016/6059] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:45 2021] PUT /identity/v3/projects/1758fab713fa44f0a9e774aa81c061e1/users/c7f448c685de46f59f15e144779378b5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:45.278890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.288556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154fb56-30b2-4643-a3e4-c69109b0c2ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.365615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.366293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.366566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.366830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.368309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.370524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a456e-6054-4410-98a9-24c311687f93 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.381149 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3044/6060] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:45 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:45.386677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.407749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f1c7-19bd-4f29-bee2-9c19d4d4b6eb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.415086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.416355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.416788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.417243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] PATH_INFO: `/v3/projects/1758fab713fa44f0a9e774aa81c061e1/users/c7f448c685de46f59f15e144779378b5/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.420231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1758fab713fa44f0a9e774aa81c061e1, user_id=c7f448c685de46f59f15e144779378b5, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.423146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.437721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3017/6061] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:45 2021] PUT /identity/v3/projects/1758fab713fa44f0a9e774aa81c061e1/users/c7f448c685de46f59f15e144779378b5/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:45.448807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.449166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.449512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.483313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] MFA Rules not processed for user `c7f448c685de46f59f15e144779378b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:45.484563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:45.565275 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3045/6062] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:45.586477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:45.588193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:45.646520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c14d-483f-4603-aae5-c6c1923febd8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:45.650208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:45.650840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:45.651119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:45.651390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:45.660215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:45.661607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:45.671434 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3018/6063] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:45 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:46.000081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.009271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bbc78-5ec4-4487-9ad1-294aae6e8b78 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.013884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f448c685de46f59f15e144779378b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1758fab713fa44f0a9e774aa81c061e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.014527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.014807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.015081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.015806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:46.016116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.017736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.029872 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3046/6064] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:46.033740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.043152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44cd7d-1aa9-4e6f-b1cc-4329b544b1fe service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.047691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f448c685de46f59f15e144779378b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1758fab713fa44f0a9e774aa81c061e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.048375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.048671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.048952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.049659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.051544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.077104 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3019/6065] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:46 2021] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:46.081461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.092052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71edba8-04de-425d-82ae-331f68dad5f8 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.144870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f448c685de46f59f15e144779378b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1758fab713fa44f0a9e774aa81c061e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.145533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.145809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.146081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.146810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:46.147179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.149064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.161610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3047/6066] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:46.195894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.207096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4bdea-ccc5-4d16-afa9-d687b8334731 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.211822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f448c685de46f59f15e144779378b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1758fab713fa44f0a9e774aa81c061e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.212708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.213516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.213788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] PATH_INFO: `/v3/projects/6607dc5f01e544769af9259f7a0e7a19` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.215001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6607dc5f01e544769af9259f7a0e7a19)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.216904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.263738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6607dc5f01e544769af9259f7a0e7a19', 'request_id': 'req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.269175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6607dc5f01e544769af9259f7a0e7a19', 'request_id': 'req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.276511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6607dc5f01e544769af9259f7a0e7a19', 'request_id': 'req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.288480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] The token cache is being invalidate because project 6607dc5f01e544769af9259f7a0e7a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:46.288795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.289423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-181e9b3f-d882-4b23-bcf1-ab26dc7bbce2 tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.291019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3020/6067] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:46 2021] DELETE /identity/v3/projects/6607dc5f01e544769af9259f7a0e7a19 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:46.479866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.481727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:46.544901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6254d90-1adb-4377-8967-1ddba79391af tempest-VolumeQuotaClassesTest-155112799 tempest-VolumeQuotaClassesTest-155112799-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.600053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.601187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.601465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.601744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] PATH_INFO: `/v3/users/489dec3278cb42f898e3fd510d5e65a7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.602959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=489dec3278cb42f898e3fd510d5e65a7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.604993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.652417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489dec3278cb42f898e3fd510d5e65a7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.659113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489dec3278cb42f898e3fd510d5e65a7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.659778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489dec3278cb42f898e3fd510d5e65a7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.671392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489dec3278cb42f898e3fd510d5e65a7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.678680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489dec3278cb42f898e3fd510d5e65a7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:46.685668 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3048/6068] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:46 2021] DELETE /identity/v3/users/489dec3278cb42f898e3fd510d5e65a7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:46.690761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.691048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.691316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.709483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:46.710846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:46.773226 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3021/6069] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:46.783884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:46.785302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:46.843855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ae5a-e47d-4212-9ce7-b2586b5d4c65 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:46.847702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:46.848513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:46.848827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:46.849105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:46.859067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:46.860595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:46.870887 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3049/6070] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:47.137500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:47.138907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:47.155451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680cd09-6c92-4711-a08c-5bbe39c249bd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:47.160285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:47.161263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.161445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.161720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] PATH_INFO: `/v3/projects/215f9787f505417c9bb36344fdd9845c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.162912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215f9787f505417c9bb36344fdd9845c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:47.164832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:47.210762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215f9787f505417c9bb36344fdd9845c', 'request_id': 'req-447cd0ae-0dfa-4418-ba9d-9f09de4af407'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.215896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215f9787f505417c9bb36344fdd9845c', 'request_id': 'req-447cd0ae-0dfa-4418-ba9d-9f09de4af407'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.222002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215f9787f505417c9bb36344fdd9845c', 'request_id': 'req-447cd0ae-0dfa-4418-ba9d-9f09de4af407'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.234337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] The token cache is being invalidate because project 215f9787f505417c9bb36344fdd9845c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:47.234669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.235283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.236872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3022/6071] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:47 2021] DELETE /identity/v3/projects/215f9787f505417c9bb36344fdd9845c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:47.240930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:47.251155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e93a-9764-494c-a1db-79761e6b5a69 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:47.306765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:47.307621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.307896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.308166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] PATH_INFO: `/v3/users/c7f448c685de46f59f15e144779378b5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.309479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f448c685de46f59f15e144779378b5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:47.311439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:47.357956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f448c685de46f59f15e144779378b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.364799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f448c685de46f59f15e144779378b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.365466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f448c685de46f59f15e144779378b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.377028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f448c685de46f59f15e144779378b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.385168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f5a96d3-f0db-4f79-9dc0-c6bcd1e5c2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f448c685de46f59f15e144779378b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.391330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3050/6072] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:47 2021] DELETE /identity/v3/users/c7f448c685de46f59f15e144779378b5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:47.657413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:47.658832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:47.672929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd0ae-0dfa-4418-ba9d-9f09de4af407 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:47.727349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:47.728198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.728500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.728806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] PATH_INFO: `/v3/projects/1758fab713fa44f0a9e774aa81c061e1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.730000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1758fab713fa44f0a9e774aa81c061e1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:47.731863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:47.778589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1758fab713fa44f0a9e774aa81c061e1', 'request_id': 'req-f779e387-6add-4780-8f19-88d894452098'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.783755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1758fab713fa44f0a9e774aa81c061e1', 'request_id': 'req-f779e387-6add-4780-8f19-88d894452098'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.789852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1758fab713fa44f0a9e774aa81c061e1', 'request_id': 'req-f779e387-6add-4780-8f19-88d894452098'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.801313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] The token cache is being invalidate because project 1758fab713fa44f0a9e774aa81c061e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:47.801600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.802226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f779e387-6add-4780-8f19-88d894452098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:47.809239 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3023/6073] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:47 2021] DELETE /identity/v3/projects/1758fab713fa44f0a9e774aa81c061e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:47.810818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.811245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.811362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.829501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:47.830700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:47.889126 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3051/6074] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:47.897140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.897450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.897727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.921970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:47.923251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:47.934898 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3024/6075] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:47.939783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:47.955364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee12550-ba2c-4edd-9cf8-fc1179402b2b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:47.960989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:47.961878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:47.962212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:47.962493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:47.964309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:47.964645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:47.966310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:47.983069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3052/6076] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:16:47.986665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:47.998654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467183bd-c0f1-48b1-9a12-83facd92aa71 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.005017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.005809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.006184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.006553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.007345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.010012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.051085 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3025/6077] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:47 2021] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:48.055308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.067154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02da5-b125-4881-a7b6-7cc78eee740f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.132344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.133051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.133334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.133609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.134322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.136602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.161132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3053/6078] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:48 2021] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:48.163122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.179018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baeb14-4012-4c56-ae29-d60d04eef135 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.184074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.185017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.185309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.185581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.190128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.192260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.204937 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3026/6079] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:48.209354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.221935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e970f-f9da-437d-ad32-a1e176818234 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.227779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.229055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.229966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.230239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.231434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.233124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653bd8-d0e6-491c-a395-c53787852368 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.244797 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3054/6080] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:48.249045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.259948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868433f3-1859-40b5-8d14-f292ede763f9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.267018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.267917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.268191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.268460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] PATH_INFO: `/v3/projects/6928d06e60864741add16260cd032208/users/7944520656514721b13b560f8b1032a5/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.296805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928d06e60864741add16260cd032208, user_id=7944520656514721b13b560f8b1032a5, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.299383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.317739 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3027/6081] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:48 2021] PUT /identity/v3/projects/6928d06e60864741add16260cd032208/users/7944520656514721b13b560f8b1032a5/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:48.329205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.329484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.329758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.363825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] MFA Rules not processed for user `7944520656514721b13b560f8b1032a5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:48.366693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:48.436467 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3055/6082] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:48 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:48.441173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.517336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01cf-e994-4153-8a0f-ecca149e4093 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.522098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.522754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.523032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.523304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.524009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.526509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.553469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3028/6083] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:48 2021] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:48.557019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.568050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb367c0-5770-4c55-af5b-122fc236fea6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.627829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.628500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.628838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.629108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.629818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.631695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.652099 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3056/6084] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:48 2021] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:48.656156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.666775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685303-06f2-459d-b0e4-67e8dd1072e4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.671743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.672401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.672710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.672987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.673712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.675278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.690454 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3029/6085] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:48.691645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.702453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce4a6-a351-4461-adf7-5b9c4207891e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.707057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.707932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.708212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.708486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] PATH_INFO: `/v3/projects/d0e103ece11742659a447a0fdef96c22/users/7efec002421d4076abca2b63eb5e57f1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.723316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e103ece11742659a447a0fdef96c22, user_id=7efec002421d4076abca2b63eb5e57f1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.725958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.739093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3057/6086] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:48 2021] PUT /identity/v3/projects/d0e103ece11742659a447a0fdef96c22/users/7efec002421d4076abca2b63eb5e57f1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:48.743152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.754414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e9fe-56d7-4786-ba79-da1977e92ea1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.810241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.810830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.811111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.811386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.812120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.813719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c147fab-2602-42f2-94e1-4bdea585f34b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.824000 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3030/6087] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:48.828406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.839169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eaeec-5972-44fb-ae8c-db5b9b6561dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:48.843820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:48.844719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.845001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.845274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] PATH_INFO: `/v3/projects/d0e103ece11742659a447a0fdef96c22/users/7efec002421d4076abca2b63eb5e57f1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.847263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e103ece11742659a447a0fdef96c22, user_id=7efec002421d4076abca2b63eb5e57f1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:48.849891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:48.860812 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3058/6088] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:48 2021] PUT /identity/v3/projects/d0e103ece11742659a447a0fdef96c22/users/7efec002421d4076abca2b63eb5e57f1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:48.870765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:48.871050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:48.871328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:48.898135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] MFA Rules not processed for user `7efec002421d4076abca2b63eb5e57f1`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:48.899339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:48.966452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3031/6089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:48 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:48.976241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:48.978079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:49.037279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355c2c-6c5d-416a-b886-8bc9b01cc049 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:49.042994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:49.043670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:49.043953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:49.044229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:49.055053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:49.057653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:49.067617 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3059/6090] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:48 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:49.164866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:49.168401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:49.189813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f89e8f-5c61-4a42-8711-04b804c3b696 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:49.194608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:49.195488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:49.195974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:49.196673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:49.300006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:49.301483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf3a1d-b80f-4e8c-b9b3-2645008e56c3 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:49.312053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3032/6091] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:49 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:53.751167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:53.834627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a23f7-37fc-4e9b-b4b5-9adc49511bec service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:53.839875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:53.840771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:53.841049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:53.841521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] PATH_INFO: `/v3/users/7944520656514721b13b560f8b1032a5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:53.842721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7944520656514721b13b560f8b1032a5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:53.844629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:53.899714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7944520656514721b13b560f8b1032a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:53.907006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7944520656514721b13b560f8b1032a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:53.908048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7944520656514721b13b560f8b1032a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:53.921221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7944520656514721b13b560f8b1032a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:53.933336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7944520656514721b13b560f8b1032a5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:53.943251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3060/6092] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:53 2021] DELETE /identity/v3/users/7944520656514721b13b560f8b1032a5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:53.947080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:53.947725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:53.947806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:53.968132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:53.969371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.056897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.058264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.060651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3033/6093] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:54.068749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.070487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.125139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c88af-2212-442a-97c8-4c5655466ea3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:54.130055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:54.130912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.131263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.131612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:54.133678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.137224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844de6-20b0-4fae-9a24-18ec9671bc63 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:54.147195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:54.148666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.149220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.149468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:54.172094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:54.173985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:54.194225 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3034/6094] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:16:54.215344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:54.215344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:54.226355 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3061/6095] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:54 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:54.253839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.255356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.275571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd3d9-ab8b-47cf-9082-c0f41ea147e1 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:54.284062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:54.285553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.286062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.286399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] PATH_INFO: `/v3/users/2b67e06516e746ceb504984154c8ef11` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:54.287876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b67e06516e746ceb504984154c8ef11)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:54.290367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:54.368931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b67e06516e746ceb504984154c8ef11'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.381763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b67e06516e746ceb504984154c8ef11'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.383278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b67e06516e746ceb504984154c8ef11'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.384212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b67e06516e746ceb504984154c8ef11'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.396786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b67e06516e746ceb504984154c8ef11'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.429820 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3035/6096] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:54 2021] DELETE /identity/v3/users/2b67e06516e746ceb504984154c8ef11 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:54.669362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.671191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.695978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddc89-1a3c-4ad6-82ac-75e42275e7a9 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:54.799054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:54.799624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.800115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.800484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.800896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] PATH_INFO: `/v3/projects/6928d06e60864741add16260cd032208` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:54.807058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6928d06e60864741add16260cd032208)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:54.807471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.809675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:54.845238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd200b-b9cb-4b6d-8f10-355b4421e9f3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:54.855452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:54.858107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.859462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.859749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] PATH_INFO: `/v3/projects/26827b5258ad40dfae9a961a5dda3346` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:54.862219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26827b5258ad40dfae9a961a5dda3346)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:54.864153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:54.879049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6928d06e60864741add16260cd032208', 'request_id': 'req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.885517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6928d06e60864741add16260cd032208', 'request_id': 'req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.894617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6928d06e60864741add16260cd032208', 'request_id': 'req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.917677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] The token cache is being invalidate because project 6928d06e60864741add16260cd032208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:54.918183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.919048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.921287 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3062/6097] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:54 2021] DELETE /identity/v3/projects/6928d06e60864741add16260cd032208 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:54.925133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:54.926692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:54.931216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26827b5258ad40dfae9a961a5dda3346', 'request_id': 'req-156464e3-8903-44e9-a97f-badddbf02864'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.939551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26827b5258ad40dfae9a961a5dda3346', 'request_id': 'req-156464e3-8903-44e9-a97f-badddbf02864'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.949635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26827b5258ad40dfae9a961a5dda3346', 'request_id': 'req-156464e3-8903-44e9-a97f-badddbf02864'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.983839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] The token cache is being invalidate because project 26827b5258ad40dfae9a961a5dda3346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:54.985215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.986661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-156464e3-8903-44e9-a97f-badddbf02864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:54.988977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3036/6098] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:54 2021] DELETE /identity/v3/projects/26827b5258ad40dfae9a961a5dda3346 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:54.996658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176dea-c72d-4966-b95b-e0c8a01a5a5f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:54.996962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176dea-c72d-4966-b95b-e0c8a01a5a5f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:54.997214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176dea-c72d-4966-b95b-e0c8a01a5a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.019662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ff27-0062-4e1a-bed9-a0a423f1afe9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.032343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-53176dea-c72d-4966-b95b-e0c8a01a5a5f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:55.033938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53176dea-c72d-4966-b95b-e0c8a01a5a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.093749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.095044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.095728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.095728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] PATH_INFO: `/v3/users/7efec002421d4076abca2b63eb5e57f1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.096967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efec002421d4076abca2b63eb5e57f1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.099728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.127827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3037/6099] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:55.143863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.144134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.147168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.167252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efec002421d4076abca2b63eb5e57f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.175605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efec002421d4076abca2b63eb5e57f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.176515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efec002421d4076abca2b63eb5e57f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.176832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:55.178181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.190280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3038/6100] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:55.191420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efec002421d4076abca2b63eb5e57f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.194554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.202907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efec002421d4076abca2b63eb5e57f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.205874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bac65-b573-4768-9608-2dac21b60df9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.210722 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3063/6101] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:16:54 2021] DELETE /identity/v3/users/7efec002421d4076abca2b63eb5e57f1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:55.214334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.214334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.214334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.214334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.214666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:55.214666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.215692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.228246 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3039/6102] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:16:55.233434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.234183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.309949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7fce8-7313-4899-a61e-b0f1f6ae6fbf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.315516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.316324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.317012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.317325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.318347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.320386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.350600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3064/6103] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:55.354635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.365775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000691a6-19dd-469b-84ee-7bd33a87b17b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.421785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.422531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.422813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.423199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.424022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.426228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.446077 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3040/6104] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:55.450698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.461414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9bddd-a817-4cbc-9223-3c3c30a925d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.466884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.467540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.467816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.468086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.468860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.470450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.483988 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3065/6105] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:55.485711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.495464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.496631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f889c1-cab5-4445-b819-cdeedfb41fd0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.497719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.501661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.502324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.503337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.503620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.504740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.506347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.512831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db26b28-eb87-400f-a631-14bd8fd2d414 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.518126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.519329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.519796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.520380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] PATH_INFO: `/v3/projects/d0e103ece11742659a447a0fdef96c22` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.521848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e103ece11742659a447a0fdef96c22)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.521990 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3041/6106] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:55.524369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.526206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.536090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087f0f-5234-4fc8-9588-ef0bbcfe414b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.541100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.541974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.542280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.542555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] PATH_INFO: `/v3/projects/8e88284f9ef743c7bd4c0df26719a5ec/users/45ec13d633804480abc8eb86e9f072cb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.559950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e88284f9ef743c7bd4c0df26719a5ec, user_id=45ec13d633804480abc8eb86e9f072cb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.562710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ab1f-62af-430c-b649-55acbc4e0f55 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.573636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e103ece11742659a447a0fdef96c22', 'request_id': 'req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.576422 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3042/6107] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:55 2021] PUT /identity/v3/projects/8e88284f9ef743c7bd4c0df26719a5ec/users/45ec13d633804480abc8eb86e9f072cb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:55.579180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e103ece11742659a447a0fdef96c22', 'request_id': 'req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.582001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.582278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.582547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.585660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e103ece11742659a447a0fdef96c22', 'request_id': 'req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.598086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] The token cache is being invalidate because project d0e103ece11742659a447a0fdef96c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:16:55.598369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.598981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d2f8e24-0730-430a-8ce7-9b3837b9ed48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:16:55.599369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:55.600541 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3066/6108] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:16:55 2021] DELETE /identity/v3/projects/d0e103ece11742659a447a0fdef96c22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:55.600732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.606181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffd0-a496-4770-aa78-cc552b96fc0d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.606457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffd0-a496-4770-aa78-cc552b96fc0d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.606841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffd0-a496-4770-aa78-cc552b96fc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.625917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c998ffd0-a496-4770-aa78-cc552b96fc0d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:55.627114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c998ffd0-a496-4770-aa78-cc552b96fc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.662180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3043/6109] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:55.671823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.673774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.704698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3067/6110] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:55.713426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.713711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.713997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.733458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:55.734644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:55.742457 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3068/6111] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:16:55.744636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865abb6-1e60-4639-b174-b7d81662a7a0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.747343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.749715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.750586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.750909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.751351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.756597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db160e-d7d2-4bf6-becb-0acbba1c3b98 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.761687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.762320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.762596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.762867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.763591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:16:55.763886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.764006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.765503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.766110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.780433 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3069/6112] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:16:55.780631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3044/6113] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:55.781425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.791139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d847-81b1-482c-a6b4-14e11a4ed4ce admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.795809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.796447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.796772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.797049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.797739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.799611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.829130 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3070/6114] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:55.833220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.844164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1405-4bad-4a33-ab7c-b5638952a589 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.903538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.904235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.904514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.904817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.905523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.907569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.930133 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3045/6115] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:55 2021] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:55.931334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.942895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06fb26-e548-4aad-9233-eba0b4a61db0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.950726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.951820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.951820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.952132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.952973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.954545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.965526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3071/6116] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:55.969407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:55.979681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596641b8-b5b8-4f72-885c-00d595810454 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:55.994461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:55.994461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:55.994461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:55.994461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:55.994800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:55.994800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5d1d9-0e53-4cec-b7a0-73efa5e86c95 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:55.998615 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3046/6117] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:16:56.002760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.013676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69603-3599-475b-9758-5bf371d51423 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.019067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.020010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.020298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.020853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] PATH_INFO: `/v3/projects/45fad32e8e174d6fb68f4194d876f3f1/users/e41104ed714744aebd5aecb1a64f14c0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.037942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fad32e8e174d6fb68f4194d876f3f1, user_id=e41104ed714744aebd5aecb1a64f14c0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.040715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.055932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3072/6118] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:56 2021] PUT /identity/v3/projects/45fad32e8e174d6fb68f4194d876f3f1/users/e41104ed714744aebd5aecb1a64f14c0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:56.066993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.067281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.067570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.110307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] MFA Rules not processed for user `e41104ed714744aebd5aecb1a64f14c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:56.111604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.209703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3047/6119] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:56.214631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.293994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53d8dc-7b4d-4d1b-adce-3c2a88269f04 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.299780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.300447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.300765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.301049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.301756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.303694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.331362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3073/6120] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:16:56.335715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.347657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ded09-a2c8-44dd-b4fc-ca508b22080b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.413033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.413712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.413991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.414270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.415000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.416987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.441049 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3048/6121] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:16:56.442217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.454055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93a40-0940-44ad-afc4-40cfa7493472 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.458996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.459680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.459955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.460224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.460979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.463109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.483400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3074/6122] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:56 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:56.484896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.495098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea220a1-0731-4b53-a21b-2151d21393bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.500091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.500973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.501248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.501522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] PATH_INFO: `/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23/users/0c18b3e382c34f8fb53b97cbfd6179c9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.516411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb313dbe0ed41c4bd966d98dc34ca23, user_id=0c18b3e382c34f8fb53b97cbfd6179c9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.519056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acca464-6108-4027-b428-8ee5e9493f80 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.536462 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3049/6123] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:56 2021] PUT /identity/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23/users/0c18b3e382c34f8fb53b97cbfd6179c9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:16:56.541166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.552619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d14e13-3122-499d-bb7c-de3a73d38f9e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.575081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecee7-d00d-4d57-b1fe-e0235bf69804 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.575899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecee7-d00d-4d57-b1fe-e0235bf69804 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.576332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecee7-d00d-4d57-b1fe-e0235bf69804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.618067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d60ecee7-d00d-4d57-b1fe-e0235bf69804 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:56.619456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d60ecee7-d00d-4d57-b1fe-e0235bf69804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.620769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.621466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.621729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.622002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.622794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.624377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.636426 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3075/6124] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:16:56 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:16:56.640257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.651811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2867d2-7ff5-497b-a730-7a10a5383575 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.660654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.661634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.662096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.662596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] PATH_INFO: `/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23/users/0c18b3e382c34f8fb53b97cbfd6179c9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.665215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb313dbe0ed41c4bd966d98dc34ca23, user_id=0c18b3e382c34f8fb53b97cbfd6179c9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.667967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f34914-43ad-492a-8567-6203b4d55750 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.680645 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3076/6125] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:16:56 2021] PUT /identity/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23/users/0c18b3e382c34f8fb53b97cbfd6179c9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:16:56.691116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.691399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.691726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.750361 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3050/6126] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:56.763443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.764758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.765035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.772960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] MFA Rules not processed for user `0c18b3e382c34f8fb53b97cbfd6179c9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:56.775658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.798092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:16:56.809938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.876404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3077/6127] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:56.888920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.890515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.916896 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3051/6128] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:16:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:16:56.925986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:56.928366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:16:56.966971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bd1e-28ef-4d32-ac4d-49d87e7738a2 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:56.972413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:56.973196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:56.973551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:56.973890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:56.984099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:56.985671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:56.996132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3078/6129] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:56 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:57.010657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae2971-40bc-45ee-bdab-2965dba4e8e5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:57.017674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:57.018331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:57.018607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:57.018858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:57.029055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:57.035999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:57.043032 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3052/6130] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:56 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:16:57.081391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:16:57.093584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2e6b6-79df-478f-80db-e18217220a96 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:16:57.099182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:16:57.099979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:16:57.100359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:16:57.100555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:16:57.173733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:16:57.175069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:16:57.184621 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3079/6131] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:16:57 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:01.107570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:01.122327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43c1f-43c5-46dd-844b-ca7cbb5a8cfa service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:01.132758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:01.133937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:01.135257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:01.135574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:01.138366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:01.238066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:01.242171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d1730-5ec7-4659-a96f-dbb83954146a service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:01.268154 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3053/6132] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:01 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:02.191020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:02.250762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351694-7e07-49a8-baba-c25e7701cd85 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:02.255332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:02.256182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:02.256463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:02.256770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] PATH_INFO: `/v3/users/e41104ed714744aebd5aecb1a64f14c0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:02.257954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41104ed714744aebd5aecb1a64f14c0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:02.260445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:02.303598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41104ed714744aebd5aecb1a64f14c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.311042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41104ed714744aebd5aecb1a64f14c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.311723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41104ed714744aebd5aecb1a64f14c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.323774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41104ed714744aebd5aecb1a64f14c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.330969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41104ed714744aebd5aecb1a64f14c0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.336979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3080/6133] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:02 2021] DELETE /identity/v3/users/e41104ed714744aebd5aecb1a64f14c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:02.341537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:02.341988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:02.342160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:02.359005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:02.360193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:02.418732 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3054/6134] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:02.428770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:02.430216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:02.488307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274681-0a80-483a-a75e-f2651ba02556 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:02.492088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:02.493012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:02.493168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:02.493940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:02.505228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:02.507097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:02.519435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3081/6135] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:02.834069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:02.836381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:02.848401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdf669-8e11-438b-8717-351601a33e23 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:02.853748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:02.854573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:02.855248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:02.855689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] PATH_INFO: `/v3/projects/45fad32e8e174d6fb68f4194d876f3f1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:02.856944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fad32e8e174d6fb68f4194d876f3f1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:02.858969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:02.908824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fad32e8e174d6fb68f4194d876f3f1', 'request_id': 'req-641594f5-ec56-4d0e-a404-6f806ca9a9c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.914038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fad32e8e174d6fb68f4194d876f3f1', 'request_id': 'req-641594f5-ec56-4d0e-a404-6f806ca9a9c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.921295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fad32e8e174d6fb68f4194d876f3f1', 'request_id': 'req-641594f5-ec56-4d0e-a404-6f806ca9a9c1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.933620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] The token cache is being invalidate because project 45fad32e8e174d6fb68f4194d876f3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:02.933905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.934531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:02.936072 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3055/6136] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:02 2021] DELETE /identity/v3/projects/45fad32e8e174d6fb68f4194d876f3f1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:02.940049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:02.950096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ef44-8ec5-4723-a11d-b613d9cf1921 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.007444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.008307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.008585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.008885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] PATH_INFO: `/v3/users/0c18b3e382c34f8fb53b97cbfd6179c9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.010117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c18b3e382c34f8fb53b97cbfd6179c9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.011960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.057819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c18b3e382c34f8fb53b97cbfd6179c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.064267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c18b3e382c34f8fb53b97cbfd6179c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.064945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c18b3e382c34f8fb53b97cbfd6179c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.076128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c18b3e382c34f8fb53b97cbfd6179c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.083345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d67dad39-5964-49b3-8237-86a1c9b5c550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c18b3e382c34f8fb53b97cbfd6179c9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.089954 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3082/6137] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:02 2021] DELETE /identity/v3/users/0c18b3e382c34f8fb53b97cbfd6179c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:03.389309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.390765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:03.406742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641594f5-ec56-4d0e-a404-6f806ca9a9c1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.475690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.476881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.477139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.477449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] PATH_INFO: `/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.478966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb313dbe0ed41c4bd966d98dc34ca23)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.481046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.548525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb313dbe0ed41c4bd966d98dc34ca23', 'request_id': 'req-14112345-a4c2-44b0-9f43-5b455ae52866'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.554334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb313dbe0ed41c4bd966d98dc34ca23', 'request_id': 'req-14112345-a4c2-44b0-9f43-5b455ae52866'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.561054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb313dbe0ed41c4bd966d98dc34ca23', 'request_id': 'req-14112345-a4c2-44b0-9f43-5b455ae52866'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.574868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] The token cache is being invalidate because project beb313dbe0ed41c4bd966d98dc34ca23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:03.575219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.575792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-14112345-a4c2-44b0-9f43-5b455ae52866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:03.577886 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3056/6138] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:03 2021] DELETE /identity/v3/projects/beb313dbe0ed41c4bd966d98dc34ca23 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:03.585184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.585686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.585912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.606811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:03.608393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:03.673170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3083/6139] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:03.681028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e716-0214-407f-9051-72c44b042163 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.681322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e716-0214-407f-9051-72c44b042163 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.681599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e716-0214-407f-9051-72c44b042163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.701268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4a78e716-0214-407f-9051-72c44b042163 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:03.702735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a78e716-0214-407f-9051-72c44b042163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:03.710949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3057/6140] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:03.715786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.725511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198895e-3faa-46d3-b7fd-0bd176c5dc2d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.730463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.731106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.731380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.731647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.732368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:03.732700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.734314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.746511 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3084/6141] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:03.751356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e716-0214-407f-9051-72c44b042163 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.761510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e716-0214-407f-9051-72c44b042163 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.766129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.766780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.767060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.767335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.768040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.769966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.798940 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3058/6142] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:03 2021] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:03.805522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.817176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be933-4866-40b6-b185-50af46fb0f50 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.887713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.888549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.888950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.889336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.890204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.892153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.912206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3085/6143] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:03 2021] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:03.916346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.927782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af895f-8f63-4bae-b996-06a7c755881d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.933569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.934345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.934508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.934779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.935514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.937189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.951500 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3059/6144] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:17:03.952987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:03.965939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5389c-e8e5-442e-8b80-a0a18b24f213 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:03.973327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:03.974012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:03.974294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:03.974571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:03.975310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:03.976932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de90b-5f0a-4796-af54-d5b76d20774d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:03.993211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3086/6145] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:03.995509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:04.008207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053391b-605d-4926-89ed-6a5c54bcf6b2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:04.013949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:04.015132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.015592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.016032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] PATH_INFO: `/v3/projects/f4afe2470c234e5bb94a41ae53879844/users/10820857cecc431ab6f61c0621768bf7/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.045296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4afe2470c234e5bb94a41ae53879844, user_id=10820857cecc431ab6f61c0621768bf7, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:04.048999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:04.076751 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3060/6146] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:03 2021] PUT /identity/v3/projects/f4afe2470c234e5bb94a41ae53879844/users/10820857cecc431ab6f61c0621768bf7/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:04.087378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.087772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.088047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.119676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] MFA Rules not processed for user `10820857cecc431ab6f61c0621768bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:04.120967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:04.201298 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3087/6147] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:04 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:04.230211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:04.232163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:04.315887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab7151-22f5-428f-86dc-a450a370a8b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:04.320322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:04.321004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.321939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.322225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.331067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:04.332573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf6fd-d96a-4c50-9430-3f405f3a9681 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:04.341383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3061/6148] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:04 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:04.356395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:04.419916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6dc4-0453-4ebd-89d0-3dee2c2a23a6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:04.424540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:04.425430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.425715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.425984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] PATH_INFO: `/v3/users/10820857cecc431ab6f61c0621768bf7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.427394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10820857cecc431ab6f61c0621768bf7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:04.429908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:04.510756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10820857cecc431ab6f61c0621768bf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:04.538925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10820857cecc431ab6f61c0621768bf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:04.541115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10820857cecc431ab6f61c0621768bf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:04.562166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10820857cecc431ab6f61c0621768bf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:04.573237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10820857cecc431ab6f61c0621768bf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:04.586743 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3088/6149] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:04 2021] DELETE /identity/v3/users/10820857cecc431ab6f61c0621768bf7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:04.591500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.591921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.592106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.609594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:04.610801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:04.670944 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3062/6150] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:04.681857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:04.683550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:04.751234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab699d0-5cb1-401a-8ac3-b3f0dd69de5c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:04.755346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:04.756065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:04.756348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:04.756645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:04.766635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:04.767999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638bdb8-a9dd-4ba3-98bc-2b536a0998d9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:04.777250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3089/6151] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:17:05.063271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.064871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:05.080815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ed49-1fe3-405a-9082-3b6ae987a2be None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.085872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.087373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.087657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.087951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] PATH_INFO: `/v3/projects/f4afe2470c234e5bb94a41ae53879844` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.089303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4afe2470c234e5bb94a41ae53879844)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.091188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.151377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4afe2470c234e5bb94a41ae53879844', 'request_id': 'req-eff3524c-62a3-4d62-829f-66e844d2b431'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:05.157625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4afe2470c234e5bb94a41ae53879844', 'request_id': 'req-eff3524c-62a3-4d62-829f-66e844d2b431'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:05.167137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4afe2470c234e5bb94a41ae53879844', 'request_id': 'req-eff3524c-62a3-4d62-829f-66e844d2b431'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:05.182869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] The token cache is being invalidate because project f4afe2470c234e5bb94a41ae53879844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:05.183260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:05.184058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-eff3524c-62a3-4d62-829f-66e844d2b431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:05.185785 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3063/6152] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:05 2021] DELETE /identity/v3/projects/f4afe2470c234e5bb94a41ae53879844 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:05.192131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.192704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.192832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.212365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:05.213706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:05.283470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3090/6153] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:05.286562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.286850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.287129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.307839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:05.309081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:05.317838 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3064/6154] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:05.322322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.332514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ebfa9-5a29-4ae4-ba25-53e3ec01a3b6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.337750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.338404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.338689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.338960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.339695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:05.340000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.341626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.354052 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3091/6155] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:05.358438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.368087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ccc07-3c1a-4922-824f-0c4f14e8d18f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.373071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.373756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.374174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.374453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.375178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.377259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.408099 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3065/6156] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:05 2021] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:05.409259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.420561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659abff-ab60-4c9d-a09f-5acb83020b0e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.480028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.480767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.481046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.481317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.482018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.483953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.505746 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3092/6157] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:05 2021] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:17:05.506931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.517210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f77d-5e0b-48d2-a7b1-7f332dc52d90 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.521894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.522639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.522919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.523192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.523923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.526066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.539529 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3066/6158] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:05.541422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.551675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acdd2f-e953-42c4-8ad6-73c96e4cc159 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.556924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.557601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.557879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.558174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.558880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.560883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23771f91-11b5-4645-b9f0-175e9280c66b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.571880 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3093/6159] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:17:05.575838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.588089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808295af-83dc-42bd-9aa6-366852f078e7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.593992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.594965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.595443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.595718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] PATH_INFO: `/v3/projects/13258b52b4254a4dbfb61a71094668c9/users/3a6732c9dee4449580a1e7248988f91d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.612866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13258b52b4254a4dbfb61a71094668c9, user_id=3a6732c9dee4449580a1e7248988f91d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.615843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.640905 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3067/6160] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:05 2021] PUT /identity/v3/projects/13258b52b4254a4dbfb61a71094668c9/users/3a6732c9dee4449580a1e7248988f91d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:05.651118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ffd97-bbe5-477a-8eb5-d2dc8d1f4455 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.651629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ffd97-bbe5-477a-8eb5-d2dc8d1f4455 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.651811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ffd97-bbe5-477a-8eb5-d2dc8d1f4455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.681086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a57ffd97-bbe5-477a-8eb5-d2dc8d1f4455 None None] MFA Rules not processed for user `3a6732c9dee4449580a1e7248988f91d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:05.682298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a57ffd97-bbe5-477a-8eb5-d2dc8d1f4455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:05.750113 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3094/6161] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:05 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:05.763692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:05.766260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:05.837986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac217a0-a2b7-49dd-935a-e56afe370793 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:05.841892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:05.842538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:05.842819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:05.843092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:05.852084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:05.853575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c30f-d1ed-413d-83a6-74d0298b8a9f service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:05.863048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3068/6162] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:05 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:06.617806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:06.618093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:06.618944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:06.635906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:06.637137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:06.692451 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3095/6163] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:06 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:07.795355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461502-a747-4187-a1fb-e447cd762401 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:07.795905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461502-a747-4187-a1fb-e447cd762401 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:07.795905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461502-a747-4187-a1fb-e447cd762401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:07.829892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-36461502-a747-4187-a1fb-e447cd762401 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:07.831120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-36461502-a747-4187-a1fb-e447cd762401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:07.891412 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3069/6164] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:11.127937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:11.129382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:11.209587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36461502-a747-4187-a1fb-e447cd762401 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:11.211235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-36461502-a747-4187-a1fb-e447cd762401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:11.226146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36461502-a747-4187-a1fb-e447cd762401 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:11.231012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:11.231980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099cdd5-2f6d-468b-8025-a24e24d58da1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:11.232196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:11.232743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:11.233221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:11.235497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:11.239872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:11.240536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:11.240908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:11.241186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:11.249283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:11.324212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:11.325793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:11.344820 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3070/6165] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:17:11.384877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:11.386332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:11.402586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3096/6166] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:11.668059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:11.683540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febf30d-144a-41db-b307-26a0b5a43eb0 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:11.690787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:11.691775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:11.692258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:11.692789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:11.703216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:11.880148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:11.881645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee11c37-f555-48fd-8e39-96c06abd7899 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:11.909413 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3071/6167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:14.468930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:14.541462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa7a8-6136-495a-8bb8-d693cc57aa5a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:14.546769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:14.547656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:14.548113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:14.548539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] PATH_INFO: `/v3/users/3a6732c9dee4449580a1e7248988f91d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:14.550006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6732c9dee4449580a1e7248988f91d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:14.552102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:14.609502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6732c9dee4449580a1e7248988f91d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:14.616705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6732c9dee4449580a1e7248988f91d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:14.617577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6732c9dee4449580a1e7248988f91d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:14.629868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6732c9dee4449580a1e7248988f91d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:14.642241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6732c9dee4449580a1e7248988f91d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:14.650124 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3097/6168] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:14 2021] DELETE /identity/v3/users/3a6732c9dee4449580a1e7248988f91d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:14.654756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:14.655251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:14.655342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:14.672886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:14.674404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:14.745574 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3072/6169] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:14.756809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:14.759431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:14.826729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661c3e6-4a73-4ebc-9f6e-68f99e249515 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:14.830807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:14.831458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:14.831824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:14.832104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:14.844879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:14.846581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cebd8-0a10-4aac-bcd1-cb3ce97c6161 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:14.856955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3098/6170] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:15.270128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.274628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:15.288093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818842bb-0a25-486d-beb4-79124f44f8c5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.293290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.294454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.295005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.295486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] PATH_INFO: `/v3/projects/13258b52b4254a4dbfb61a71094668c9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.297045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13258b52b4254a4dbfb61a71094668c9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.299169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.362119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13258b52b4254a4dbfb61a71094668c9', 'request_id': 'req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.368843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13258b52b4254a4dbfb61a71094668c9', 'request_id': 'req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.375063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13258b52b4254a4dbfb61a71094668c9', 'request_id': 'req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.397769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] The token cache is being invalidate because project 13258b52b4254a4dbfb61a71094668c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:15.397992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.401554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a5c1cd20-d7d4-4f7e-ace8-8369adb11d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.403366 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3073/6171] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:15 2021] DELETE /identity/v3/projects/13258b52b4254a4dbfb61a71094668c9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:15.409638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.410090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.410547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.445412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:15.446923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:15.519966 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3099/6172] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:15.527840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.528051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.528650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.549127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:15.550670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:15.564764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.571753 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3074/6173] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:15.577788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7957e7b-58f3-4e81-a38e-f0eb892b0b2f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.584865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.585536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.585814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.586085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.587341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:15.587651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.589308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.607941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3100/6174] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:15.609904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.623041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7dfa5-a04c-4cfc-8c10-60687b666c44 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.633637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.634311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.634657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.634916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.635850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.637950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.665651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3075/6175] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:15 2021] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:15.669996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.683837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a884895-5718-4781-9773-0b69a884d870 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.701379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.704047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:15.759617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.760280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.760566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.760884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.761621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.763665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.778158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4bd-bec4-416f-a567-f0c91ca35aaf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.784972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.786182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.786500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.786896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] PATH_INFO: `/v3/users/5726a431e6ec4dcc90bae2ec9cd07bd2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.788845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5726a431e6ec4dcc90bae2ec9cd07bd2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.791572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.792944 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3101/6176] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:15 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:15.798506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.816101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60cc6-7e83-4ce6-8fde-23a1cfd1a750 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.824720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.825535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.826058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.827026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.829495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.831671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.845503 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3102/6177] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:15 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:15.853954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.858578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5726a431e6ec4dcc90bae2ec9cd07bd2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.864318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45af89-6957-4ea2-9f8f-332977cba179 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.865852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5726a431e6ec4dcc90bae2ec9cd07bd2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.866546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5726a431e6ec4dcc90bae2ec9cd07bd2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.867167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5726a431e6ec4dcc90bae2ec9cd07bd2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.869161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.869816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.870101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.870367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.871089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.872696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:15.876107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4afcca0-6dfe-49c2-af80-d2f92e046675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5726a431e6ec4dcc90bae2ec9cd07bd2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:15.888544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3103/6178] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:15.889920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:15.891263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:15.897482 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3076/6179] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:15 2021] DELETE /identity/v3/users/5726a431e6ec4dcc90bae2ec9cd07bd2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:15.905375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0023c5-06e5-462b-a9d4-0adee7034fd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:15.972842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:15.973753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:15.974025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:15.974292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] PATH_INFO: `/v3/projects/3a98fe29a26f445a84b4c47c9dcee2b2/users/9b1bae462c6a46afbd1608fd32168dea/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:15.990657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a98fe29a26f445a84b4c47c9dcee2b2, user_id=9b1bae462c6a46afbd1608fd32168dea, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:15.994004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:16.006761 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3104/6180] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:15 2021] PUT /identity/v3/projects/3a98fe29a26f445a84b4c47c9dcee2b2/users/9b1bae462c6a46afbd1608fd32168dea/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:16.012352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:16.012633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:16.012927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:16.031665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:16.032895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:16.085618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:16.088750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:16.097839 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3077/6181] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:16.107947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:16.109724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:16.111082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67089f-199e-4e41-9c2a-b7cb0ba6f963 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:16.117746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:16.119333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:16.119681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:16.120083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] PATH_INFO: `/v3/projects/dac8c622c5e44556b123f0c76f41e8c2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:16.121543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac8c622c5e44556b123f0c76f41e8c2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:16.123955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:16.170698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232b9dd-6506-4611-a3fe-d33a1560f6ba None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:16.174828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac8c622c5e44556b123f0c76f41e8c2', 'request_id': 'req-80b37403-cd45-4468-a631-17bc7c10acd6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.182030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac8c622c5e44556b123f0c76f41e8c2', 'request_id': 'req-80b37403-cd45-4468-a631-17bc7c10acd6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.189379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac8c622c5e44556b123f0c76f41e8c2', 'request_id': 'req-80b37403-cd45-4468-a631-17bc7c10acd6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.202920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] The token cache is being invalidate because project dac8c622c5e44556b123f0c76f41e8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:16.203215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.204751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.209471 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3105/6182] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:16 2021] DELETE /identity/v3/projects/dac8c622c5e44556b123f0c76f41e8c2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:17:16.210134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:16.211471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:16.224738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:16.225373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:16.225656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:16.225933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:16.228774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:16.291611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37403-cd45-4468-a631-17bc7c10acd6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:16.296831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:16.297748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:16.298025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:16.298428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] PATH_INFO: `/v3/users/a2ca2d206ec64e71a9191a37f0dbc855` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:16.299887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ca2d206ec64e71a9191a37f0dbc855)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:16.302162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:16.303629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:16.305180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:16.319864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3078/6183] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:17:16.376009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ca2d206ec64e71a9191a37f0dbc855'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.384187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ca2d206ec64e71a9191a37f0dbc855'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.385040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ca2d206ec64e71a9191a37f0dbc855'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.399675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ca2d206ec64e71a9191a37f0dbc855'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.409990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-60dc1781-5f8c-48ca-b9f7-a0b2164e6d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ca2d206ec64e71a9191a37f0dbc855'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:16.420387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3106/6184] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:16 2021] DELETE /identity/v3/users/a2ca2d206ec64e71a9191a37f0dbc855 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:17:16.849241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:16.869702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2762-9bd4-4027-ad1f-27370e4d7281 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:16.971531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:16.972357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:16.972694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:16.973159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] PATH_INFO: `/v3/projects/0200cbe944aa4a1eb45231a99d411fcc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:16.974937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0200cbe944aa4a1eb45231a99d411fcc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:16.978275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.046261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0200cbe944aa4a1eb45231a99d411fcc', 'request_id': 'req-34a98e23-8ea8-40ac-a4cb-892a88455829'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:17.056757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0200cbe944aa4a1eb45231a99d411fcc', 'request_id': 'req-34a98e23-8ea8-40ac-a4cb-892a88455829'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:17.066521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0200cbe944aa4a1eb45231a99d411fcc', 'request_id': 'req-34a98e23-8ea8-40ac-a4cb-892a88455829'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:17.085733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] The token cache is being invalidate because project 0200cbe944aa4a1eb45231a99d411fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:17.086589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:17.088456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-34a98e23-8ea8-40ac-a4cb-892a88455829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:17.090205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3079/6185] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:16 2021] DELETE /identity/v3/projects/0200cbe944aa4a1eb45231a99d411fcc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:17.096755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.097497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.098026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.120533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:17.122494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.211250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3107/6186] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:17.222119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.222309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.222567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.245223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:17.247654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.257097 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3080/6187] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:17.261973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.272298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338dd77-c909-4ce9-bb06-9fa6db4e8d34 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.278721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.279513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.279789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.280110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.280992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:17.281345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.282961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2174-766b-4a98-87fc-3121dd92408c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.298559 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3108/6188] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:17.302915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.313671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750544bf-3afd-4d71-b3fb-02e6f7ac3fa9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.318749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.319486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.319764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.320550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.320962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.323555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.348602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.348920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.349262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.358571 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3081/6189] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:17:17.364106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.383366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] MFA Rules not processed for user `9b1bae462c6a46afbd1608fd32168dea`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:17.385217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.462680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a3f7-4f6e-4dd7-a7d7-f360ddbd0b7a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.463016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3109/6190] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:17.472567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.473114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.473845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.474366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.475022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.475544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.476724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.479818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.505176 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3082/6191] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:17.509876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.520635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1bb21-8e68-4109-a3f2-53a59582c9fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.529243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.530065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.530458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.530985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.532961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.537052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.548405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf517b7-2e51-46f9-af32-f6c0b598d5a9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.551616 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3083/6192] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:17:17.552387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.553062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.553336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.553605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.556023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.563195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.564725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.566491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e4039-cc7b-4460-880f-e818d0dfadbf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.574370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.575131 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3110/6193] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:17.575262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.575551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.575917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.576782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.578831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd029-8961-4bc8-bf30-e6ef6d3fc160 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.595414 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3084/6194] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:17.596728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.617457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf597-a0b1-4428-8a22-f7e5d7fd0241 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.631592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.634106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.635252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.637717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] PATH_INFO: `/v3/projects/3c7d32d780ea4a4c8ea311bc0477cc1a/users/ab4061e5aca2462e8d0bd2898c345f6e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.656267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7d32d780ea4a4c8ea311bc0477cc1a, user_id=ab4061e5aca2462e8d0bd2898c345f6e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.659231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:17.673704 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3111/6195] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:17 2021] PUT /identity/v3/projects/3c7d32d780ea4a4c8ea311bc0477cc1a/users/ab4061e5aca2462e8d0bd2898c345f6e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:17.684522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.684831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.685103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.733149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] MFA Rules not processed for user `ab4061e5aca2462e8d0bd2898c345f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:17.734353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.832850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.835707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.853137 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3085/6196] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:17.864311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:17.865950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.941158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b4bb0-c8a0-4e69-8291-b35ed7260050 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.948053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.950809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.951329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.951849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.955292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77898e-9d3b-48f0-bc11-2625abc683d1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:17.958507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:17.963143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:17.963867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:17.964212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:17.964737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:17.979923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:17.981356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:18.001037 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3086/6197] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:18.085148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:18.087298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233795-c601-4db7-902e-bfad6b77d086 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:18.099309 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3112/6198] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:18.874516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:18.876147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:18.916326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c953776-5ddd-47b5-bf05-21eff9696148 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:18.924281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:18.929813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:18.930125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:18.930901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] PATH_INFO: `/v3/users/b14e52c2dee142bb896f6e0e61e52426` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:18.935039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14e52c2dee142bb896f6e0e61e52426)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:18.942039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:19.031606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14e52c2dee142bb896f6e0e61e52426'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.047777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14e52c2dee142bb896f6e0e61e52426'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.049216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14e52c2dee142bb896f6e0e61e52426'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.049774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14e52c2dee142bb896f6e0e61e52426'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.073128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d16-e202-494e-b4cc-e422f032fc13 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:19.073754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d16-e202-494e-b4cc-e422f032fc13 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:19.074237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d16-e202-494e-b4cc-e422f032fc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:19.089602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14e52c2dee142bb896f6e0e61e52426'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.107762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f0f46d16-e202-494e-b4cc-e422f032fc13 None None] MFA Rules not processed for user `9b1bae462c6a46afbd1608fd32168dea`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:19.110656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f0f46d16-e202-494e-b4cc-e422f032fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:19.132715 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3087/6199] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:18 2021] DELETE /identity/v3/users/b14e52c2dee142bb896f6e0e61e52426 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:19.251987 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3113/6200] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:19.596629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:19.598365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:19.722760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1cfc-d57b-4823-bc36-ab2f1c60398f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:19.736517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:19.737470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:19.737737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:19.738018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] PATH_INFO: `/v3/projects/d1b41fe8af644d33915bdae4bbd34947` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:19.742471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b41fe8af644d33915bdae4bbd34947)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:19.744477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:19.852989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b41fe8af644d33915bdae4bbd34947', 'request_id': 'req-616d89b9-0a3e-4167-a75c-cb57a995496c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.866143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b41fe8af644d33915bdae4bbd34947', 'request_id': 'req-616d89b9-0a3e-4167-a75c-cb57a995496c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.873673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b41fe8af644d33915bdae4bbd34947', 'request_id': 'req-616d89b9-0a3e-4167-a75c-cb57a995496c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.893645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] The token cache is being invalidate because project d1b41fe8af644d33915bdae4bbd34947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:19.894766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.895958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-616d89b9-0a3e-4167-a75c-cb57a995496c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:19.898407 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3088/6201] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:19 2021] DELETE /identity/v3/projects/d1b41fe8af644d33915bdae4bbd34947 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:19.904684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635576cd-6ae0-4ed5-82aa-b37a8f9d8cf1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:19.904980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635576cd-6ae0-4ed5-82aa-b37a8f9d8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:19.905262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635576cd-6ae0-4ed5-82aa-b37a8f9d8cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:19.934980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-635576cd-6ae0-4ed5-82aa-b37a8f9d8cf1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:19.936483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-635576cd-6ae0-4ed5-82aa-b37a8f9d8cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:20.057577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3114/6202] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:20.065534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.065883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.066643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.115371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.116202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.116659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.133392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:20.135153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:20.154334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] MFA Rules not processed for user `7726a2bc4958475680e70966d92fc50f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:20.156712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:20.165278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3089/6203] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:20.166391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.189327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30384e5-1e3a-4634-b972-76e13f030676 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.215801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.220630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.220931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.221224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.225737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:20.226128 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3115/6204] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:20 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:20.234427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.236206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.260911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.273978 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3090/6205] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:20.275876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c910fc-82dd-4fb2-91f6-43d80169e7a5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.286662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.287357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.287630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.287896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.288597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.293336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.358414 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3116/6206] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:20 2021] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:20.363587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.379593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925001e8-d5c1-462d-a7b7-0b28cbf525db admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.502367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.503185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.503480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.503805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.504572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.510719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.544441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3091/6207] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:20 2021] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:20.549412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.562462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e630-a27e-4916-9cbe-50e6722914f7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.568543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.569558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.570046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.570588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.572150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.573997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.588336 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3117/6208] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:20 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:20.592211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.614179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce18cd-177c-43db-9d8e-d2971f6e2e4c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.626002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.627788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.627919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.628157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.629823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.632449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970885c9-cbd8-4ba0-883b-f0130e632651 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.644654 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3092/6209] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:20 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:17:20.648791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.659524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba2d11-97b2-49c5-9ac7-c5e63010b61b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.664548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.666222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.666489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.666754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] PATH_INFO: `/v3/projects/02273f07cda641aeb603060c95be43a8/users/0e657e3ab6d5440db8f81d6b0ed7c056/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.683807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02273f07cda641aeb603060c95be43a8, user_id=0e657e3ab6d5440db8f81d6b0ed7c056, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.686744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.710151 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3118/6210] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:20 2021] PUT /identity/v3/projects/02273f07cda641aeb603060c95be43a8/users/0e657e3ab6d5440db8f81d6b0ed7c056/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:17:20.720229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.721116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.721116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.753448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] MFA Rules not processed for user `0e657e3ab6d5440db8f81d6b0ed7c056`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:20.754826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:20.844115 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3093/6211] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:20 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:20.845345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:20.847500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:20.920691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0bd2-627c-4d64-9035-21081bb40774 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:20.924427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:20.925107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:20.925386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:20.925665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:20.936889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:20.938346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ebdf-c332-49a0-a9e4-4e08f84d31bc service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:20.954362 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3119/6212] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:20 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:23.632766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:23.634981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:23.725787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18662-0a33-46ba-ae98-a09b048c36b3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:23.733257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:23.734310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:23.734685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:23.735031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:23.738471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:23.760146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:23.762640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f59b4-ec97-498a-8240-489bd58caee5 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:23.777302 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3094/6213] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:23 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:26.024944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:26.025867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:26.026158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:26.042866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:26.044061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:26.098167 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3120/6214] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:26 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:27.981442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a144-31fa-42e4-a775-984266b660d9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:27.981890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a144-31fa-42e4-a775-984266b660d9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:27.981979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a144-31fa-42e4-a775-984266b660d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:27.999276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c8c9a144-31fa-42e4-a775-984266b660d9 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:28.000446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c8c9a144-31fa-42e4-a775-984266b660d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:28.007362 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3095/6215] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:28.496836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:28.498655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:28.574939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927833c-9876-4ccd-9fc5-6fdb1c4d3d02 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:28.580041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:28.581173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:28.581762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:28.582201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:28.584215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:28.596324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:28.598497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448a8b1-0666-4000-8ac2-cca4b6858b88 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:28.609427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3121/6216] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:29.966303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3493-156f-4904-9cd1-67c5afe717ad None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:29.966844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3493-156f-4904-9cd1-67c5afe717ad None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:29.966844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3493-156f-4904-9cd1-67c5afe717ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:29.984600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-322e3493-156f-4904-9cd1-67c5afe717ad None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:29.986007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-322e3493-156f-4904-9cd1-67c5afe717ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:29.993897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3096/6217] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:29 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:30.416526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8befcd-3b5d-41db-aa53-9da4a7708e84 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:30.416992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8befcd-3b5d-41db-aa53-9da4a7708e84 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:30.417304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8befcd-3b5d-41db-aa53-9da4a7708e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:30.442880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5a8befcd-3b5d-41db-aa53-9da4a7708e84 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:30.444314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5a8befcd-3b5d-41db-aa53-9da4a7708e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:30.456689 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3122/6218] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:30 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:30.970215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6107f2-8b61-4cf6-bbdb-ba0e432d92a3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:30.970719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6107f2-8b61-4cf6-bbdb-ba0e432d92a3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:30.970847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6107f2-8b61-4cf6-bbdb-ba0e432d92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:30.992063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ae6107f2-8b61-4cf6-bbdb-ba0e432d92a3 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:30.993324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ae6107f2-8b61-4cf6-bbdb-ba0e432d92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:31.004548 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3097/6219] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:30 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:31.485999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c702-c345-4a4f-bd1f-ad51e774bf85 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:31.486492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c702-c345-4a4f-bd1f-ad51e774bf85 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:31.486584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c702-c345-4a4f-bd1f-ad51e774bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:31.504758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d592c702-c345-4a4f-bd1f-ad51e774bf85 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:31.505981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d592c702-c345-4a4f-bd1f-ad51e774bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:31.513365 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3123/6220] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:31.906762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c1b8-5bee-4b15-b0b5-4a5bdf1c6c3d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:31.907067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c1b8-5bee-4b15-b0b5-4a5bdf1c6c3d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:31.907320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c1b8-5bee-4b15-b0b5-4a5bdf1c6c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:31.932024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-44d8c1b8-5bee-4b15-b0b5-4a5bdf1c6c3d None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:31.933336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-44d8c1b8-5bee-4b15-b0b5-4a5bdf1c6c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:31.943089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3098/6221] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:32.319684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21c41-333d-47b8-82d7-8b840d28763e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:32.319965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21c41-333d-47b8-82d7-8b840d28763e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:32.320257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21c41-333d-47b8-82d7-8b840d28763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:32.338210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-82b21c41-333d-47b8-82d7-8b840d28763e None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:32.339385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-82b21c41-333d-47b8-82d7-8b840d28763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:32.346386 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3124/6222] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:32.879819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:32.880295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:32.880495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:32.911981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:32.913355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:32.927170 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3099/6223] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:34.105251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c6f-78c5-4fde-9d0b-effebdc00d33 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:34.105984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c6f-78c5-4fde-9d0b-effebdc00d33 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:34.106251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c6f-78c5-4fde-9d0b-effebdc00d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:34.144277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-be140c6f-78c5-4fde-9d0b-effebdc00d33 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:34.146495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-be140c6f-78c5-4fde-9d0b-effebdc00d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:34.163546 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3125/6224] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:34.532524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:34.604112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9436-ff18-4730-bcda-494c845410bd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:34.608763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:34.609624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:34.610126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:34.610601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] PATH_INFO: `/v3/users/0e657e3ab6d5440db8f81d6b0ed7c056` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:34.611817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e657e3ab6d5440db8f81d6b0ed7c056)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:34.613746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:34.666858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e657e3ab6d5440db8f81d6b0ed7c056'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:34.675712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e657e3ab6d5440db8f81d6b0ed7c056'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:34.677068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e657e3ab6d5440db8f81d6b0ed7c056'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:34.677977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e657e3ab6d5440db8f81d6b0ed7c056'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:34.686111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1206a35-21ec-4f20-936b-417a75244511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e657e3ab6d5440db8f81d6b0ed7c056'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:34.706232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3100/6225] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:34 2021] DELETE /identity/v3/users/0e657e3ab6d5440db8f81d6b0ed7c056 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:34.710376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:34.710698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:34.710981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:34.736999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:34.737288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:34.737733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:34.747440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:34.750596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:34.763255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] MFA Rules not processed for user `9b1bae462c6a46afbd1608fd32168dea`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:34.764879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:34.845028 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3126/6226] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:34.857925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:34.859524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:34.867645 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3101/6227] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:34.925050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbda7-e0d7-4161-8379-920f01237de0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:34.928812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:34.929611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:34.929927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:34.930202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:34.941880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:34.944593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be89a-ef1c-47b2-a5c6-fd2221fb64a4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:34.955808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3127/6228] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:17:35.437474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:35.438905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:35.454834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10063-39fa-431a-92b0-52db2e20beac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:35.476581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:35.478105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:35.478390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:35.478664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] PATH_INFO: `/v3/projects/02273f07cda641aeb603060c95be43a8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:35.481745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02273f07cda641aeb603060c95be43a8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:35.483648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:35.574550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02273f07cda641aeb603060c95be43a8', 'request_id': 'req-d8d5cb70-637b-4a21-b07c-bc4860e86546'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:35.584815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02273f07cda641aeb603060c95be43a8', 'request_id': 'req-d8d5cb70-637b-4a21-b07c-bc4860e86546'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:35.596044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02273f07cda641aeb603060c95be43a8', 'request_id': 'req-d8d5cb70-637b-4a21-b07c-bc4860e86546'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:35.619376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] The token cache is being invalidate because project 02273f07cda641aeb603060c95be43a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:35.619904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:35.621238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d8d5cb70-637b-4a21-b07c-bc4860e86546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:35.623869 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3102/6229] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:35 2021] DELETE /identity/v3/projects/02273f07cda641aeb603060c95be43a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:17:35.630426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:35.630910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:35.631007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:35.657996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:35.659892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:35.755174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3128/6230] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:35.765841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:35.766255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:35.766644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:35.812176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:35.813547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:35.824638 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3103/6231] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:35.829845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:35.847083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93e595-14bd-4285-829d-3fe05b75b720 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:35.855778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:35.856447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:35.856839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:35.856994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:35.857746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:17:35.858052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:35.859714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:35.875750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:35.877163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:35.884238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3129/6232] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:17:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:17:35.888206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:35.903065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c4cb9-8d17-4831-a0a2-0886878546d8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:35.911588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:35.912343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:35.912721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:35.913067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:35.915092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:35.917147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:35.962655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3130/6233] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:35 2021] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:17:35.977420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.026029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005098a9-f089-41a1-a906-5e0d21eea5ca None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.111043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e816746-fa66-4a7b-99c7-75efe2d458be admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.119789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.120703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.121089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.121782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.122373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.125139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.162333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3131/6234] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:35 2021] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:36.168012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.174083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.175219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.175679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.176111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.180004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:36.184298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dd0c1-263b-48a0-8264-7fcbb406fd30 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.191624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.192745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.193315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.193799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.195165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.197387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.197542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.201302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.216735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3132/6235] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:17:36.219227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.229376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3104/6236] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:36.252324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e1b0e-f15a-4a72-b89c-bb1675d252cc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.258261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.259389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.260341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.260645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.261404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.263207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251cad-305f-43a1-ba0d-82f2150dd97b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.281764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3133/6237] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:36.286877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.300180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e650-2c18-421d-9e78-92f1ee810de9 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.307436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.311735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.311999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.312505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] PATH_INFO: `/v3/projects/6c0528b04d134afa8397951de3d7922f/users/e39b47dc0794427ca139086096853aab/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.330258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0528b04d134afa8397951de3d7922f, user_id=e39b47dc0794427ca139086096853aab, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.334727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.350536 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3105/6238] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:36 2021] PUT /identity/v3/projects/6c0528b04d134afa8397951de3d7922f/users/e39b47dc0794427ca139086096853aab/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:17:36.362272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.362588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.362860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.393510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] MFA Rules not processed for user `e39b47dc0794427ca139086096853aab`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:36.394864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:36.473374 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3134/6239] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:36.477887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.630553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6cdc-71d3-426d-b4fa-ee9d63e189a9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.639224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.639931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.640177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.640456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.642758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.644924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.678939 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3106/6240] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:17:36 2021] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:36.683275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.697047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d71b74-9044-4a4d-8a25-c2c54b7149f4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.779921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.780937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.781218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.781486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.782242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.784271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.821677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3135/6241] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:17:36 2021] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:17:36.825618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.849575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cdbf-fcdb-4ac0-9e53-796c1ca66201 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.866782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.868257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.868522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.868837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.869625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.871330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:36.895051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:36.895250 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3107/6242] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:36.923340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b362242-9cd7-4f6e-b1fd-6eb4686f0d76 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:36.942202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:36.943822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:36.944285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:36.944795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] PATH_INFO: `/v3/projects/64e130cb763148bc9ab88adb1d883d76/users/ad91e08b56aa4da48dd10d6341512c6a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:36.965288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e130cb763148bc9ab88adb1d883d76, user_id=ad91e08b56aa4da48dd10d6341512c6a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:36.968273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b4456-203f-4c20-a267-e0975f4955d4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:37.014879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3136/6243] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:36 2021] PUT /identity/v3/projects/64e130cb763148bc9ab88adb1d883d76/users/ad91e08b56aa4da48dd10d6341512c6a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:37.018860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:37.036963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00358279-9d64-4ff1-8f76-dedb88e10eed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:37.088026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4610-f489-4350-9a1f-efdd5ae3ed45 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.088026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4610-f489-4350-9a1f-efdd5ae3ed45 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.088026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4610-f489-4350-9a1f-efdd5ae3ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.120355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-722b4610-f489-4350-9a1f-efdd5ae3ed45 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:37.122272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-722b4610-f489-4350-9a1f-efdd5ae3ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:37.139701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:37.141185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.141185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.141653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.143199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:37.145234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:37.158358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3108/6244] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:17:37 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:17:37.166004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:37.195753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49bec9-2672-4241-be29-579cfbd84dc7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:37.209504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:37.210503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.210848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.211289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] PATH_INFO: `/v3/projects/64e130cb763148bc9ab88adb1d883d76/users/ad91e08b56aa4da48dd10d6341512c6a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.214403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e130cb763148bc9ab88adb1d883d76, user_id=ad91e08b56aa4da48dd10d6341512c6a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:37.217972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3137/6245] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:17:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:37.225041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:37.257960 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3109/6246] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:17:37 2021] PUT /identity/v3/projects/64e130cb763148bc9ab88adb1d883d76/users/ad91e08b56aa4da48dd10d6341512c6a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:37.269859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.269859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.269859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.271309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:37.273176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:37.338840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] MFA Rules not processed for user `ad91e08b56aa4da48dd10d6341512c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:37.349663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:37.403355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf02b04-51dd-491a-9883-213141b6349a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:37.426039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:37.428000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.429162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.433022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.579701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:37.581425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f1a7-e3a3-49b0-a4ec-f1fb71a6877f service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:37.582544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3138/6247] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:37 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:17:37.597109 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3110/6248] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:17:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:17:37.610942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:37.613104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:37.814924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d1231-aece-4e35-835f-83a04d100fe7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:37.827069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:37.828395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:37.828849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:37.829386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:37.959096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:37.962237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82996ffd-a798-44f9-ab9d-cc1618a2e788 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:37.978254 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3139/6249] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:38.951256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:38.952153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:38.952924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:39.014560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:39.016862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:39.149301 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3111/6250] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:38 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:40.432033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f517-04eb-4781-be98-c73c18858292 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:40.432504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f517-04eb-4781-be98-c73c18858292 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:40.432773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f517-04eb-4781-be98-c73c18858292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:40.463120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9f36f517-04eb-4781-be98-c73c18858292 None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:40.464564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9f36f517-04eb-4781-be98-c73c18858292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:40.483720 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3140/6251] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:40 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:41.895053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:41.897135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:42.011655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b4b06-32ce-4e19-a700-9470778a620c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:42.025102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:42.025986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:42.026261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:42.026530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] PATH_INFO: `/v3/users/ab4061e5aca2462e8d0bd2898c345f6e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:42.028664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4061e5aca2462e8d0bd2898c345f6e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:42.030581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:42.129725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4061e5aca2462e8d0bd2898c345f6e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:42.141093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4061e5aca2462e8d0bd2898c345f6e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:42.142170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4061e5aca2462e8d0bd2898c345f6e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:42.143055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4061e5aca2462e8d0bd2898c345f6e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:42.155923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4061e5aca2462e8d0bd2898c345f6e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:42.178822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3112/6252] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:17:41 2021] DELETE /identity/v3/users/ab4061e5aca2462e8d0bd2898c345f6e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:42.184062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:42.184656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:42.184656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:42.217756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:42.228004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:42.373846 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3141/6253] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:42.392570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:42.394285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:42.650491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83405fbf-4cb7-46a6-9771-8b9cf0fed855 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:42.658276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:42.659905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:42.660197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:42.660474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:42.691251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:42.692887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:42.721545 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3113/6254] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:43.208652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:43.210861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:43.232152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a6b5-9e87-40d9-a3ce-4661379a0264 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:43.238234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:43.238910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:43.239189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:43.239705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:43.242128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:43.392805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:43.394264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:43.406793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3142/6255] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:43 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:43.803327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:43.805553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:43.828359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065104ba-db14-4418-b9a6-1fa6177ef75e service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:43.853325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:43.855931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:43.857838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:43.858315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] PATH_INFO: `/v3/projects/3c7d32d780ea4a4c8ea311bc0477cc1a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:43.874700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7d32d780ea4a4c8ea311bc0477cc1a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:43.878057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:44.021877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7d32d780ea4a4c8ea311bc0477cc1a', 'request_id': 'req-254ec770-a07d-4842-9919-22b4baf51520'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:44.035250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7d32d780ea4a4c8ea311bc0477cc1a', 'request_id': 'req-254ec770-a07d-4842-9919-22b4baf51520'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:44.052133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7d32d780ea4a4c8ea311bc0477cc1a', 'request_id': 'req-254ec770-a07d-4842-9919-22b4baf51520'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:44.070623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] The token cache is being invalidate because project 3c7d32d780ea4a4c8ea311bc0477cc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:17:44.071368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:44.072088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-254ec770-a07d-4842-9919-22b4baf51520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:17:44.074311 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3114/6256] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:17:43 2021] DELETE /identity/v3/projects/3c7d32d780ea4a4c8ea311bc0477cc1a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:17:49.120358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:49.124107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:49.311778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763409e6-0672-45a9-89da-3d570abd7ed2 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:49.432530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:49.435076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:49.435620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:49.436660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:49.439576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:49.480114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:49.482020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ad62-ac06-46dd-84d0-fec88aa8406e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:49.545512 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3143/6257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:54.138248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:54.138810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:54.138899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:54.159701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] MFA Rules not processed for user `e39b47dc0794427ca139086096853aab`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:54.161616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:54.256160 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3115/6258] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:56.960693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ead6b-7f47-4701-b6c8-0d1e9794c8fe None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:56.961204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ead6b-7f47-4701-b6c8-0d1e9794c8fe None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:56.961387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ead6b-7f47-4701-b6c8-0d1e9794c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:56.995972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0d2ead6b-7f47-4701-b6c8-0d1e9794c8fe None None] MFA Rules not processed for user `45ec13d633804480abc8eb86e9f072cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:56.997607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d2ead6b-7f47-4701-b6c8-0d1e9794c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:57.089801 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3144/6259] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:17:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:57.184442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:57.185992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:57.256275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390e30-768d-40d6-bee2-3222ad563932 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:57.260029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:57.260709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:57.261005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:57.261253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:57.263116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:57.276009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:57.277479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:57.287241 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3116/6260] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:17:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:17:59.508925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd458bdc-9955-404c-8f41-6af2dc6df58f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:59.509469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd458bdc-9955-404c-8f41-6af2dc6df58f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:59.509734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd458bdc-9955-404c-8f41-6af2dc6df58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:59.537037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dd458bdc-9955-404c-8f41-6af2dc6df58f None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:17:59.538829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dd458bdc-9955-404c-8f41-6af2dc6df58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:59.601183 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3145/6261] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:17:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:17:59.617562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:17:59.619624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:17:59.715612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbc7e-a0af-4890-aaa1-2e003ddf02e6 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:17:59.723784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:17:59.724845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:17:59.725329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:17:59.726338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:17:59.736129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:17:59.737850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:17:59.748803 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3117/6262] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:17:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:13.888853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f521c5-05bc-499d-89c8-1aeab4b19cd5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:13.889765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f521c5-05bc-499d-89c8-1aeab4b19cd5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:13.890220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f521c5-05bc-499d-89c8-1aeab4b19cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:13.913954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b3f521c5-05bc-499d-89c8-1aeab4b19cd5 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:13.916098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b3f521c5-05bc-499d-89c8-1aeab4b19cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:13.934526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3146/6263] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:18:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:13.950266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:13.963971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2fe8-9e32-4dd7-8db2-2484000cec5b service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:13.970004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:13.970777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:13.971124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:13.971475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:13.980905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:13.982812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:13.993288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3118/6264] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:20.132007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfedf1-6f71-43f8-b915-6c0e2fdc583a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:20.132579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfedf1-6f71-43f8-b915-6c0e2fdc583a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:20.132844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfedf1-6f71-43f8-b915-6c0e2fdc583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:20.166967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a7cfedf1-6f71-43f8-b915-6c0e2fdc583a None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:20.169260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a7cfedf1-6f71-43f8-b915-6c0e2fdc583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:20.200468 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3147/6265] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:18:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:20.216177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:20.242820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f6122-222b-4b9b-9e75-378b1d84627f service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:20.253703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:20.256852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:20.257357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:20.257797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:20.267556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:20.269166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:20.279535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3119/6266] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:26.397818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365de3-18fd-4155-a0e7-96ad493be34e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:26.398407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365de3-18fd-4155-a0e7-96ad493be34e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:26.398407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365de3-18fd-4155-a0e7-96ad493be34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:26.420239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-36365de3-18fd-4155-a0e7-96ad493be34e None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:26.421487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36365de3-18fd-4155-a0e7-96ad493be34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:26.432438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3148/6267] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:18:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:26.448025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:26.462816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fc38-de0b-434d-abbc-d5a90adc0f95 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:26.468191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:26.468876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:26.469156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:26.469431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:26.479419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:26.481321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:26.491048 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3120/6268] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:18:27.171847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:27.172072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:27.172370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:27.194706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:27.196232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:27.205582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3149/6269] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:18:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:27.227926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:27.243980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38451e6-611e-445c-8025-48535dc20c03 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:27.249779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:27.250446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:27.250731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:27.250999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:27.262002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:27.263975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:27.274990 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3121/6270] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:27.802270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:27.809703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:27.834976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ca434-3a34-4dda-ab0e-551814598856 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:27.842479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:27.843751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:27.844262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:27.844794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:27.849697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:27.872835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:27.875794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:27.897566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:27.900276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:27.935869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3150/6271] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:28.104752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a49b4-7af3-49eb-bcdd-94b0b3249da5 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:28.121522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:28.123259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:28.123544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:28.124228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:28.130215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:28.151999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:28.155453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:28.171883 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3122/6272] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:18:29.690606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:29.692073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:29.800804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dea46-0a92-40e0-a7fe-96d29f103cf5 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:29.809670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:29.811177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:29.811671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:29.812085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] PATH_INFO: `/v3/users/9b1bae462c6a46afbd1608fd32168dea` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:29.816583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1bae462c6a46afbd1608fd32168dea)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:29.818845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:29.877186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1bae462c6a46afbd1608fd32168dea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:29.888878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1bae462c6a46afbd1608fd32168dea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:29.891922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1bae462c6a46afbd1608fd32168dea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:29.926306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1bae462c6a46afbd1608fd32168dea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:29.942075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cd1d4986-19b3-44a9-bc90-b56d090d3016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1bae462c6a46afbd1608fd32168dea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:29.953178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3151/6273] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:18:29 2021] DELETE /identity/v3/users/9b1bae462c6a46afbd1608fd32168dea => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:30.195106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:30.235440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386892-a0f6-46fd-950a-471414be2c9e service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:30.327211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:30.328364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:30.328823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:30.329105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] PATH_INFO: `/v3/projects/3a98fe29a26f445a84b4c47c9dcee2b2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:30.330773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a98fe29a26f445a84b4c47c9dcee2b2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:30.332702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:30.406858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a98fe29a26f445a84b4c47c9dcee2b2', 'request_id': 'req-78aaf79f-0f93-4b71-a27e-e0d90798051b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:30.418867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a98fe29a26f445a84b4c47c9dcee2b2', 'request_id': 'req-78aaf79f-0f93-4b71-a27e-e0d90798051b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:30.425788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a98fe29a26f445a84b4c47c9dcee2b2', 'request_id': 'req-78aaf79f-0f93-4b71-a27e-e0d90798051b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:30.442203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] The token cache is being invalidate because project 3a98fe29a26f445a84b4c47c9dcee2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:18:30.442532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:30.443193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-78aaf79f-0f93-4b71-a27e-e0d90798051b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:30.446052 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3123/6274] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:18:30 2021] DELETE /identity/v3/projects/3a98fe29a26f445a84b4c47c9dcee2b2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:30.529887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:30.530313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:30.530695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:30.558616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:30.560068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:30.650812 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3152/6275] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:30.655590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:30.655883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:30.656154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:30.748461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:30.749927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:30.762703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3124/6276] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:30.763753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:30.775875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2bec3-c797-4612-a2ba-d9625b3faf35 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:30.781497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:30.782203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:30.782679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:30.783126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:30.785113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:18:30.785856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:30.787456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:30.809061 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3153/6277] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:18:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:18:30.814030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:30.831869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86664d8a-fd7e-4739-87d9-d0de28ca2529 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:30.846971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:30.848027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:30.848531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:30.849204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:30.850740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:30.854370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:30.915324 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3125/6278] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:18:30 2021] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:30.919523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:30.935134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8603d-caaa-4735-9702-d55313dfb2c6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:31.056477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:31.057878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.058438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.058717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.059572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:31.071425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:31.106904 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3154/6279] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:18:30 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:31.110827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:31.127021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565f5d8-defc-4ec1-b297-9a9eb06c0e10 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:31.138472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:31.140256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.141874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.142522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.145380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:31.151059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:31.185725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3126/6280] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:18:31.187950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:31.199591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c600518-6743-4b58-9503-1c73444c0609 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:31.226012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:31.227550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.228192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.228843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.229743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:31.231560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c319-a244-4405-a1f4-fd114a2d4de8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:31.256892 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3155/6281] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:18:31.259626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:31.272751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33d3c-f2a3-4baf-8ce6-3ff728bca0fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:31.290533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:31.291443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.291725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.292070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] PATH_INFO: `/v3/projects/013b9c6863cb415e8f96c6f0a835d4a2/users/690c6ac9dc834ddc963a086baee55fe5/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.310172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013b9c6863cb415e8f96c6f0a835d4a2, user_id=690c6ac9dc834ddc963a086baee55fe5, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:31.313289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:31.335539 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3127/6282] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:18:31 2021] PUT /identity/v3/projects/013b9c6863cb415e8f96c6f0a835d4a2/users/690c6ac9dc834ddc963a086baee55fe5/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:31.345767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471058e7-96c1-426a-b012-943415b6b007 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.346142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471058e7-96c1-426a-b012-943415b6b007 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.346547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471058e7-96c1-426a-b012-943415b6b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.410506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-471058e7-96c1-426a-b012-943415b6b007 None None] MFA Rules not processed for user `690c6ac9dc834ddc963a086baee55fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:31.411864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-471058e7-96c1-426a-b012-943415b6b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:31.559695 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3156/6283] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:31 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:31.572509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:31.574538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:31.690196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e911-e989-424a-9c0d-2ca4bc1d9b22 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:31.695482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:31.696190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:31.696599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:31.696921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:31.710699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:31.712499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2820-9e03-4dba-a9f9-70dfc0bed454 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:31.724014 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3128/6284] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:31 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:34.434744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471058e7-96c1-426a-b012-943415b6b007 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:34.543394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471058e7-96c1-426a-b012-943415b6b007 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:34.560335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:34.563863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:34.564163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:34.564692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] PATH_INFO: `/v3/users/690c6ac9dc834ddc963a086baee55fe5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:34.568482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=690c6ac9dc834ddc963a086baee55fe5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:34.571553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:34.696210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690c6ac9dc834ddc963a086baee55fe5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:34.705543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690c6ac9dc834ddc963a086baee55fe5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:34.706294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690c6ac9dc834ddc963a086baee55fe5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:34.722059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690c6ac9dc834ddc963a086baee55fe5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:34.745119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690c6ac9dc834ddc963a086baee55fe5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:34.756584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3157/6285] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:18:34 2021] DELETE /identity/v3/users/690c6ac9dc834ddc963a086baee55fe5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:34.759480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:34.759893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:34.759967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:34.841864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:34.843006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:34.941459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3129/6286] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:18:34.951431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:34.953492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:35.010987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e4ea7-a49e-4878-b182-ce882fe47bbb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.014787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.015483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.015764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.016063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.025258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.026709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdbc17-6e0b-47a7-adcb-483147e5bc27 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.035893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3158/6287] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:35.415146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:35.416632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:35.429578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1357-1fc5-4bfd-b775-361a49354e23 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.434503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.435434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.435781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.436125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] PATH_INFO: `/v3/projects/013b9c6863cb415e8f96c6f0a835d4a2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.437441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=013b9c6863cb415e8f96c6f0a835d4a2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.439440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.498598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013b9c6863cb415e8f96c6f0a835d4a2', 'request_id': 'req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:35.504703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013b9c6863cb415e8f96c6f0a835d4a2', 'request_id': 'req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:35.511901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013b9c6863cb415e8f96c6f0a835d4a2', 'request_id': 'req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:35.525264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] The token cache is being invalidate because project 013b9c6863cb415e8f96c6f0a835d4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:18:35.525597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:35.526174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0883ee12-2eaa-4a82-8b28-d7dac2908ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:35.527812 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3130/6288] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:18:35 2021] DELETE /identity/v3/projects/013b9c6863cb415e8f96c6f0a835d4a2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:35.533587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.534087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.534240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.590052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:35.591737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:35.656315 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3159/6289] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:35.665083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.665519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.665974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.685976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:35.687182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:35.697205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3131/6290] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:35.700300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:35.712303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9389-5f87-4a26-bb73-bb744297b1f4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.717305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.718143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.718429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.718707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.719677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:18:35.719811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.721576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.734741 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3160/6291] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:18:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:18:35.739063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:35.748889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4c1d-0337-415c-ab77-cd61c53b1790 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.755013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.756659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.756947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.757308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.758119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.761230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.797285 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3132/6292] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:18:35 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:35.804661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:35.814994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3a5e-77b4-452b-acbf-1569c8bb2316 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.882125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.882802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.883082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.883354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.884787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.886047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.926483 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3161/6293] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:18:35 2021] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:35.931717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:35.943280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaea2b-0941-4e36-a230-a6d0cebf425c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:35.959932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:35.960820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:35.961105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:35.961377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:35.962125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:35.963726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:35.994049 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3133/6294] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:18:35.999236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:36.014485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add938b-eb5d-4ab8-bd4f-d59a3ff23e77 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:36.021062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:36.022440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:36.022843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:36.023219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:36.024067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:36.026534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dd57d-9638-4372-aba0-98a199328c90 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:36.041042 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3162/6295] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:18:36.044774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:36.056119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14560fa-ce36-469b-b8d5-444e07d1960b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:36.076916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:36.078704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:36.079060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:36.079410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] PATH_INFO: `/v3/projects/39843a8d6afa4f72b1f720499a5737db/users/9484b3ee637848caa0c67b233a185044/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:36.097899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39843a8d6afa4f72b1f720499a5737db, user_id=9484b3ee637848caa0c67b233a185044, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:36.101483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:36.122426 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3134/6296] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:18:36 2021] PUT /identity/v3/projects/39843a8d6afa4f72b1f720499a5737db/users/9484b3ee637848caa0c67b233a185044/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:18:36.135008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:36.135393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:36.135731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:36.192685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] MFA Rules not processed for user `9484b3ee637848caa0c67b233a185044`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:36.194487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:36.292561 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3163/6297] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:36.299983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:36.302033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:36.373800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb576f2-ffe8-49d2-8e01-1b038f0cfc97 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:36.377837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:36.378498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:36.378782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:36.379057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:36.389502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:36.391588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:36.403379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3135/6298] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:36 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:36.610664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:36.613047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:36.749313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32976-4277-4b2c-89e0-7062497b04a0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:36.753313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:36.754013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:36.754292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:36.755365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:36.759115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:36.933869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:36.935719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d92f7-b892-40f4-894b-5b78750089a5 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:36.954686 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3164/6299] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:37.055967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:37.059449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:37.126747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a33c-e1cc-49dc-aca0-0b28bf8d752a service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:37.132492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:37.133443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:37.133916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:37.134212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:37.136848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:37.150900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:37.152323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:37.163879 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3136/6300] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:37.458805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6310-6e64-42c4-ae94-3508653c4d6d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:37.460179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6310-6e64-42c4-ae94-3508653c4d6d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:37.460532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6310-6e64-42c4-ae94-3508653c4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:37.484879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b98f6310-6e64-42c4-ae94-3508653c4d6d None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:37.486351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b98f6310-6e64-42c4-ae94-3508653c4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:37.566601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3165/6301] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:18:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:37.594567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:37.596751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:37.727234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389c1b-e61a-4bfe-84e7-7773770e2a32 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:37.733388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:37.744039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:37.744392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:37.744702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:37.767568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:37.770203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:37.785883 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3137/6302] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:40.590767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:40.591354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:40.591354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:40.617762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:40.619117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:40.635368 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3166/6303] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:18:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:40.654998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:40.668410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a62a-6acd-456e-89db-967f7092e923 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:40.675901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:40.676695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:40.677101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:40.677441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:40.695689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:40.697546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9d360-2928-4074-a97a-90804489acb2 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:40.709821 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3138/6304] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:18:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:18:49.089035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:49.246485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1961-a98a-469f-9c64-5afb38ef19d1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:49.262952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:49.263210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:49.263445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:49.263640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] PATH_INFO: `/v3/users/9484b3ee637848caa0c67b233a185044` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:49.264991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9484b3ee637848caa0c67b233a185044)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:49.266859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:49.416991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9484b3ee637848caa0c67b233a185044'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:49.463297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9484b3ee637848caa0c67b233a185044'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:49.484384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9484b3ee637848caa0c67b233a185044'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:49.519721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9484b3ee637848caa0c67b233a185044'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:49.538132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9484b3ee637848caa0c67b233a185044'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:49.549248 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3167/6305] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:18:49 2021] DELETE /identity/v3/users/9484b3ee637848caa0c67b233a185044 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:18:49.555023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:49.556202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:49.556945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:49.594568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:49.597953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:49.756666 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3139/6306] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:18:49.784791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:49.787360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:49.903970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8f2a0-3aeb-4d5c-92ad-ca18db5af702 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:49.918269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:49.918269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:49.918269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:49.918269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:49.926048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:49.928067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8efc8f-810b-4c3e-bfae-544ebcb14b2a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:49.939563 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3168/6307] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:50.322765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:50.324292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:50.365040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf7657-9ef9-484f-8fbe-d30fc8f958c0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:50.372207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:50.373354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:50.373691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:50.374219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] PATH_INFO: `/v3/projects/39843a8d6afa4f72b1f720499a5737db` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:50.407277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39843a8d6afa4f72b1f720499a5737db)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:50.415843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:50.530311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39843a8d6afa4f72b1f720499a5737db', 'request_id': 'req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:50.538273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39843a8d6afa4f72b1f720499a5737db', 'request_id': 'req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:50.547044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39843a8d6afa4f72b1f720499a5737db', 'request_id': 'req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:50.567995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] The token cache is being invalidate because project 39843a8d6afa4f72b1f720499a5737db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:18:50.569155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:50.575653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f50fb576-cf0b-4eb2-b1b9-9d889e580c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:18:50.584936 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3140/6308] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:18:50 2021] DELETE /identity/v3/projects/39843a8d6afa4f72b1f720499a5737db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:50.586229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:50.586796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:50.586796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:50.623439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:50.627355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:50.727631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3169/6309] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:50.739670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:50.740465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:50.741012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:50.785380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:50.787692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:50.813635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:50.814499 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3141/6310] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:50.837974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a027d44-cd23-4304-b897-dfc8304aa673 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:50.861467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:50.862075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:50.862363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:50.862636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:50.863447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:18:50.863694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:50.873605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:50.901757 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3170/6311] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:18:50.902970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:50.919267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9838ed-3548-4d68-98eb-b596531efa8a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:50.935243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:50.935243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:50.935243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:50.936042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:50.936326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:50.944774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:51.028458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3142/6312] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:18:50 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:51.030080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:51.046993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98dee-c83d-4ec0-8501-f4e7a284322c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:51.259201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:51.259954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:51.260273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:51.260550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:51.261892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:51.267631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:51.329955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3171/6313] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:18:51 2021] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:18:51.332278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:51.354725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300f5a-c347-4253-85b3-3dc0c908072f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:51.374834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:51.375537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:51.375817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:51.376095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:51.376880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:51.378691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:51.420368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:51.420886 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3143/6314] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:18:51.435756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311348-d838-4250-859b-3dd4dbb1ec99 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:51.447709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:51.448399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:51.448698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:51.451993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:51.453382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:51.458174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a5f3-cb16-4832-9300-67066422eb25 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:51.521158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:51.521966 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3172/6315] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:18:51.556129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6a8b-3d4e-4dea-9079-13a42743fbd1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:51.601463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:51.603284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:51.603793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:51.604354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] PATH_INFO: `/v3/projects/7871a17d74c24db48d01976d917fdf16/users/1509f508db444f48a31f2ee0c980842f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:51.660426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7871a17d74c24db48d01976d917fdf16, user_id=1509f508db444f48a31f2ee0c980842f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:51.668936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:51.701967 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3144/6316] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:18:51 2021] PUT /identity/v3/projects/7871a17d74c24db48d01976d917fdf16/users/1509f508db444f48a31f2ee0c980842f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:18:51.715377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62be60-afef-420b-9aa6-ce45c1836b68 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:51.716009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62be60-afef-420b-9aa6-ce45c1836b68 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:51.716200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62be60-afef-420b-9aa6-ce45c1836b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:51.759599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ea62be60-afef-420b-9aa6-ce45c1836b68 None None] MFA Rules not processed for user `1509f508db444f48a31f2ee0c980842f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:51.769061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea62be60-afef-420b-9aa6-ce45c1836b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:51.954570 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3173/6317] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:51.968665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:51.970794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:52.139357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0574-1780-4582-b893-ff0855c9482d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:52.151875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:52.152721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:52.154335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:52.154787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:52.177313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:52.179267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93361a80-2adc-45ed-8672-2c9608046e22 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:52.206825 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3145/6318] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:53.782076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:53.785115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:53.786513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:53.854200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] MFA Rules not processed for user `e39b47dc0794427ca139086096853aab`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:53.856019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:54.049737 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3174/6319] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:53 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:54.140102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:54.140713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:54.140811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:54.180829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] MFA Rules not processed for user `1509f508db444f48a31f2ee0c980842f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:18:54.182772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:54.225285 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3146/6320] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:18:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:18:54.418283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:54.419840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:54.566586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575b78d-648b-4ab3-9706-1c847503ad8f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:54.570564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:54.575901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:54.576180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:54.576455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:54.579040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:54.766797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:54.769054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e9b7-9ec9-4e58-a5e5-09f797b77ca5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:54.793215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3175/6321] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:18:55.352992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:18:55.355261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:55.369249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ab42-6d25-4cf7-b3a7-e781c017c319 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:18:55.373992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:18:55.375290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:18:55.375727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:18:55.376177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:18:55.378200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:18:55.391236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:18:55.392984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:18:55.409965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3147/6322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:18:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:00.513952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57788546-6da8-435c-b501-257986a3ef22 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:00.514466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57788546-6da8-435c-b501-257986a3ef22 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:00.514742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57788546-6da8-435c-b501-257986a3ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:00.590065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-57788546-6da8-435c-b501-257986a3ef22 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:00.591394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-57788546-6da8-435c-b501-257986a3ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:00.658109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3176/6323] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:19:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:00.671375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:00.672869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:00.743393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e05316-54dd-4473-bfcb-0a2a6b4500fb service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:00.749117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:00.749707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:00.750015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:00.750293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:00.759077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:00.760683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:00.769729 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3148/6324] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:19:02.537958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57788546-6da8-435c-b501-257986a3ef22 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:02.540421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-57788546-6da8-435c-b501-257986a3ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:02.563131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57788546-6da8-435c-b501-257986a3ef22 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:02.571872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:02.573221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:02.573894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:02.574417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] PATH_INFO: `/v3/users/7726a2bc4958475680e70966d92fc50f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:02.576085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7726a2bc4958475680e70966d92fc50f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:02.579020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:02.663327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7726a2bc4958475680e70966d92fc50f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:02.683459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7726a2bc4958475680e70966d92fc50f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:02.684967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7726a2bc4958475680e70966d92fc50f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:02.719869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7726a2bc4958475680e70966d92fc50f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:02.727935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a55d0c54-adff-4c14-a473-432994b3e1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7726a2bc4958475680e70966d92fc50f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:02.733813 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3177/6325] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:02 2021] DELETE /identity/v3/users/7726a2bc4958475680e70966d92fc50f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:02.918933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:02.944144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214485b-fba9-4d4b-bcf7-74b82a7893b5 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:02.997053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:02.997328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:02.997795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.031716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:03.033484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.085316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.086658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.087875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.088307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] PATH_INFO: `/v3/projects/805d7a00cdff46bf93787cb1abccceba` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.090791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=805d7a00cdff46bf93787cb1abccceba)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.093567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.098033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3178/6326] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:19:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:03.116710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.118675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.153003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805d7a00cdff46bf93787cb1abccceba', 'request_id': 'req-e8f4b60c-f307-4b78-a787-9d83bce7a78b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:03.159058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805d7a00cdff46bf93787cb1abccceba', 'request_id': 'req-e8f4b60c-f307-4b78-a787-9d83bce7a78b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:03.168400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805d7a00cdff46bf93787cb1abccceba', 'request_id': 'req-e8f4b60c-f307-4b78-a787-9d83bce7a78b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:03.184804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] The token cache is being invalidate because project 805d7a00cdff46bf93787cb1abccceba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:03.185085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:03.185718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e8f4b60c-f307-4b78-a787-9d83bce7a78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:03.187458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3149/6327] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:02 2021] DELETE /identity/v3/projects/805d7a00cdff46bf93787cb1abccceba => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:03.195951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f33e-1335-4f09-aa8c-3b1d31f396f0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.196374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f33e-1335-4f09-aa8c-3b1d31f396f0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.196684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f33e-1335-4f09-aa8c-3b1d31f396f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.209566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023e3da-103f-44d0-ac5a-00dc40ebddf1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.219565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5a11f33e-1335-4f09-aa8c-3b1d31f396f0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:03.220963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5a11f33e-1335-4f09-aa8c-3b1d31f396f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.277770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.278442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.278715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.279270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.281200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.285126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3150/6328] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:03.294126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.294484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.299796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.323533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:03.324839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.333670 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3151/6329] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:03.337798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.347635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264a0b-afd4-4341-8517-64e4a66cf353 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.352870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.353056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.353397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.353738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.354779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.354905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:03.354905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.356514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.356685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.367463 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3179/6330] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:19:03.372421 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3152/6331] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:03.373530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.388032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008872a6-306e-48a6-8cdc-392da702b0c9 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.393757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.394606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.394885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.395158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.395947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.397902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.433794 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3180/6332] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:03 2021] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:03.437409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.448877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb511-342d-4afd-91dc-ce49e648ade7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.524034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.524744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.525025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.525297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.525998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.527911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.553452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3153/6333] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:03 2021] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:03.554600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.565483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851de4b-419d-4074-8fc3-3f8697271c07 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.571209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.571870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.572154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.572429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.573200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.574871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.589282 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3181/6334] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:03.590408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.601784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcdd1b-befe-4f62-8604-1f322e1853db admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.606443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.607090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.607366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.607639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.608625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.610378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489056f7-5c53-4278-933c-7c8df2d3ba43 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.625200 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3154/6335] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:03.626681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.639280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6057-d06d-4663-ba75-c5958c19d7bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.646614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.647612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.647898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.648175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] PATH_INFO: `/v3/projects/94482b4b4b9c4b0583f87dd15521c5e6/users/adbcebe49264484fbe6a3720f3238425/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.664592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94482b4b4b9c4b0583f87dd15521c5e6, user_id=adbcebe49264484fbe6a3720f3238425, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.667605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.681442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3182/6336] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:03 2021] PUT /identity/v3/projects/94482b4b4b9c4b0583f87dd15521c5e6/users/adbcebe49264484fbe6a3720f3238425/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:03.686796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a06d2-8146-480b-85b3-1fd9020ac4be None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.687190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a06d2-8146-480b-85b3-1fd9020ac4be None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.687998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a06d2-8146-480b-85b3-1fd9020ac4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.706730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-060a06d2-8146-480b-85b3-1fd9020ac4be None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:03.708181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-060a06d2-8146-480b-85b3-1fd9020ac4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.772814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3155/6337] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:03.779924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:03.781668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:03.839363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40769-61f2-47fb-8af1-a95be4306e78 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:03.843721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:03.844388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:03.844697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:03.844963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:03.854819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:03.856221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8e0a-2425-4b85-8fa5-484f257f9dd9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:03.865398 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3183/6338] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:09.654404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:09.654876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:09.654994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:09.683929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] MFA Rules not processed for user `adbcebe49264484fbe6a3720f3238425`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:09.685358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:09.753399 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3156/6339] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:09 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:09.827272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4ed9-1e32-4925-92cb-78caca7e9438 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:09.828098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4ed9-1e32-4925-92cb-78caca7e9438 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:09.828439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4ed9-1e32-4925-92cb-78caca7e9438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:09.849359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-36fc4ed9-1e32-4925-92cb-78caca7e9438 None None] MFA Rules not processed for user `adbcebe49264484fbe6a3720f3238425`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:09.850832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36fc4ed9-1e32-4925-92cb-78caca7e9438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:09.860092 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3184/6340] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:09 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:09.872255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:09.874075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:09.971636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab39323-fad9-4b17-8766-9e9d177f62dd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:09.977511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:09.978184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:09.978447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:09.978723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:09.991347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:09.993001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:10.002518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3157/6341] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:09 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:15.115432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65ef17-cb3e-4b70-bb5f-8ff8c0f92b7d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:15.116003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65ef17-cb3e-4b70-bb5f-8ff8c0f92b7d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:15.116003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65ef17-cb3e-4b70-bb5f-8ff8c0f92b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:15.135523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ce65ef17-cb3e-4b70-bb5f-8ff8c0f92b7d None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:15.137380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ce65ef17-cb3e-4b70-bb5f-8ff8c0f92b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:15.212736 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3185/6342] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:19:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:15.230337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:15.231834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:15.331509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df527-3521-46fe-924a-2af0d3d251cc service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:15.339464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:15.340125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:15.340499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:15.340709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:15.355481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:15.357298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:15.375879 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3158/6343] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:19:16.278571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eff1-7540-4246-9055-905c81ae3178 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:16.279078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eff1-7540-4246-9055-905c81ae3178 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:16.279204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123eff1-7540-4246-9055-905c81ae3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:16.298029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d123eff1-7540-4246-9055-905c81ae3178 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:16.300013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d123eff1-7540-4246-9055-905c81ae3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:16.314041 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3186/6344] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:19:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:16.329965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:16.352100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900566-f79c-4b9f-87fe-10a57aa12977 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:16.358887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:16.359960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:16.360492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:16.360922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:16.374394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:16.376407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:16.387207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3159/6345] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:19:16.697456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb85c2-d939-449a-bf40-a1a1532adab2 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:16.697920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb85c2-d939-449a-bf40-a1a1532adab2 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:16.698299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb85c2-d939-449a-bf40-a1a1532adab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:16.724230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-06fb85c2-d939-449a-bf40-a1a1532adab2 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:16.725904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-06fb85c2-d939-449a-bf40-a1a1532adab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:16.747978 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3187/6346] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:19:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:16.760216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:16.775960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2abaf5-b1d4-4eca-8b34-d8eba7ebe1e2 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:16.786363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:16.787520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:16.788567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:16.788938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:16.812831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:16.814565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:16.825309 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3160/6347] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:19:17.259569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:17.260112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:17.260937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:17.293480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:17.295833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:17.311230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3188/6348] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:19:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:17.325832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:17.338209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde989d-161a-4ecf-913e-df161e9c8e4e service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:17.345413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:17.346438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:17.346737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:17.347223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:17.356899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:17.358476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015c7c-0649-4ca2-89e5-8b350aa8ef4d service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:17.372279 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3161/6349] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:19:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:19:19.505540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:19.506978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:19.521343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595129db-be73-47f3-b31a-4337078f98a8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:19.526121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:19.526982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:19.527256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:19.527528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] PATH_INFO: `/v3/users/1509f508db444f48a31f2ee0c980842f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:19.528778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1509f508db444f48a31f2ee0c980842f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:19.530670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:19.578657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1509f508db444f48a31f2ee0c980842f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:19.585797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1509f508db444f48a31f2ee0c980842f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:19.586471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1509f508db444f48a31f2ee0c980842f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:19.599046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1509f508db444f48a31f2ee0c980842f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:19.606981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1509f508db444f48a31f2ee0c980842f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:19.613148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3189/6350] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:19 2021] DELETE /identity/v3/users/1509f508db444f48a31f2ee0c980842f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:19.618123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:19.618614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:19.618802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:19.636685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:19.637871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:19.698045 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3162/6351] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:19.708708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:19.710103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:19.768152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4cd6d-ffd6-45b2-8bd9-de689e76bfed admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:19.773319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:19.774067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:19.774395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:19.774789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:19.784825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:19.786892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bb163-70a8-47c3-af42-99d0fea83154 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:19.796504 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3190/6352] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:19.961939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:19.963456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:19.977328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b1bf1-6460-4e55-8cc7-548db448d9f3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:19.982167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:19.983011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:19.983465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:19.983899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] PATH_INFO: `/v3/projects/7871a17d74c24db48d01976d917fdf16` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:19.985302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7871a17d74c24db48d01976d917fdf16)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:19.987354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.036386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7871a17d74c24db48d01976d917fdf16', 'request_id': 'req-75268a78-f0c7-47b7-84d8-04c4315b7738'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:20.041613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7871a17d74c24db48d01976d917fdf16', 'request_id': 'req-75268a78-f0c7-47b7-84d8-04c4315b7738'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:20.047793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7871a17d74c24db48d01976d917fdf16', 'request_id': 'req-75268a78-f0c7-47b7-84d8-04c4315b7738'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:20.059776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] The token cache is being invalidate because project 7871a17d74c24db48d01976d917fdf16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:20.060060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:20.060710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-75268a78-f0c7-47b7-84d8-04c4315b7738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:20.062249 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3163/6353] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:19 2021] DELETE /identity/v3/projects/7871a17d74c24db48d01976d917fdf16 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:20.068501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.068816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.069087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.086893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:20.087999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:20.144117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3191/6354] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:20.152719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.153008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.153303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.171259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:20.172446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:20.180213 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3164/6355] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:20.184407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.194563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392047a6-9405-415c-8eb7-79b64eb0bb4d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.199025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.199660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.199931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.201229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.202208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:20.202603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.204432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.216621 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3192/6356] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:20.221178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.230212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633b6a7-4a70-41c0-96c0-8f39fafb862e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.234760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.235401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.235696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.235944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.236673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.238556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.263887 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3165/6357] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:20 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:20.268091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.278831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a1f5-095d-4d3b-bd80-121a6a738a8d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.332956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.333621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.333896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.334289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.335006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.337003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.357449 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3193/6358] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:20 2021] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:20.361371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.372452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26673-7295-432d-b007-3a1044aaa71d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.377081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.377739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.378015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.378283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.379027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.381302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.391677 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3166/6359] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:20.395973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.406070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026cee-f62e-4c0d-a59e-e1168ab4bfa4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.410695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.411348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.411625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.411896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.412637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.414224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc588-83fe-4732-92d2-cbafdcddd0d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.424407 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3194/6360] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:20.429029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.438859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f3c3-ac8b-4e23-a3e4-6c71955351d4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.444145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.445037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.445311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.445603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] PATH_INFO: `/v3/projects/7a1459c391de4d32a954b4161a443857/users/9a70c1c56a3a40ff9dbf9ec2311a4684/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.460365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1459c391de4d32a954b4161a443857, user_id=9a70c1c56a3a40ff9dbf9ec2311a4684, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.463371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.476921 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3167/6361] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:20 2021] PUT /identity/v3/projects/7a1459c391de4d32a954b4161a443857/users/9a70c1c56a3a40ff9dbf9ec2311a4684/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:20.481848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.482440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.482716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.501082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:20.502916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:20.559526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3195/6362] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:20.570433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:20.572360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:20.628687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f30289-b8f4-44ad-820c-6cffca2bad39 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:20.633042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:20.633676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:20.633952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:20.634224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:20.643633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:20.645428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:20.655352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3168/6363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:23.253131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:23.255931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:23.270932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ab24-a735-4514-bdd0-92bd560dfde5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:23.275515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:23.276410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:23.276785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:23.277245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] PATH_INFO: `/v3/users/45ec13d633804480abc8eb86e9f072cb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:23.278463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ec13d633804480abc8eb86e9f072cb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:23.280363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:23.336627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ec13d633804480abc8eb86e9f072cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.344440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ec13d633804480abc8eb86e9f072cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.345243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ec13d633804480abc8eb86e9f072cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.366919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ec13d633804480abc8eb86e9f072cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.378137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-30d1dd07-064a-4cc7-8f4b-3e117fcb48c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ec13d633804480abc8eb86e9f072cb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.385275 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3196/6364] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:23 2021] DELETE /identity/v3/users/45ec13d633804480abc8eb86e9f072cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:23.628216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:23.641397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350dfc8-f2e3-4b8a-9635-a15b49dad414 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:23.748983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:23.750150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:23.751341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:23.752201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] PATH_INFO: `/v3/projects/8e88284f9ef743c7bd4c0df26719a5ec` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:23.756916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e88284f9ef743c7bd4c0df26719a5ec)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:23.766209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:23.877466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e88284f9ef743c7bd4c0df26719a5ec', 'request_id': 'req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.885003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e88284f9ef743c7bd4c0df26719a5ec', 'request_id': 'req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.891766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e88284f9ef743c7bd4c0df26719a5ec', 'request_id': 'req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.909736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] The token cache is being invalidate because project 8e88284f9ef743c7bd4c0df26719a5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:23.910029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.911225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7d75b41-3494-4b6e-b4d2-9e97a908bca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:23.912936 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3169/6365] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:23 2021] DELETE /identity/v3/projects/8e88284f9ef743c7bd4c0df26719a5ec => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:23.922474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:23.922810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:23.923089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:23.954764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:23.957071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:24.065950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3197/6366] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:24.075520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.076082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.076594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.100735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:24.102507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:24.115349 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3170/6367] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:24.120639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.132316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f681d-58b7-42f6-b8bb-b76c0923e63e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.139293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.141003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.141766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.142266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.143689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:24.145517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.148069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.165555 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3198/6368] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:24.169985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.190540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51dfc7-60ef-4588-a751-ed4ceeceee45 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.199055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.200914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.201636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.202137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.203938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.206790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.258604 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3171/6369] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:24 2021] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:24.262870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.283770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae5b8a-ba6b-431b-a9e5-f14852d2e8d4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.363334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.364245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.364928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.365379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.366321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.368391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.393700 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3199/6370] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:24 2021] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:24.398984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.428294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a838-1ee1-415b-ac46-bc8ab3226849 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.436950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.438848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.440260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.440260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.441149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.443957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.462254 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3172/6371] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:24 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:24.463483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.476790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7de48-1397-40dc-8831-cb363283aa06 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.484698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.485420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.485700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.486455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.487707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.490375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a66b3b-f670-43c2-9d91-e5d2596f10f0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.517096 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3200/6372] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:24 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:24.530253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.545774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95043-d389-4409-b12e-6df59981eb16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.557415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.558495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.558763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.559040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] PATH_INFO: `/v3/projects/193a360e8af146719e682f55a72af991/users/fc286776d1d64e64bbade9266eea0d81/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.594842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=193a360e8af146719e682f55a72af991, user_id=fc286776d1d64e64bbade9266eea0d81, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:24.601106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:24.633666 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3173/6373] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:24 2021] PUT /identity/v3/projects/193a360e8af146719e682f55a72af991/users/fc286776d1d64e64bbade9266eea0d81/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:24.643682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.644111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.644485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.700843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] MFA Rules not processed for user `fc286776d1d64e64bbade9266eea0d81`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:24.702341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:24.838474 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3201/6374] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:24 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:24.845723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:24.986995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5252a-336a-4b67-878c-1a475836d5ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:24.997488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:24.998168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:24.998445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:24.998716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:24.999589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.001518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.063356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3174/6375] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:24 2021] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:25.067879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.093420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147ae1f-a728-4042-86d3-9c6a09e3b4af None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.195888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.196850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.197229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.197678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.198565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.204302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.239707 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3202/6376] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:25 2021] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:25.240498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.272750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40202-59d7-4717-9fa3-75ccbdfec9e0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.278699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.279532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.279814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.280633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.281481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.284636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.305769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.313647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3175/6377] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:25 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:25.318657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f7f0-143b-44ab-a765-782d889c7c99 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.324000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.325266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.325701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.326158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] PATH_INFO: `/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8/users/4a4024b0fe874b4ead0313c0ddd47280/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.353707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcde1ebca7b4a04866cb01a1390b9f8, user_id=4a4024b0fe874b4ead0313c0ddd47280, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.358074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.377165 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3203/6378] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:25 2021] PUT /identity/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8/users/4a4024b0fe874b4ead0313c0ddd47280/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:25.382036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.395507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5273-c29b-42b1-a894-f29fc34a35b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.459599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.460283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.460570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.461336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.461704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.463641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a9cc8-11be-43a7-b369-27b29ee93f62 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.476792 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3176/6379] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:25 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:25.479237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.494125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac2b3-bd89-4b41-9c9b-2bf4ce67136e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.499174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.500058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.500330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.500597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] PATH_INFO: `/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8/users/4a4024b0fe874b4ead0313c0ddd47280/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.502592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcde1ebca7b4a04866cb01a1390b9f8, user_id=4a4024b0fe874b4ead0313c0ddd47280, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.506171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.517413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3204/6380] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:25 2021] PUT /identity/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8/users/4a4024b0fe874b4ead0313c0ddd47280/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:25.528781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.529225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.529655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.563612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] MFA Rules not processed for user `4a4024b0fe874b4ead0313c0ddd47280`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:25.565780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:25.697574 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3177/6381] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:25 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:25.703662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.733202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469728b-f5aa-4af9-ba0a-d2c2158feedd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.746080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.746829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.747023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.747485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.748408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.750023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.777303 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3205/6382] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:19:25 2021] POST /identity/v3/domains => generated 275 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:25.781593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.795725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f6c7-5a8c-4536-8172-00fba3681fc2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.887525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.888383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.888821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.889235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.890061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.892098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.930617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3178/6383] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:25 2021] POST /identity/v3/users => generated 348 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:25.931779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.942973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df04e82-787b-4721-a2a5-8bc3276d8aa4 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:25.948152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:25.948883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:25.949170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:25.949448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:25.950170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:25.952035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:25.981165 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3206/6384] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:25 2021] POST /identity/v3/users => generated 324 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:25.985556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:25.996385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5239a1-c194-40ff-b57c-f73ad28e04cf tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.001631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.002521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.002808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.003090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users/98776a8f11eb4e10b1a47db2014e1ba1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.019561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:get_user(user_id=98776a8f11eb4e10b1a47db2014e1ba1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.022320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.024098 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3179/6385] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:19:25 2021] GET /identity/v3/users/98776a8f11eb4e10b1a47db2014e1ba1 => generated 348 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:26.031103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.042501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58364f2-6798-4ae7-b715-1820a07612a7 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.047946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.048886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.049173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.049450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.050731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Adding query filter params (domain_id=08454d03954747b685972cce7ed455ad) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:26.051070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.053364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.069236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3207/6386] 10.222.0.13 () {58 vars in 1206 bytes} [Wed Nov 10 04:19:26 2021] GET /identity/v3/users?domain_id=08454d03954747b685972cce7ed455ad => generated 485 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:26.074726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.086579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93acfa-addb-49b8-ae08-9f9f8a5de382 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.094668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.095659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.095808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.096226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.097139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.099314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.144289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3180/6387] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:26 2021] GET /identity/v3/users => generated 7161 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:26.146639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.158049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e548e-4f71-4a14-8928-7ed03f1d41ba tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.163194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.163868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.164151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.164425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.165351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1435338364) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:26.165602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.167740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.192831 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3208/6388] 10.222.0.13 () {58 vars in 1188 bytes} [Wed Nov 10 04:19:26 2021] GET /identity/v3/users?name=tempest-test_user-1435338364 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:26.193740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.204459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73e3e-eb4e-4e8c-a84a-315de214cbc2 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.211430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.212260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.212653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.213258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.213788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:26.214118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.216104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.248705 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3181/6389] 10.222.0.13 () {58 vars in 1148 bytes} [Wed Nov 10 04:19:26 2021] GET /identity/v3/users?enabled=False => generated 432 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:19:26.251852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.264158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84013bf-b206-4421-9cbc-73e3789c1b89 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.270673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.271559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.271938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.272121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users/d05c25af5bb34c61a82392292099bfaf` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.288118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d05c25af5bb34c61a82392292099bfaf)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.290514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.344943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05c25af5bb34c61a82392292099bfaf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.355084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05c25af5bb34c61a82392292099bfaf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.356737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05c25af5bb34c61a82392292099bfaf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.372185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05c25af5bb34c61a82392292099bfaf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.386980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05c25af5bb34c61a82392292099bfaf'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.401992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.402148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3209/6390] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:26 2021] DELETE /identity/v3/users/d05c25af5bb34c61a82392292099bfaf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:26.403850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:26.417304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2643f0-2025-4f47-b502-7f184e4d897a tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.484225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.485148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.485434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.485711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/users/98776a8f11eb4e10b1a47db2014e1ba1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.487221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98776a8f11eb4e10b1a47db2014e1ba1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.489785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.543678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98776a8f11eb4e10b1a47db2014e1ba1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.553295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98776a8f11eb4e10b1a47db2014e1ba1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.553960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98776a8f11eb4e10b1a47db2014e1ba1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.554579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98776a8f11eb4e10b1a47db2014e1ba1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.564078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98776a8f11eb4e10b1a47db2014e1ba1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.594665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.595802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3182/6391] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:26 2021] DELETE /identity/v3/users/98776a8f11eb4e10b1a47db2014e1ba1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:26.607722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6dd52-7034-456b-883a-8937198ebee6 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.703341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.704506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.704962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.705357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/domains/08454d03954747b685972cce7ed455ad` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.707021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08454d03954747b685972cce7ed455ad)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:26.708863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:26.738051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.739815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.794586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.795683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-898ebf96-3905-42cf-9d94-62841bc93366 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:26.801802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3210/6392] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:19:26 2021] PATCH /identity/v3/domains/08454d03954747b685972cce7ed455ad => generated 276 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:26.804731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:26.809601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:26.832446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b0bc-fca5-4b33-938b-0a58cafbbc56 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:26.970535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.970825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.971282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:26.989813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4024b0fe874b4ead0313c0ddd47280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dcde1ebca7b4a04866cb01a1390b9f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:26.990683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:26.990960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:26.991232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] PATH_INFO: `/v3/domains/08454d03954747b685972cce7ed455ad` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.027514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08454d03954747b685972cce7ed455ad)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.030463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.037463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] MFA Rules not processed for user `9a70c1c56a3a40ff9dbf9ec2311a4684`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:27.040065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.092639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.117184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08454d03954747b685972cce7ed455ad'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.151456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3211/6393] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:26 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:27.156056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.162469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.174077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.180535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.188196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.206062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] The token cache is being invalidate because project 08454d03954747b685972cce7ed455ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:27.206490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.207932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.215990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.219575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.220401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08454d03954747b685972cce7ed455ad', 'request_id': 'req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.229954 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3183/6394] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:19:26 2021] DELETE /identity/v3/domains/08454d03954747b685972cce7ed455ad => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:27.234273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.236642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.242506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc97e3e-bd4d-4841-bdaf-ca22a4d17986 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.303568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.304234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.304509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.304811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.305522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.306810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e2d5-d7e6-4014-a37c-1fdb5eed3506 tempest-UsersV3TestJSON-2022091181 tempest-UsersV3TestJSON-2022091181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.307501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.311625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.312497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.312819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.313100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] PATH_INFO: `/v3/users/fc286776d1d64e64bbade9266eea0d81` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.314329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc286776d1d64e64bbade9266eea0d81)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.316228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.328972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3212/6395] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:27 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:27.333154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.341988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.360644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953560-27de-4991-87c1-f2b4982e2a3b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.366185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.366870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.367386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.367675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.368771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.373719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.385734 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3213/6396] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:27 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:27.390630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.402241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc286776d1d64e64bbade9266eea0d81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.405176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02b42-5b44-48d6-b427-cb7b4446f0fd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.413576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.415058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.415294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc286776d1d64e64bbade9266eea0d81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.415807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.416033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc286776d1d64e64bbade9266eea0d81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.416507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] PATH_INFO: `/v3/system/users/8d7ccca9ac4b4b08bb787c7c897d26ad/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.416725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc286776d1d64e64bbade9266eea0d81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.428284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-74c4074c-6596-47ec-b811-41c53afa82b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc286776d1d64e64bbade9266eea0d81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:27.441214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d7ccca9ac4b4b08bb787c7c897d26ad, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.441323 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:19:27.441323 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:19:27.441323 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:19:27.443559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd583ce-065b-4d9e-988b-3d3de8fc6915 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.459571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3214/6397] 10.222.0.13 () {60 vars in 1377 bytes} [Wed Nov 10 04:19:27 2021] PUT /identity/v3/system/users/8d7ccca9ac4b4b08bb787c7c897d26ad/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:27.470818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.471209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.471470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.483484 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3184/6398] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:27 2021] DELETE /identity/v3/users/fc286776d1d64e64bbade9266eea0d81 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:27.485635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.486412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.491550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.506213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] MFA Rules not processed for user `8d7ccca9ac4b4b08bb787c7c897d26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:27.508157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.517202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:27.518662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.601603 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3185/6399] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:27.612585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.614114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:27.637033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3215/6400] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:27 2021] POST /identity/v3/auth/tokens => generated 2404 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 10 04:19:27.639311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:27.698669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6574-84bb-47df-a21f-a5611e86f4c6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.703960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.705123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.705472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.705817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.722377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.724490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.743018 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3186/6401] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:27.781219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9db70-cbd2-48ea-850b-ed8fb202652a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:27.845078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7ccca9ac4b4b08bb787c7c897d26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:27.845940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:27.846422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:27.846892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:27.848036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:27.849985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:27.858842 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3216/6402] 10.222.0.13 () {58 vars in 1109 bytes} [Wed Nov 10 04:19:27 2021] GET /identity/v3/services => generated 2191 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:27.863116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:28.001784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c241-2f5b-42e2-be74-214a36d171f8 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:28.052795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7ccca9ac4b4b08bb787c7c897d26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:28.052795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:28.052795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:28.053067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] PATH_INFO: `/v3/limits` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:28.053436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:28.055336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:28.090817 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Nov 10 04:19:28.096444 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3187/6403] 10.222.0.13 () {60 vars in 1125 bytes} [Wed Nov 10 04:19:27 2021] POST /identity/v3/limits => generated 124 bytes in 234 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:19:28.097474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:28.149786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:28.151814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:28.191183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4d75-5fbb-4b9c-9a28-4a793c03635e None tempest-ImageQuotaTest-819726568-system-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:28.205518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:28.205853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:28.206138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:28.209356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] PATH_INFO: `/v3/projects/193a360e8af146719e682f55a72af991` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:28.215457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] RBAC: Authorizing `identity:delete_project(project_id=193a360e8af146719e682f55a72af991)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:28.219863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:28.272692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c273e-65b1-4806-b97e-02a7b6f7ca6b None tempest-ImageQuotaTest-819726568-system-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:28.340339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193a360e8af146719e682f55a72af991', 'request_id': 'req-0421fc72-5e7d-4cbc-9c41-a517e38c269b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.347722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193a360e8af146719e682f55a72af991', 'request_id': 'req-0421fc72-5e7d-4cbc-9c41-a517e38c269b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.359411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193a360e8af146719e682f55a72af991', 'request_id': 'req-0421fc72-5e7d-4cbc-9c41-a517e38c269b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.367730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7ccca9ac4b4b08bb787c7c897d26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:28.369165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:28.369796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:28.370287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:28.371331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:28.372711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:28.381677 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3217/6404] 10.222.0.13 () {58 vars in 1136 bytes} [Wed Nov 10 04:19:28 2021] GET /identity/v3/registered_limits => generated 129 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:19:28.388447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:28.397182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] The token cache is being invalidate because project 193a360e8af146719e682f55a72af991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:28.398069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.399086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.402017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3188/6405] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:28 2021] DELETE /identity/v3/projects/193a360e8af146719e682f55a72af991 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:28.406024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:28.409340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:28.515823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421fc72-5e7d-4cbc-9c41-a517e38c269b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:28.521790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:28.523389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:28.523672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:28.523942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] PATH_INFO: `/v3/users/4a4024b0fe874b4ead0313c0ddd47280` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:28.525310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4024b0fe874b4ead0313c0ddd47280)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:28.531526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:28.553066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38168-3866-4fcd-a74c-bca76427ab8a None tempest-ImageQuotaTest-819726568-system-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:28.617466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4024b0fe874b4ead0313c0ddd47280'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.628801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4024b0fe874b4ead0313c0ddd47280'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.630121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4024b0fe874b4ead0313c0ddd47280'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.630928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4024b0fe874b4ead0313c0ddd47280'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.633250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7ccca9ac4b4b08bb787c7c897d26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:28.634029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:28.634366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:28.635277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:28.636545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:28.638287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:28.649058 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3218/6406] 10.222.0.13 () {58 vars in 1136 bytes} [Wed Nov 10 04:19:28 2021] GET /identity/v3/registered_limits => generated 129 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:28.658466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-57f4a985-5a43-4b1b-9b1a-ca2e5860bf30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4024b0fe874b4ead0313c0ddd47280'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:28.700208 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3189/6407] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:28 2021] DELETE /identity/v3/users/4a4024b0fe874b4ead0313c0ddd47280 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:29.545467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:29.547751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:29.639249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17d56-9322-4757-b665-2fdd459b5b06 None tempest-ImageQuotaTest-819726568-system-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:29.646958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:29.648255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:29.648598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:29.648904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] PATH_INFO: `/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:29.650125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcde1ebca7b4a04866cb01a1390b9f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:29.657687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:29.774472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcde1ebca7b4a04866cb01a1390b9f8', 'request_id': 'req-e585b968-3cd0-49fd-b29b-e51b02ecb52b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:29.786725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcde1ebca7b4a04866cb01a1390b9f8', 'request_id': 'req-e585b968-3cd0-49fd-b29b-e51b02ecb52b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:29.798738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcde1ebca7b4a04866cb01a1390b9f8', 'request_id': 'req-e585b968-3cd0-49fd-b29b-e51b02ecb52b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:29.817706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] The token cache is being invalidate because project 3dcde1ebca7b4a04866cb01a1390b9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:29.818159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:29.819588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e585b968-3cd0-49fd-b29b-e51b02ecb52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:29.824670 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3219/6408] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:29 2021] DELETE /identity/v3/projects/3dcde1ebca7b4a04866cb01a1390b9f8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:29.827315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:29.828038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:29.828138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:29.847055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:29.848945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:29.963934 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3190/6409] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:30.035949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.036230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.036506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.064534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:30.065662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:30.085403 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3220/6410] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:30.090712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.104283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62090df-7ee7-4ad7-b7c9-4b4362445f3d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.110307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.111544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.111544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.111544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.112341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:30.112916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.115799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.135295 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3191/6411] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:19:30.136625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.147462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3416-03b2-4514-885f-258a88c1769c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.153308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.153962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.154234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.154495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.155193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.157184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.196138 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3221/6412] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:30.204064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.222537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323296-9aab-4e51-b15b-e1d87772beab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.315413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.316366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.317424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.317926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.318838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.321112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.361987 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3192/6413] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:30.367759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.386487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be056-d9bd-4a32-a7b8-a33480d558cf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.392809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.399717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.400087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.400368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.401823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.404302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.428601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3222/6414] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:30 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:30.429638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.444568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2535-cd70-448b-8ba8-cda4784ea211 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.461296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.462255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.462817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.463264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.464359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.466301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32000f1-0414-4e35-ac5a-dddb25ebdccc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.480359 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3193/6415] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:30 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:30.484694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.498770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ab38-fdc0-44f9-8c91-cbb3cf74589a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.510536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.511354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.511629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.511897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] PATH_INFO: `/v3/projects/9a1ba180d9894fecb64af7735d54a0ba/users/18466c2b7a034cc49efac5149f48b7ed/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.532177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1ba180d9894fecb64af7735d54a0ba, user_id=18466c2b7a034cc49efac5149f48b7ed, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.534868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.560668 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3223/6416] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:30 2021] PUT /identity/v3/projects/9a1ba180d9894fecb64af7735d54a0ba/users/18466c2b7a034cc49efac5149f48b7ed/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:30.567758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.568045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.568316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.603588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] MFA Rules not processed for user `18466c2b7a034cc49efac5149f48b7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:30.604917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:30.698219 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3194/6417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:30.702378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.802207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08244-f4ea-4899-9e28-81992b29d6bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.809405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.810300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.810758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.811189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.812283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.815336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.852843 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3224/6418] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:30.856631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:30.868189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12add-98b7-4df8-89c8-26434c78dadf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:30.950970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:30.951998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:30.952457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:30.953182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:30.954055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:30.956411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:30.990384 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3195/6419] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:30 2021] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:30.994159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.008116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d2e3-1ba5-43d9-9674-faf4129cf82c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.026951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.027710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.027998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.029128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.029328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.033515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.053325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3225/6420] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:30 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:31.057115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.070842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f2c7-d023-4f63-a3a3-148604b05f56 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.075677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.078619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.079224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.079598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] PATH_INFO: `/v3/projects/af2546ed535d4f3d80a860a4af5253cd/users/9514d7a5b0a247ea95f3d446bfd47724/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.102065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2546ed535d4f3d80a860a4af5253cd, user_id=9514d7a5b0a247ea95f3d446bfd47724, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.106634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.127581 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3196/6421] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:31 2021] PUT /identity/v3/projects/af2546ed535d4f3d80a860a4af5253cd/users/9514d7a5b0a247ea95f3d446bfd47724/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:31.132209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.144893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42872d-49d2-4ab7-86fe-82f84ca9def3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.234366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.235047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.235374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.235705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.236450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.238085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdf0be-da52-40d0-a188-61a5109cba2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.253518 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3226/6422] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:31 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:31.256444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.271899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ee35-4413-4770-97aa-5f12b5be093e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.278726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.279898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.280336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.280803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] PATH_INFO: `/v3/projects/af2546ed535d4f3d80a860a4af5253cd/users/9514d7a5b0a247ea95f3d446bfd47724/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.284044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2546ed535d4f3d80a860a4af5253cd, user_id=9514d7a5b0a247ea95f3d446bfd47724, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.287992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.299508 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3197/6423] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:31 2021] PUT /identity/v3/projects/af2546ed535d4f3d80a860a4af5253cd/users/9514d7a5b0a247ea95f3d446bfd47724/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:31.310458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.310815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.311095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.341668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] MFA Rules not processed for user `9514d7a5b0a247ea95f3d446bfd47724`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:31.343197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:31.460658 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3227/6424] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:31.462231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.478980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b92d8-2539-49cf-93c9-1b697a2074c4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.485981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.486906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.487350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.487969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.489962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.492590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95ea42-3b78-4b4a-9677-0f75bc9d2b38 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.533138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3198/6425] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/projects => generated 328 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:31.538730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.553226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209c359-e3d0-430d-b91c-d3ba47eed6b4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.578144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.578372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.578934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.602504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] MFA Rules not processed for user `694bd6d882cd4099b51d58a50f6f1ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:31.604338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:31.639166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.639789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.639894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.640112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.641219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.644563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.671218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3228/6426] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/users => generated 416 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:31.674493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.693587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bab4ed-a5b1-428f-a12e-559463efeb97 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.696361 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3199/6427] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:31.705828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.706875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.707469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.708442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.709698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.712583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.736908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3229/6428] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/roles => generated 244 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:31.741496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.765640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29b614-adeb-431b-87fb-36c2d1aefd72 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.777874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.778759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.782976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.783261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.784038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.786211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.832848 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3200/6429] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:31 2021] POST /identity/v3/roles => generated 246 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:31.832968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.842998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0ac0-f2da-4c3d-a743-aeb3959d1dd4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.847958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.848896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.849192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.849466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/7a2a36efcbb74db89779e2034c8beea1/users/efc7180f40ee4fd89ac01b36c55355c6/roles/7997ec6398a740249cce7c9e83a36478` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.866432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a2a36efcbb74db89779e2034c8beea1, user_id=efc7180f40ee4fd89ac01b36c55355c6, role_id=7997ec6398a740249cce7c9e83a36478)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.869396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:31.889708 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3230/6430] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:31 2021] PUT /identity/v3/projects/7a2a36efcbb74db89779e2034c8beea1/users/efc7180f40ee4fd89ac01b36c55355c6/roles/7997ec6398a740249cce7c9e83a36478 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:31.893923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:31.904294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86aaaa-f701-4886-aef2-ccb49ce30fff tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:31.978804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:31.980629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:31.981136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:31.981619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/7a2a36efcbb74db89779e2034c8beea1/users/efc7180f40ee4fd89ac01b36c55355c6/roles/e48c7871acc54e7fa14c1f41fa8daf3b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:31.985255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a2a36efcbb74db89779e2034c8beea1, user_id=efc7180f40ee4fd89ac01b36c55355c6, role_id=e48c7871acc54e7fa14c1f41fa8daf3b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:31.989567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.013488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.014213 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3201/6431] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:31 2021] PUT /identity/v3/projects/7a2a36efcbb74db89779e2034c8beea1/users/efc7180f40ee4fd89ac01b36c55355c6/roles/e48c7871acc54e7fa14c1f41fa8daf3b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:32.025802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342761-78e6-436e-9338-85e73e85866b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.122232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.123156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.123630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.124094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.125115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.127558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9c0e-4cbe-4ebe-a6b6-fe0d9e56487d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.151617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.153738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.167332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3231/6432] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:32 2021] GET /identity/v3/users => generated 7192 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:32.172202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.172500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.172812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.219243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] MFA Rules not processed for user `efc7180f40ee4fd89ac01b36c55355c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:32.220820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.228439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2bed-f4cb-4773-84f0-1d14eb539fa4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.232141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.232912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.233119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.233345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.235118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.247970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.250199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4439-2754-45b6-a382-a6456ef107b3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.265028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3202/6433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:19:32.293622 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3232/6434] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:32 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:32.305347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.305633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.305910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.324598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] MFA Rules not processed for user `efc7180f40ee4fd89ac01b36c55355c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:32.325845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.334505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3203/6435] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:32 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:32.338828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.350408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b685c-4187-4e8d-a701-062ec94d70d8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.354901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc7180f40ee4fd89ac01b36c55355c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2a36efcbb74db89779e2034c8beea1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-658972978', 'tempest-DelegatedRole-1711521816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.355592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.355876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.356150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.356952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.358185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.464862 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3233/6436] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:32 2021] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:32.469641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.515835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69255982-ed79-4635-8975-643f5e357aa8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.533417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.534183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.534530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.534873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.537269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.538374 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_trusts failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:19:32.538374 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:19:32.538374 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:19:32.541502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.561174 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3204/6437] 10.222.0.13 () {58 vars in 1154 bytes} [Wed Nov 10 04:19:32 2021] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:32.562470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.594682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232de90c-2dbb-4d9a-bb66-559af89c2f4d tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.608494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc7180f40ee4fd89ac01b36c55355c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2a36efcbb74db89779e2034c8beea1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-658972978', 'tempest-DelegatedRole-1711521816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.608494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.608795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.609333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] PATH_INFO: `/v3/OS-TRUST/trusts/858a4429ffde4246b7f456d4955aedb6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.631384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: Authorizing `identity:delete_trust(trust_id=858a4429ffde4246b7f456d4955aedb6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.633650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.674224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '858a4429ffde4246b7f456d4955aedb6', 'request_id': 'req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:32.678056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '858a4429ffde4246b7f456d4955aedb6', 'request_id': 'req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:32.721174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '858a4429ffde4246b7f456d4955aedb6', 'request_id': 'req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:32.729569 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3234/6438] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:19:32 2021] DELETE /identity/v3/OS-TRUST/trusts/858a4429ffde4246b7f456d4955aedb6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:32.733925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.737614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.766837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ff80-6f3a-494e-a472-b60106749788 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.773705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc7180f40ee4fd89ac01b36c55355c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2a36efcbb74db89779e2034c8beea1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-658972978', 'tempest-DelegatedRole-1711521816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.774634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.774982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.775384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] PATH_INFO: `/v3/OS-TRUST/trusts/858a4429ffde4246b7f456d4955aedb6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.795526 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Could not find trust: 858a4429ffde4246b7f456d4955aedb6.: keystone.exception.TrustNotFound: Could not find trust: 858a4429ffde4246b7f456d4955aedb6. Nov 10 04:19:32.800236 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3205/6439] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:32 2021] GET /identity/v3/OS-TRUST/trusts/858a4429ffde4246b7f456d4955aedb6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:19:32.802228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.807956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.828666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b0b72-a096-4963-9ac6-b53cb0e41e08 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.836266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.837304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.837656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.839311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/e48c7871acc54e7fa14c1f41fa8daf3b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.841742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e48c7871acc54e7fa14c1f41fa8daf3b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.844729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:32.895725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role e48c7871acc54e7fa14c1f41fa8daf3b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:32.896284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:32.897280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:32.899851 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3235/6440] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:32 2021] DELETE /identity/v3/roles/e48c7871acc54e7fa14c1f41fa8daf3b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:32.903914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:32.906373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:32.923873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a8d7-3535-4d2e-b2d7-ef69c48d7574 tempest-TrustsV3TestJSON-954334908 tempest-user-1252055907] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:32.987544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:32.989416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:32.989896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:32.990647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/7997ec6398a740249cce7c9e83a36478` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:32.992437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7997ec6398a740249cce7c9e83a36478)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:32.994421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.067363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role 7997ec6398a740249cce7c9e83a36478 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:33.067856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.070810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.076327 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3206/6441] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:32 2021] DELETE /identity/v3/roles/7997ec6398a740249cce7c9e83a36478 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:33.078577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.092858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2233a-5f37-49d0-8eef-33fb727d81d9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.189020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.190174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.190614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.191038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/efc7180f40ee4fd89ac01b36c55355c6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.193158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efc7180f40ee4fd89ac01b36c55355c6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.195597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.252099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc7180f40ee4fd89ac01b36c55355c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.259392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc7180f40ee4fd89ac01b36c55355c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.260218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc7180f40ee4fd89ac01b36c55355c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.270702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.272111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.282414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc7180f40ee4fd89ac01b36c55355c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.291347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc7180f40ee4fd89ac01b36c55355c6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.299019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3236/6442] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:33 2021] DELETE /identity/v3/users/efc7180f40ee4fd89ac01b36c55355c6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:33.302847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.306723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.373498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfad3-673c-40a8-b387-60bdba48d7ad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.385850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4199-8d25-4e8a-bc68-df791084171f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.392879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.395616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.395898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.396170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/7a2a36efcbb74db89779e2034c8beea1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.397448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a2a36efcbb74db89779e2034c8beea1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.399354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.444193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.445446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.446021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.446542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] PATH_INFO: `/v3/users/9a70c1c56a3a40ff9dbf9ec2311a4684` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.448063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a70c1c56a3a40ff9dbf9ec2311a4684)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.450199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.465299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2a36efcbb74db89779e2034c8beea1', 'request_id': 'req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.472086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2a36efcbb74db89779e2034c8beea1', 'request_id': 'req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.484697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2a36efcbb74db89779e2034c8beea1', 'request_id': 'req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.504687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project 7a2a36efcbb74db89779e2034c8beea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:33.505277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.505943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.507786 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3237/6443] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:33 2021] DELETE /identity/v3/projects/7a2a36efcbb74db89779e2034c8beea1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:33.507913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a70c1c56a3a40ff9dbf9ec2311a4684'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.513926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.515591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.516450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a70c1c56a3a40ff9dbf9ec2311a4684'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.517359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a70c1c56a3a40ff9dbf9ec2311a4684'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.518071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a70c1c56a3a40ff9dbf9ec2311a4684'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.526549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a70c1c56a3a40ff9dbf9ec2311a4684'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.544223 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3207/6444] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:33 2021] DELETE /identity/v3/users/9a70c1c56a3a40ff9dbf9ec2311a4684 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:33.595375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f970e-d2eb-4941-a42d-fb0dc7c43b8b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.650485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.651148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.651425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.651840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.652558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.654454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.680356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3238/6445] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:33 2021] POST /identity/v3/projects => generated 328 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:33.684595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.686022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.700848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080aff7-59c0-42a2-aadb-92cf8524ac4f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.717754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.720007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.772187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.772968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.773271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.773588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.774260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.776211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.796508 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3208/6446] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:33 2021] POST /identity/v3/users => generated 416 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:33.801493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.812015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11caeb-b678-4502-afbd-33d71d4c2e81 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.812705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633500be-ecb4-4ccc-93e3-792bf3980227 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.817607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.818630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.818831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.818831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.818831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.819204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.819417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.819533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.819622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] PATH_INFO: `/v3/projects/7a1459c391de4d32a954b4161a443857` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.820965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1459c391de4d32a954b4161a443857)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.821403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.822889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:33.852897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3209/6447] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:33 2021] POST /identity/v3/roles => generated 243 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:33.858230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.873353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60195a8-3661-41ed-8efa-d84060bc7559 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:33.899826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1459c391de4d32a954b4161a443857', 'request_id': 'req-da88f936-f4ba-4887-8e76-1bdc2df19a78'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.907143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1459c391de4d32a954b4161a443857', 'request_id': 'req-da88f936-f4ba-4887-8e76-1bdc2df19a78'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.915383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1459c391de4d32a954b4161a443857', 'request_id': 'req-da88f936-f4ba-4887-8e76-1bdc2df19a78'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.947803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] The token cache is being invalidate because project 7a1459c391de4d32a954b4161a443857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:33.948244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.950798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:33.956919 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3239/6448] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:33 2021] DELETE /identity/v3/projects/7a1459c391de4d32a954b4161a443857 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:33.958897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:33.963506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:33.967516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:33.969838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:33.970278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:33.972894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:33.973890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:33.978466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.020867 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3210/6449] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:33 2021] POST /identity/v3/roles => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:34.024631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.026611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.039516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008981a7-895f-4581-8b91-c7e32e634d4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.047452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.048363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.048688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.050584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e/users/2eca5376d94e46b1a569a0cfc6307a29/roles/a0da025d4045477082539da0daad9542` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.079011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eaa5f5e95b7047ca89ab001b2d58f88e, user_id=2eca5376d94e46b1a569a0cfc6307a29, role_id=a0da025d4045477082539da0daad9542)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.079212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f936-f4ba-4887-8e76-1bdc2df19a78 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.079302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.085648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.086677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.086797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.087079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] PATH_INFO: `/v3/users/8d7ccca9ac4b4b08bb787c7c897d26ad` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.088453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7ccca9ac4b4b08bb787c7c897d26ad)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.090392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.094315 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3211/6450] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:34 2021] PUT /identity/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e/users/2eca5376d94e46b1a569a0cfc6307a29/roles/a0da025d4045477082539da0daad9542 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:34.098765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.155272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7ccca9ac4b4b08bb787c7c897d26ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.163369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7ccca9ac4b4b08bb787c7c897d26ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.164058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7ccca9ac4b4b08bb787c7c897d26ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.170359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3846f-bda5-4268-b1fd-c42ec1bf4529 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.175234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.177109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.177384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.177656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e/users/2eca5376d94e46b1a569a0cfc6307a29/roles/e494de37074949a9aeb15febe26270e5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.177967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7ccca9ac4b4b08bb787c7c897d26ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.179990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eaa5f5e95b7047ca89ab001b2d58f88e, user_id=2eca5376d94e46b1a569a0cfc6307a29, role_id=e494de37074949a9aeb15febe26270e5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.182975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b9ac-493f-4ad5-840c-06d60427ef8d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.187683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7ccca9ac4b4b08bb787c7c897d26ad'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.195811 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3240/6451] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:33 2021] DELETE /identity/v3/users/8d7ccca9ac4b4b08bb787c7c897d26ad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:34.196562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3212/6452] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:34 2021] PUT /identity/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e/users/2eca5376d94e46b1a569a0cfc6307a29/roles/e494de37074949a9aeb15febe26270e5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:34.202224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.204228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.277813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66becbcc-7465-4396-8ccf-82c8e0f26976 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.283038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.283706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.284038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.284320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.285699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.287754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb53c2-f4ef-4a50-82bc-ac8b0e35646b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.319495 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3241/6453] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:34 2021] GET /identity/v3/users => generated 6640 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:34.324575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.324892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.325795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.378667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] MFA Rules not processed for user `2eca5376d94e46b1a569a0cfc6307a29`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:34.379927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.453698 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3213/6454] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:34.463441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.463761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.464000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.483406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] MFA Rules not processed for user `2eca5376d94e46b1a569a0cfc6307a29`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:34.484947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.489338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.491081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.503011 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3242/6455] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:34.512104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.521996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65f86b-5cc9-4862-8538-0a2e4c6b9012 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.526629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eca5376d94e46b1a569a0cfc6307a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2114551298', 'tempest-DelegatedRole-478203259'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.527353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.527890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.528156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.529070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.530289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.578651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d074-f99b-4f2f-ae89-4668ceac9318 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.592210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.592865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.593142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.593412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.604884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.606996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.614760 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3243/6456] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:34.615997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.621569 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d2fc8e9a-cc84-433d-aa3f-fc764e51b046 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Nov 10 04:19:34.623151 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3214/6457] 10.222.0.13 () {58 vars in 1148 bytes} [Wed Nov 10 04:19:34 2021] DELETE /identity/v3/projects/None => generated 85 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 04:19:34.631257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812613-52b0-4c6b-a9a6-6eb3b229f51a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.631540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812613-52b0-4c6b-a9a6-6eb3b229f51a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.631819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812613-52b0-4c6b-a9a6-6eb3b229f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.639111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb48df-eae3-4ade-ad9c-901d034aced6 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.651119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-36812613-52b0-4c6b-a9a6-6eb3b229f51a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:34.651324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eca5376d94e46b1a569a0cfc6307a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2114551298', 'tempest-DelegatedRole-478203259'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.651801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.652081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.652373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-36812613-52b0-4c6b-a9a6-6eb3b229f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.652502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.653157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.655381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.663227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3244/6458] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Nov 10 04:19:34 2021] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=2eca5376d94e46b1a569a0cfc6307a29 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:34.664746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3215/6459] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:34.667695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.670926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.671189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.672602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.685140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b962d-d8c0-4dcb-be62-e2ab81f430c8 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.691787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eca5376d94e46b1a569a0cfc6307a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2114551298', 'tempest-DelegatedRole-478203259'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.692466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.692805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.693086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] PATH_INFO: `/v3/OS-TRUST/trusts/be5a21e2095c4c2d94e9a13708f8f70e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.701478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorizing `identity:delete_trust(trust_id=be5a21e2095c4c2d94e9a13708f8f70e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.703387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.713644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:34.714857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.720924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'be5a21e2095c4c2d94e9a13708f8f70e', 'request_id': 'req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.721836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'be5a21e2095c4c2d94e9a13708f8f70e', 'request_id': 'req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.724630 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3216/6460] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:34.728741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.730399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'be5a21e2095c4c2d94e9a13708f8f70e', 'request_id': 'req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.738992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9473b2-e69c-4e44-9360-ad7f244b4f7f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.739501 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3245/6461] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:19:34 2021] DELETE /identity/v3/OS-TRUST/trusts/be5a21e2095c4c2d94e9a13708f8f70e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:34.744283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.745771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.749525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.750332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.750730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.751129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.752109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:34.752446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.754510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.763297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1dda5-cea2-4b45-9aff-d8b74d6c4979 tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.768669 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3217/6462] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:19:34.772390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eca5376d94e46b1a569a0cfc6307a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2114551298', 'tempest-DelegatedRole-478203259'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.773387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.773675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.773883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.774027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] PATH_INFO: `/v3/OS-TRUST/trusts/be5a21e2095c4c2d94e9a13708f8f70e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.776415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.789950 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Could not find trust: be5a21e2095c4c2d94e9a13708f8f70e.: keystone.exception.TrustNotFound: Could not find trust: be5a21e2095c4c2d94e9a13708f8f70e. Nov 10 04:19:34.791152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d9994-a440-493e-86b9-92c240cacae8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.793231 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3246/6463] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:34 2021] GET /identity/v3/OS-TRUST/trusts/be5a21e2095c4c2d94e9a13708f8f70e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:19:34.797256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.799874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.820068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.820910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.826100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.826100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.826882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.829088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.830912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b003-9221-45d9-b0cb-7ff2d98e55fb tempest-TrustsV3TestJSON-739822344 tempest-user-1575789728] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.839273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.840181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.840681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.841131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/e494de37074949a9aeb15febe26270e5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.842717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e494de37074949a9aeb15febe26270e5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:34.844411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:34.880866 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3218/6464] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:34.885303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.902351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role e494de37074949a9aeb15febe26270e5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:34.902691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.903296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:34.905439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3247/6465] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:34 2021] DELETE /identity/v3/roles/e494de37074949a9aeb15febe26270e5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:34.909279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:34.910700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:34.990001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df252f-ad25-44b3-b6ba-9ed2c139313b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.990545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7245c-8abe-43aa-85ff-73da803b5f9b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:34.995437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:34.996302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:34.996584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:34.996912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/a0da025d4045477082539da0daad9542` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:34.998427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a0da025d4045477082539da0daad9542)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.001609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.070645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role a0da025d4045477082539da0daad9542 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:35.072055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.072944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.075599 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3248/6466] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:34 2021] DELETE /identity/v3/roles/a0da025d4045477082539da0daad9542 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:35.079468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.081908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.090931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.091609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.091890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.092165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.092906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.094797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.120662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3219/6467] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:34 2021] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:35.124749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.126486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.141532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b57bb-c42d-4e40-b5e0-4f86b6eed10b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.180372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4c38a-706d-4359-8360-f0360f5e2883 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.187068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.188408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.188742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.189024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/2eca5376d94e46b1a569a0cfc6307a29` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.190333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eca5376d94e46b1a569a0cfc6307a29)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.193246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.224143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.224876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.225150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.225698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.226536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.229420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.249565 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3220/6468] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:35.255234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.265628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eca5376d94e46b1a569a0cfc6307a29'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.271923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16589-e3e8-4323-82cd-4492ef14ba33 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.276390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eca5376d94e46b1a569a0cfc6307a29'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.277234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eca5376d94e46b1a569a0cfc6307a29'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.280383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.281829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.282488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.283618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.285020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.287828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.290553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eca5376d94e46b1a569a0cfc6307a29'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.298755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eca5376d94e46b1a569a0cfc6307a29'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.303619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3221/6469] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:35.307004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3249/6470] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:35 2021] DELETE /identity/v3/users/2eca5376d94e46b1a569a0cfc6307a29 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:35.307567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.309410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.310584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.312406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.326940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8208-fab2-4c1f-aab1-c2a0948300c3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.389433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.390380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.390663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.391219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] PATH_INFO: `/v3/projects/abc6c1178ce447b7ac33663ea9dea21f/users/89d53dad7e2b4d0cbeb6703d41da920b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.399274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65767c-b704-43de-a743-907977c84118 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.405448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.406807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.407094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.407242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc6c1178ce447b7ac33663ea9dea21f, user_id=89d53dad7e2b4d0cbeb6703d41da920b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.407412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.408634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eaa5f5e95b7047ca89ab001b2d58f88e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.409785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283b44-87c9-401b-8bbd-e19ce4b6eca1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.411220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.425532 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3222/6471] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:35 2021] PUT /identity/v3/projects/abc6c1178ce447b7ac33663ea9dea21f/users/89d53dad7e2b4d0cbeb6703d41da920b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:35.430562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.431000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.431329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.450135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:35.451360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.464308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'request_id': 'req-5ccdba32-f639-43ef-870c-a20e3411dad9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.470369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'request_id': 'req-5ccdba32-f639-43ef-870c-a20e3411dad9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.477528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa5f5e95b7047ca89ab001b2d58f88e', 'request_id': 'req-5ccdba32-f639-43ef-870c-a20e3411dad9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.491349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project eaa5f5e95b7047ca89ab001b2d58f88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:35.491673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.492347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:35.498357 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3250/6472] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:35 2021] DELETE /identity/v3/projects/eaa5f5e95b7047ca89ab001b2d58f88e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:35.499373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.500831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.525538 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3223/6473] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:35.535774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.537307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:35.583031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdba32-f639-43ef-870c-a20e3411dad9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.588425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.589114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.589392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.589666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.590355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.592231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.612192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baf6f3-db3f-4ce9-828e-f1a5ba45958f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.617373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.617922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.618216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.618522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.628728 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3251/6474] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:35 2021] POST /identity/v3/projects => generated 328 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:35.628728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.629612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.631039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.642023 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3224/6475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:19:35.697744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0b6e-64d9-474f-bcd9-ac570606aade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.704256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.704998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.705289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.705893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.706828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.709849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.734549 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3252/6476] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:35 2021] POST /identity/v3/users => generated 416 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:35.738526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.764012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dbac6-6dbd-4097-905a-2a18b95c95bc service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.768063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.768779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.769242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.769598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.770865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.773207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.791488 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3225/6477] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:35 2021] POST /identity/v3/roles => generated 243 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:35.795152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.810783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe30e-71fd-4130-a2f4-07dcec327cfb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.818151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.819219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.819795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.820223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.821269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.823367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.849304 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3253/6478] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:35 2021] POST /identity/v3/roles => generated 247 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:35.850239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.866437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635b1-31af-47e2-b5bf-484a15336378 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:35.876429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:35.877323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:35.877602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:35.877883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ffe522199fe74897b889cd3a1c562aad/users/629f060d0aeb481ca0aa372df69dc710/roles/7d80fd639ca54f5da2931f90f60e7128` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:35.913767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ffe522199fe74897b889cd3a1c562aad, user_id=629f060d0aeb481ca0aa372df69dc710, role_id=7d80fd639ca54f5da2931f90f60e7128)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:35.916588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:35.941892 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3226/6479] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:35 2021] PUT /identity/v3/projects/ffe522199fe74897b889cd3a1c562aad/users/629f060d0aeb481ca0aa372df69dc710/roles/7d80fd639ca54f5da2931f90f60e7128 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:35.946159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:35.961352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229811-ad49-421c-a7bb-8aedb24a1afb tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.045121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.046363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.047404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.047901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ffe522199fe74897b889cd3a1c562aad/users/629f060d0aeb481ca0aa372df69dc710/roles/f27ec1bdc5bc4c68b517dd499628301a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.052153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ffe522199fe74897b889cd3a1c562aad, user_id=629f060d0aeb481ca0aa372df69dc710, role_id=f27ec1bdc5bc4c68b517dd499628301a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.055427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5930a-3968-488b-bfba-643fe4e424d0 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.094673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3254/6480] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:35 2021] PUT /identity/v3/projects/ffe522199fe74897b889cd3a1c562aad/users/629f060d0aeb481ca0aa372df69dc710/roles/f27ec1bdc5bc4c68b517dd499628301a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:36.098405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.112224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3e3a-7d7e-4a19-a40f-277ed141edb9 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.262487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.263584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.264158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.265449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.267403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.271683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e98f3-ef48-4248-b7b8-9117e894083c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.339986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3227/6481] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:36 2021] GET /identity/v3/users => generated 6922 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:36.345999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.346243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.346530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.414211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] MFA Rules not processed for user `629f060d0aeb481ca0aa372df69dc710`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:36.415460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:36.533439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3255/6482] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:36 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:36.544279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.544795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.545072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.565874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] MFA Rules not processed for user `629f060d0aeb481ca0aa372df69dc710`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:36.567742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:36.583734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.593324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7931d-3801-4401-ae44-aa62f52b2638 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.594578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3228/6483] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:36 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:36.599440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.600499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.600818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.601087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.601838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.603658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.695213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3256/6484] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:36 2021] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:36.697061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.708813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b33b21-e69e-4d57-a347-f16415f49850 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.714092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.714925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.715395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.715545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.724904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:get_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.726556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.744948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3229/6485] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:36 2021] GET /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a => generated 858 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:36.750258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.766716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3a4dd-e780-4526-ae9b-8ef680f8cf5b tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.781619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.782978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.783265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.783583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.791373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.792999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.805582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3257/6486] 10.222.0.13 () {58 vars in 1268 bytes} [Wed Nov 10 04:19:36 2021] GET /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:36.809553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.820864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb0e59-c1e9-4c72-a621-90903ca099e8 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.829953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.830836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.831029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.831434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/7d80fd639ca54f5da2931f90f60e7128` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.838341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a, role_id=7d80fd639ca54f5da2931f90f60e7128)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.839878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.849684 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3230/6487] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:36 2021] GET /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/7d80fd639ca54f5da2931f90f60e7128 => generated 243 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:36.854105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.865518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5eea8-df97-43f5-988b-f618d670dd1f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.874976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.875955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.876346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.877051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/7d80fd639ca54f5da2931f90f60e7128` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.885093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a, role_id=7d80fd639ca54f5da2931f90f60e7128)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.888665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.895749 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3258/6488] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:36 2021] HEAD /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/7d80fd639ca54f5da2931f90f60e7128 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 10 04:19:36.899782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.910252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab3672-6d8d-4684-8455-3fe816940667 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.914848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.915802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.916183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.916557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/f27ec1bdc5bc4c68b517dd499628301a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.923925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a, role_id=f27ec1bdc5bc4c68b517dd499628301a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.926158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:36.953984 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Could not find role: f27ec1bdc5bc4c68b517dd499628301a.: keystone.exception.RoleNotFound: Could not find role: f27ec1bdc5bc4c68b517dd499628301a. Nov 10 04:19:36.956280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3231/6489] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:36 2021] GET /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/f27ec1bdc5bc4c68b517dd499628301a => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:19:36.961605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:36.974961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad65c-b2f3-4c75-9a5a-ccbd9d183e2f tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:36.987562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:36.989456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:36.989832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:36.990280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/f27ec1bdc5bc4c68b517dd499628301a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:36.997208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a, role_id=f27ec1bdc5bc4c68b517dd499628301a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:36.999150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.015057 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Could not find role: f27ec1bdc5bc4c68b517dd499628301a.: keystone.exception.RoleNotFound: Could not find role: f27ec1bdc5bc4c68b517dd499628301a. Nov 10 04:19:37.017260 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3259/6490] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:36 2021] HEAD /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a/roles/f27ec1bdc5bc4c68b517dd499628301a => generated 0 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 10 04:19:37.021685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.031725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c66-8c91-4ef2-a9e9-b2a8ea80faab tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.037894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.038796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.040277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.040277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.046697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorizing `identity:delete_trust(trust_id=e0bfef1550d04a91a6526dba30671b3a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:37.048286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.074005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e0bfef1550d04a91a6526dba30671b3a', 'request_id': 'req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.075029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e0bfef1550d04a91a6526dba30671b3a', 'request_id': 'req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.086277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e0bfef1550d04a91a6526dba30671b3a', 'request_id': 'req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.097140 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3232/6491] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:19:37 2021] DELETE /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:37.101407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.107691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:37.137565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf573d-7035-4ae2-9780-a9d0637673c7 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.142071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629f060d0aeb481ca0aa372df69dc710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe522199fe74897b889cd3a1c562aad', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2102321118', 'tempest-DelegatedRole-945598506'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.142901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.143179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.143719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] PATH_INFO: `/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.159065 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Could not find trust: e0bfef1550d04a91a6526dba30671b3a.: keystone.exception.TrustNotFound: Could not find trust: e0bfef1550d04a91a6526dba30671b3a. Nov 10 04:19:37.161270 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3260/6492] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:37 2021] GET /identity/v3/OS-TRUST/trusts/e0bfef1550d04a91a6526dba30671b3a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:19:37.165689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.167353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:37.186527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a124a3-f112-4b03-8b1a-2ff24ae09e10 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.192328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.193345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.193625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.193899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/f27ec1bdc5bc4c68b517dd499628301a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.195500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f27ec1bdc5bc4c68b517dd499628301a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:37.197227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.251383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role f27ec1bdc5bc4c68b517dd499628301a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:37.251665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.252322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.257637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3233/6493] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:37 2021] DELETE /identity/v3/roles/f27ec1bdc5bc4c68b517dd499628301a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:37.258751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.260584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:37.279159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ba1f-2923-4107-bf33-a091569eae07 tempest-TrustsV3TestJSON-493172460 tempest-user-1969260875] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.360441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.361831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.362270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.362741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/7d80fd639ca54f5da2931f90f60e7128` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.367064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7d80fd639ca54f5da2931f90f60e7128)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:37.369005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.432204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role 7d80fd639ca54f5da2931f90f60e7128 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:37.432447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.433168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.436864 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3261/6494] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:37 2021] DELETE /identity/v3/roles/7d80fd639ca54f5da2931f90f60e7128 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:37.440159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.453230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a50f-56e8-4621-9ed3-2b5c98a37ade tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.521472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.522406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.522719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.522997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/629f060d0aeb481ca0aa372df69dc710` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.524404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=629f060d0aeb481ca0aa372df69dc710)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:37.529919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.589036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629f060d0aeb481ca0aa372df69dc710'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.598644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629f060d0aeb481ca0aa372df69dc710'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.599814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629f060d0aeb481ca0aa372df69dc710'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.600441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629f060d0aeb481ca0aa372df69dc710'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.618776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629f060d0aeb481ca0aa372df69dc710'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.638633 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3234/6495] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:37 2021] DELETE /identity/v3/users/629f060d0aeb481ca0aa372df69dc710 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:37.642596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.645431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:37.665517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7be4-4a08-46ea-a2af-850d74155a6b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:37.766306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:37.767256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:37.767790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:37.768074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ffe522199fe74897b889cd3a1c562aad` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:37.771290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffe522199fe74897b889cd3a1c562aad)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:37.773308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:37.884636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe522199fe74897b889cd3a1c562aad', 'request_id': 'req-15dc7f97-ff81-43bd-b90b-595d72054a5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.893439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe522199fe74897b889cd3a1c562aad', 'request_id': 'req-15dc7f97-ff81-43bd-b90b-595d72054a5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.900658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe522199fe74897b889cd3a1c562aad', 'request_id': 'req-15dc7f97-ff81-43bd-b90b-595d72054a5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.922881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project ffe522199fe74897b889cd3a1c562aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:37.923477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.924337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:37.926808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3262/6496] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:37 2021] DELETE /identity/v3/projects/ffe522199fe74897b889cd3a1c562aad => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:37.937816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:37.939361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:37.966441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70142-3d5f-4a54-822c-7ab3c2089b76 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.080666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.081788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.082875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.083505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.084419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.086550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.120768 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3235/6497] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:37 2021] POST /identity/v3/projects => generated 328 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:38.122109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.123749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:38.139646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7f97-ff81-43bd-b90b-595d72054a5e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.209168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.209964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.210308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.210647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.211445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.213710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.236853 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3263/6498] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/users => generated 413 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:38.241156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.256936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694745-35d3-4007-b188-606886d0ec1c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.263486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.264423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.264895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.265320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.266268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.268012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.288809 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3236/6499] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/roles => generated 244 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:38.290077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.305878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c5a8-b1eb-4c17-a30a-0524c303b22e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.311209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.311900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.312183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.312677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.313467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.315227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.333766 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3264/6500] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/roles => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:38.338121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.350526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c858-1e5d-4086-81bd-fc4b09793a4b tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.356882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.357909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.358255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.358600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/de95c09c80c846988e87b14d361cdd75/users/aa4633ad5a84404995ea80f12481e9ed/roles/dee66d2d7ced4cdd89c1ac04ac6b1840` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.380597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de95c09c80c846988e87b14d361cdd75, user_id=aa4633ad5a84404995ea80f12481e9ed, role_id=dee66d2d7ced4cdd89c1ac04ac6b1840)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.384215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.401725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3237/6501] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:38 2021] PUT /identity/v3/projects/de95c09c80c846988e87b14d361cdd75/users/aa4633ad5a84404995ea80f12481e9ed/roles/dee66d2d7ced4cdd89c1ac04ac6b1840 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:38.405781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.423680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e482-c6bf-4b08-a604-645fd715c8db tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.500459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.501709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.502065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.502399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/de95c09c80c846988e87b14d361cdd75/users/aa4633ad5a84404995ea80f12481e9ed/roles/bee31e3cb110404ba017d88d6ca8e964` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.505664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de95c09c80c846988e87b14d361cdd75, user_id=aa4633ad5a84404995ea80f12481e9ed, role_id=bee31e3cb110404ba017d88d6ca8e964)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.509142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740803d-7bbf-495a-bc90-36d84b37f64f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.532843 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3265/6502] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:38 2021] PUT /identity/v3/projects/de95c09c80c846988e87b14d361cdd75/users/aa4633ad5a84404995ea80f12481e9ed/roles/bee31e3cb110404ba017d88d6ca8e964 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:38.534730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.550481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e173b-4c0e-4775-b32b-ce03be4f2af4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.641379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.642494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.642494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.642673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.643471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.647735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a852e-e4eb-49ec-a086-f79914946e94 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:38.699607 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3238/6503] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:38 2021] GET /identity/v3/users => generated 6919 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:38.707711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.708502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.708502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.768493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] MFA Rules not processed for user `aa4633ad5a84404995ea80f12481e9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:38.770014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:38.857023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3266/6504] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:38.858634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.858919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.859198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.888646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] MFA Rules not processed for user `aa4633ad5a84404995ea80f12481e9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:38.890051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:38.900652 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3239/6505] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:38.903706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:38.915611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b144516-7910-4ef2-9516-7278c59aa35a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:38.925583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4633ad5a84404995ea80f12481e9ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de95c09c80c846988e87b14d361cdd75', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2019534886', 'tempest-DelegatedRole-1033405463'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:38.927178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:38.927629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:38.928307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:38.934294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:38.935847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:39.083868 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 10 04:19:39.088376 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3267/6506] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:38 2021] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 182 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 10 04:19:39.089609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:39.107522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a4f9-cee3-4f42-82a8-bb1234d058f4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:39.113939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:39.114912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:39.115119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:39.115347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/bee31e3cb110404ba017d88d6ca8e964` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:39.116913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bee31e3cb110404ba017d88d6ca8e964)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:39.118520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:39.171819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role bee31e3cb110404ba017d88d6ca8e964 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:39.172027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.172942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.178553 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3240/6507] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:39 2021] DELETE /identity/v3/roles/bee31e3cb110404ba017d88d6ca8e964 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:39.180383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:39.182301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:39.205185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8958f-6213-42fb-836f-c5afd05678e2 tempest-TrustsV3TestJSON-561311363 tempest-user-327179036] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:39.369627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:39.370632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:39.370969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:39.371322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/dee66d2d7ced4cdd89c1ac04ac6b1840` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:39.373045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dee66d2d7ced4cdd89c1ac04ac6b1840)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:39.374741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:39.445021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role dee66d2d7ced4cdd89c1ac04ac6b1840 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:39.445453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.446041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.453424 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3268/6508] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:39 2021] DELETE /identity/v3/roles/dee66d2d7ced4cdd89c1ac04ac6b1840 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:39.454579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:39.487782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12778-819b-485d-b7c5-a425303e9df4 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:39.621174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:39.622405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:39.622893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:39.623329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/aa4633ad5a84404995ea80f12481e9ed` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:39.625299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aa4633ad5a84404995ea80f12481e9ed)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:39.628067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:39.683588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4633ad5a84404995ea80f12481e9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.692962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4633ad5a84404995ea80f12481e9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.693713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4633ad5a84404995ea80f12481e9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.694449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4633ad5a84404995ea80f12481e9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.702239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4633ad5a84404995ea80f12481e9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.733180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3241/6509] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:39 2021] DELETE /identity/v3/users/aa4633ad5a84404995ea80f12481e9ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:39.736752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:39.739098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:39.754798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6be7e-01e8-44ed-8601-e807de455aad tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:39.830856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:39.830856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:39.830856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:39.831737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/de95c09c80c846988e87b14d361cdd75` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:39.831737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de95c09c80c846988e87b14d361cdd75)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:39.837261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:39.920532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de95c09c80c846988e87b14d361cdd75', 'request_id': 'req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.928510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de95c09c80c846988e87b14d361cdd75', 'request_id': 'req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.940595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de95c09c80c846988e87b14d361cdd75', 'request_id': 'req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.959958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project de95c09c80c846988e87b14d361cdd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:39.960533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.961517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:39.968382 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3269/6510] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:39 2021] DELETE /identity/v3/projects/de95c09c80c846988e87b14d361cdd75 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:39.970043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:39.972253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:39.989125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4210-12d5-4a6f-a5ef-ef706387bd51 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.103820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.104548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.108197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.108436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.109243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.111411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.155898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.157361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:40.159327 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3242/6511] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:39 2021] POST /identity/v3/projects => generated 328 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:40.172950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3440e8-2849-47c0-8151-0d7c9f2a0fa3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.266838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.267664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.268138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.268857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.270095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.272138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.323030 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3270/6512] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:40 2021] POST /identity/v3/users => generated 416 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:40.326030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.343538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9f9b-f9a2-472f-b643-83af9ab123b5 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.355178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.355877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.356163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.356461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.357235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.358849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.403432 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3243/6513] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:40 2021] POST /identity/v3/roles => generated 242 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:40.407825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.419189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe91fa-5bf7-4594-b479-1df34c8ce192 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.425575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.426460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.426745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.427041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.427952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.429735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.460273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3271/6514] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:40 2021] POST /identity/v3/roles => generated 246 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:40.461170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.479797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47b72-7da3-48ca-9532-66bce79d710c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.491600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.493559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.493842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.494121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ca644e508bef43aa881db9c24533c7b5/users/6a081d1395a44bb5820701256b454b6a/roles/51bbb708a47c435bb835908fbcfc9c66` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.520825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ca644e508bef43aa881db9c24533c7b5, user_id=6a081d1395a44bb5820701256b454b6a, role_id=51bbb708a47c435bb835908fbcfc9c66)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.529453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.571723 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3244/6515] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:40 2021] PUT /identity/v3/projects/ca644e508bef43aa881db9c24533c7b5/users/6a081d1395a44bb5820701256b454b6a/roles/51bbb708a47c435bb835908fbcfc9c66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:40.576287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.592205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30ddf8-894b-4512-b6aa-37b09258e89c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.725684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.726645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.726989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.727362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ca644e508bef43aa881db9c24533c7b5/users/6a081d1395a44bb5820701256b454b6a/roles/0d5aa98b895e462cb251788317e384e3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.734393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ca644e508bef43aa881db9c24533c7b5, user_id=6a081d1395a44bb5820701256b454b6a, role_id=0d5aa98b895e462cb251788317e384e3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.737071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b253663-f7a3-479d-8ee8-5f26aebab3b3 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:40.763601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3272/6516] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:40 2021] PUT /identity/v3/projects/ca644e508bef43aa881db9c24533c7b5/users/6a081d1395a44bb5820701256b454b6a/roles/0d5aa98b895e462cb251788317e384e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:40.768626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:40.790422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfef2b-b5d7-424c-8d7f-13c2df1aa97c tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:40.971231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:40.971914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:40.972193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:40.973065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:40.973849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:40.975699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68ad7a-3c82-4d92-b193-f0997d558b67 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.037922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3245/6517] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:40 2021] GET /identity/v3/users => generated 6922 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:41.040680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.041150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.041256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.121027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] MFA Rules not processed for user `6a081d1395a44bb5820701256b454b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:41.122254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:41.285708 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3273/6518] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:41 2021] POST /identity/v3/auth/tokens => generated 3267 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:41.297845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.298188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.298486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.329170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] MFA Rules not processed for user `6a081d1395a44bb5820701256b454b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:41.331118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:41.351441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3246/6519] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:41 2021] POST /identity/v3/auth/tokens => generated 3267 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:41.356233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.367193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d4fe-1670-41b5-b165-6b651d9c3735 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.372759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.373732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.374255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.374807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.375789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.378246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.523326 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3274/6520] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:41 2021] POST /identity/v3/OS-TRUST/trusts => generated 832 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:41.528135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.560964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd63bd-00da-4f92-9e84-59c866d38b59 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.571655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.572528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.572844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.573124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.606114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:get_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.610709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.630304 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3247/6521] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:41 2021] GET /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234 => generated 832 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:41.634648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.655408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5e875-e31d-400b-8b7a-c3264a1c3182 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.669186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.670670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.670972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.671253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.696535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.701027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.719455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3275/6522] 10.222.0.13 () {58 vars in 1268 bytes} [Wed Nov 10 04:19:41 2021] GET /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles => generated 369 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:41.723904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.737069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0067e-8a88-4be4-8aa3-06e3a27533c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.750250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.751397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.751910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.752347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/51bbb708a47c435bb835908fbcfc9c66` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.761833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234, role_id=51bbb708a47c435bb835908fbcfc9c66)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.764559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.781386 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3248/6523] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:41 2021] GET /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/51bbb708a47c435bb835908fbcfc9c66 => generated 242 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:41.785771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.804413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ce98-d1a5-4c5c-815a-acbad6852df7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.820917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.823070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.823530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.824191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/51bbb708a47c435bb835908fbcfc9c66` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.851247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234, role_id=51bbb708a47c435bb835908fbcfc9c66)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.852982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.862309 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3276/6524] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:41 2021] HEAD /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/51bbb708a47c435bb835908fbcfc9c66 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 10 04:19:41.866970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.878163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9622-7c5c-44ef-aaab-f48c84322dba tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.890574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.891828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.892444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.892908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/0d5aa98b895e462cb251788317e384e3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.904289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234, role_id=0d5aa98b895e462cb251788317e384e3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.906158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:41.937714 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Could not find role: 0d5aa98b895e462cb251788317e384e3.: keystone.exception.RoleNotFound: Could not find role: 0d5aa98b895e462cb251788317e384e3. Nov 10 04:19:41.944030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:41.949278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3249/6525] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:41 2021] GET /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/0d5aa98b895e462cb251788317e384e3 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:19:41.960418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c19c-fc50-4962-b18a-0e6b3a3794e1 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:41.967985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:41.969110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:41.969538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:41.969955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/0d5aa98b895e462cb251788317e384e3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:41.981999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234, role_id=0d5aa98b895e462cb251788317e384e3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:41.986282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:42.004872 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Could not find role: 0d5aa98b895e462cb251788317e384e3.: keystone.exception.RoleNotFound: Could not find role: 0d5aa98b895e462cb251788317e384e3. Nov 10 04:19:42.009993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3277/6526] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:41 2021] HEAD /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234/roles/0d5aa98b895e462cb251788317e384e3 => generated 0 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 10 04:19:42.010981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.024105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842195ec-8c97-4b2f-bc30-83769418bf0a tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:42.032673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:42.035004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:42.035283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:42.035818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:42.058015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorizing `identity:delete_trust(trust_id=1e85ed3cdd034c0988c5535a2c082234)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:42.061871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:42.090495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1e85ed3cdd034c0988c5535a2c082234', 'request_id': 'req-3108f63f-274f-4b8e-9ed6-ae54cb456511'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.092171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1e85ed3cdd034c0988c5535a2c082234', 'request_id': 'req-3108f63f-274f-4b8e-9ed6-ae54cb456511'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.104408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1e85ed3cdd034c0988c5535a2c082234', 'request_id': 'req-3108f63f-274f-4b8e-9ed6-ae54cb456511'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.119317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.121323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:42.123431 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3250/6527] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:19:42 2021] DELETE /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:42.146272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21d03-4b2b-475e-93e5-9d5806a127ec tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:42.160601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a081d1395a44bb5820701256b454b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca644e508bef43aa881db9c24533c7b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-28908223', 'tempest-NotDelegatedRole-361814977'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:42.161477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:42.162779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:42.163080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] PATH_INFO: `/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:42.190284 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Could not find trust: 1e85ed3cdd034c0988c5535a2c082234.: keystone.exception.TrustNotFound: Could not find trust: 1e85ed3cdd034c0988c5535a2c082234. Nov 10 04:19:42.195378 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3278/6528] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:42 2021] GET /identity/v3/OS-TRUST/trusts/1e85ed3cdd034c0988c5535a2c082234 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:19:42.196267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.198738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:42.226465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108f63f-274f-4b8e-9ed6-ae54cb456511 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:42.233488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:42.234672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:42.235113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:42.242027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/0d5aa98b895e462cb251788317e384e3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:42.244847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0d5aa98b895e462cb251788317e384e3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:42.249509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:42.339170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role 0d5aa98b895e462cb251788317e384e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:42.341046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.342006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.344935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3251/6529] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:42 2021] DELETE /identity/v3/roles/0d5aa98b895e462cb251788317e384e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:42.350927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.353524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:42.383424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d9702-10a3-4943-8bcd-3b98cc9823c7 tempest-TrustsV3TestJSON-468763000 tempest-user-1338106248] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:42.514632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:42.515970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:42.516407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:42.517513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/51bbb708a47c435bb835908fbcfc9c66` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:42.520492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=51bbb708a47c435bb835908fbcfc9c66)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:42.522338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:42.569854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role 51bbb708a47c435bb835908fbcfc9c66 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:42.570449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.570959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.576008 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3279/6530] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:42 2021] DELETE /identity/v3/roles/51bbb708a47c435bb835908fbcfc9c66 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:42.579107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.598883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b4b0-c986-44a9-b34c-6dfdb56b25e2 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:42.670932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:42.672367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:42.672962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:42.673497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/6a081d1395a44bb5820701256b454b6a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:42.675768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a081d1395a44bb5820701256b454b6a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:42.678064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:42.769879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a081d1395a44bb5820701256b454b6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.798260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a081d1395a44bb5820701256b454b6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.806448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a081d1395a44bb5820701256b454b6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.807563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a081d1395a44bb5820701256b454b6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.821801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a081d1395a44bb5820701256b454b6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:42.944726 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3252/6531] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:42 2021] DELETE /identity/v3/users/6a081d1395a44bb5820701256b454b6a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:42.948592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:42.950364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:42.970620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29fbb-39b5-4249-86e9-2612d57a2964 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:43.104190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:43.105368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:43.105800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:43.106251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/ca644e508bef43aa881db9c24533c7b5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:43.107638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca644e508bef43aa881db9c24533c7b5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:43.110020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:43.260645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca644e508bef43aa881db9c24533c7b5', 'request_id': 'req-0478501e-d66a-47f7-9ea0-a4646552821d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:43.271211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca644e508bef43aa881db9c24533c7b5', 'request_id': 'req-0478501e-d66a-47f7-9ea0-a4646552821d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:43.293824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca644e508bef43aa881db9c24533c7b5', 'request_id': 'req-0478501e-d66a-47f7-9ea0-a4646552821d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:43.320639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project ca644e508bef43aa881db9c24533c7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:43.320941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:43.322866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:43.332680 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3280/6532] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:42 2021] DELETE /identity/v3/projects/ca644e508bef43aa881db9c24533c7b5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:43.336940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:43.340293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:43.378786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb87b2-969b-40fc-849e-348fee866e2e tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:43.583934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:43.583934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:43.583934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:43.584669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:43.584669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:43.591642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:43.650917 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3253/6533] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:43 2021] POST /identity/v3/projects => generated 328 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:43.654665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:43.656503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:43.679938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478501e-d66a-47f7-9ea0-a4646552821d tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:43.837994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:43.841056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:43.841564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:43.842735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:43.843732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:43.847240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:43.895018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3281/6534] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:43 2021] POST /identity/v3/users => generated 413 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:43.896498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:43.922651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e938c2-0709-4922-b68e-d58b04809ea8 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:43.930367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:43.931200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:43.931639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:43.933784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:43.935259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:43.938751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:43.965725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3254/6535] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:43 2021] POST /identity/v3/roles => generated 244 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:43.969958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.009670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c1b0-25d3-4d8d-9143-06cdf9942684 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.018899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:44.020801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.021287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.021511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.022269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:44.023948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:44.047579 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3282/6536] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:19:43 2021] POST /identity/v3/roles => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:44.055398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.074672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fea3f-4a5d-4d2f-a8f5-f7cdecbd5ce7 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.104856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:44.105958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.106277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.106616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/95585cd8ec2a4201a369875c050c2126/users/57a657d4862d4fd9b7b16d366fd31c65/roles/77155a38c01a4332b11960582d90cf1e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.160093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=95585cd8ec2a4201a369875c050c2126, user_id=57a657d4862d4fd9b7b16d366fd31c65, role_id=77155a38c01a4332b11960582d90cf1e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:44.163054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:44.202164 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3255/6537] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:44 2021] PUT /identity/v3/projects/95585cd8ec2a4201a369875c050c2126/users/57a657d4862d4fd9b7b16d366fd31c65/roles/77155a38c01a4332b11960582d90cf1e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:44.203374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.216108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536003-6291-47a5-bb0f-ae20de883664 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.349593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:44.350581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.350876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.351167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/95585cd8ec2a4201a369875c050c2126/users/57a657d4862d4fd9b7b16d366fd31c65/roles/f0e579fbd917433fa237796891c9264a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.355324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:create_grant(project_id=95585cd8ec2a4201a369875c050c2126, user_id=57a657d4862d4fd9b7b16d366fd31c65, role_id=f0e579fbd917433fa237796891c9264a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:44.358338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb50cc3-ba9f-42b1-a099-98dfd59fdc72 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:44.391609 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3283/6538] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:44 2021] PUT /identity/v3/projects/95585cd8ec2a4201a369875c050c2126/users/57a657d4862d4fd9b7b16d366fd31c65/roles/f0e579fbd917433fa237796891c9264a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:44.394029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.396140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.396437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.396745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.413651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb403-0394-456a-adcd-6d00841c6742 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.463801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] MFA Rules not processed for user `89d53dad7e2b4d0cbeb6703d41da920b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:44.465247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:44.510661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:44.511434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.511789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.512126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.513011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:44.515271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eac57-8167-4b2f-a63f-282aaae0fbf1 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:44.542370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3256/6539] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:44 2021] GET /identity/v3/users => generated 6919 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:44.546926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.547307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3284/6540] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:44 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:44.547617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.547902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.552276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.554083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:44.621667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] MFA Rules not processed for user `57a657d4862d4fd9b7b16d366fd31c65`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:44.641598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:44.710577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376771e-c78b-44d2-8792-8e2a52869e3b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.717086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:44.717759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.718038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.719319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.721173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:44.742731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ddbe7-8e5b-4777-b09a-b2b58205305c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:44.778728 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3257/6541] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:44 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:44.780346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:44.792326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:44.844093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3285/6542] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:44 2021] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:44.845484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a862-e335-46ad-94a1-28651615121c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:44.845776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a862-e335-46ad-94a1-28651615121c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:44.846194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a862-e335-46ad-94a1-28651615121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:44.872098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b120a862-e335-46ad-94a1-28651615121c None None] MFA Rules not processed for user `57a657d4862d4fd9b7b16d366fd31c65`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:44.873532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b120a862-e335-46ad-94a1-28651615121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:44.941047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c845d-5a96-4a27-9e76-2e759d3b0b51 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:44.972956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3286/6543] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:44 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:44.974164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a862-e335-46ad-94a1-28651615121c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.003241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.004964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.005465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.005922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.008965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:45.065142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a862-e335-46ad-94a1-28651615121c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.073170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.073282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.073491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.073765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.075135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.077086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.099751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.105342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.111598 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3287/6544] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:44 2021] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:45.116407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.121109 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3258/6545] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:45.121829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.128578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48a59-af13-48b2-9a60-3f79c48c5fdf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.134708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8012f3-27bf-4945-8140-1c6e47f9e99f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.135673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.137345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.137345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.137345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.138152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:create_trust()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.139440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.142058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.142058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.142310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.142498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.143276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.145983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.163330 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3259/6546] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/roles => generated 1893 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:45.165178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.177781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18af72-2d63-4816-93b2-f773edccbb59 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.183125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.184027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.184305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.184578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] PATH_INFO: `/v3/projects/9d062c5f873348faa8ea2297f02c221c/users/ba402aaba0c740449b0652c7fd5ad29b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.207016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d062c5f873348faa8ea2297f02c221c, user_id=ba402aaba0c740449b0652c7fd5ad29b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.212340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.229636 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3260/6547] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:45 2021] PUT /identity/v3/projects/9d062c5f873348faa8ea2297f02c221c/users/ba402aaba0c740449b0652c7fd5ad29b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:45.231036 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3288/6548] 10.222.0.13 () {60 vars in 1173 bytes} [Wed Nov 10 04:19:45 2021] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:45.233547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.236435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.254916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838b5b-c8fd-4aac-a085-8d36eba87b89 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.320294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3d3e-85ee-4c96-b352-1b3571c21837 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.326679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.327357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.327762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.328238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.329250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.330417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.331253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.331861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.335519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.335912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.347634 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3261/6549] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/roles => generated 1893 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:45.348671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.351089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:get_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.352727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.360567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2667ad9-30a7-4db0-8a68-eff6fbb5b139 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.366557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.367459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.367738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.368011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] PATH_INFO: `/v3/projects/9d062c5f873348faa8ea2297f02c221c/users/ba402aaba0c740449b0652c7fd5ad29b/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.369979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3289/6550] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a => generated 835 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:45.374173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.374356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d062c5f873348faa8ea2297f02c221c, user_id=ba402aaba0c740449b0652c7fd5ad29b, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.382940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.385142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201de74-3521-4dde-9a55-9ea193a59401 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.389534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.390316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.390589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.390861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.398037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.400547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.406145 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3262/6551] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:45 2021] PUT /identity/v3/projects/9d062c5f873348faa8ea2297f02c221c/users/ba402aaba0c740449b0652c7fd5ad29b/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:45.410895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3290/6552] 10.222.0.13 () {58 vars in 1268 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles => generated 371 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:45.414853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.515428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38210-d437-4488-af75-9ffcdbba35f9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.520631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.521481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.521761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.522038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/77155a38c01a4332b11960582d90cf1e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.544515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:get_role_for_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a, role_id=77155a38c01a4332b11960582d90cf1e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.548147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.557339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3263/6553] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/77155a38c01a4332b11960582d90cf1e => generated 244 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:45.561518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.572767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901962b2-1b7c-4851-994a-2888a81a5152 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.578539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.579359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.579640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.579910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/77155a38c01a4332b11960582d90cf1e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.588314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:get_role_for_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a, role_id=77155a38c01a4332b11960582d90cf1e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.589888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.598648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3291/6554] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:45 2021] HEAD /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/77155a38c01a4332b11960582d90cf1e => generated 0 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 10 04:19:45.603609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.618328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f195c2-9184-432a-aad1-eb05e1caf2b8 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.623201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.624163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.624447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.624860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/f0e579fbd917433fa237796891c9264a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.633402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:get_role_for_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a, role_id=f0e579fbd917433fa237796891c9264a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.635112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.653873 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Could not find role: f0e579fbd917433fa237796891c9264a.: keystone.exception.RoleNotFound: Could not find role: f0e579fbd917433fa237796891c9264a. Nov 10 04:19:45.655505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3264/6555] 10.222.0.13 () {58 vars in 1367 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/f0e579fbd917433fa237796891c9264a => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:19:45.660555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.671511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98367e-6c2e-47d9-b116-26198eec825f tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.678406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.679591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `HEAD` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.680015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.680343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/f0e579fbd917433fa237796891c9264a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.688532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:get_role_for_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a, role_id=f0e579fbd917433fa237796891c9264a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.690614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.709444 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Could not find role: f0e579fbd917433fa237796891c9264a.: keystone.exception.RoleNotFound: Could not find role: f0e579fbd917433fa237796891c9264a. Nov 10 04:19:45.711206 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3292/6556] 10.222.0.13 () {58 vars in 1368 bytes} [Wed Nov 10 04:19:45 2021] HEAD /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a/roles/f0e579fbd917433fa237796891c9264a => generated 0 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 10 04:19:45.715311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.730728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0421a-8285-465f-8fbe-16f5eecafaa9 tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.747300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.748389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.748764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.750721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.764002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorizing `identity:delete_trust(trust_id=118606c3a24c4131ad0a5ba047eec38a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:45.767248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:45.803071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '118606c3a24c4131ad0a5ba047eec38a', 'request_id': 'req-e913a3be-1821-4862-b668-e9f3cd642beb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:45.805514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '118606c3a24c4131ad0a5ba047eec38a', 'request_id': 'req-e913a3be-1821-4862-b668-e9f3cd642beb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:45.832834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '118606c3a24c4131ad0a5ba047eec38a', 'request_id': 'req-e913a3be-1821-4862-b668-e9f3cd642beb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:45.850815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3265/6557] 10.222.0.13 () {58 vars in 1253 bytes} [Wed Nov 10 04:19:45 2021] DELETE /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:45.854873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.857615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:45.877703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e1756-3635-4576-aafc-916a613546ae tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.883058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a657d4862d4fd9b7b16d366fd31c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95585cd8ec2a4201a369875c050c2126', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1076042968', 'tempest-NotDelegatedRole-1541945868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:45.883600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:45.883879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:45.884155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] PATH_INFO: `/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:45.899273 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Could not find trust: 118606c3a24c4131ad0a5ba047eec38a.: keystone.exception.TrustNotFound: Could not find trust: 118606c3a24c4131ad0a5ba047eec38a. Nov 10 04:19:45.900921 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3293/6558] 10.222.0.13 () {58 vars in 1250 bytes} [Wed Nov 10 04:19:45 2021] GET /identity/v3/OS-TRUST/trusts/118606c3a24c4131ad0a5ba047eec38a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:19:45.904771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:45.907030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:45.993399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913a3be-1821-4862-b668-e9f3cd642beb tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:45.999437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:46.000321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:46.000627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:46.000922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/f0e579fbd917433fa237796891c9264a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:46.002582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f0e579fbd917433fa237796891c9264a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:46.004517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:46.054661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role f0e579fbd917433fa237796891c9264a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:46.055270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.056083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.063472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:46.066607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:46.075837 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3266/6559] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:45 2021] DELETE /identity/v3/roles/f0e579fbd917433fa237796891c9264a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:46.087892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe881-e861-499b-adf5-5384bb77208b tempest-TrustsV3TestJSON-907813991 tempest-user-116779196] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:46.161166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:46.162370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:46.162812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:46.163295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/roles/77155a38c01a4332b11960582d90cf1e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:46.165338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77155a38c01a4332b11960582d90cf1e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:46.167688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:46.223211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invalidating the token cache because role 77155a38c01a4332b11960582d90cf1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:46.223549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.224173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.230570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:46.241175 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3294/6560] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:46 2021] DELETE /identity/v3/roles/77155a38c01a4332b11960582d90cf1e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:46.244031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d38cc-7b3b-4acb-8fd8-8f28bf2d6046 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:46.327376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:46.329624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:46.330102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:46.330703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/users/57a657d4862d4fd9b7b16d366fd31c65` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:46.334711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_user(user_id=57a657d4862d4fd9b7b16d366fd31c65)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:46.337636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:46.403341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a657d4862d4fd9b7b16d366fd31c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.411847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a657d4862d4fd9b7b16d366fd31c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.412574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a657d4862d4fd9b7b16d366fd31c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.413550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a657d4862d4fd9b7b16d366fd31c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.423281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a657d4862d4fd9b7b16d366fd31c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.451289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3267/6561] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:46 2021] DELETE /identity/v3/users/57a657d4862d4fd9b7b16d366fd31c65 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:46.452712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:46.455416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:46.515243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ca7b-1e89-47c8-aab0-3699a3282d09 tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:46.669462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9514d7a5b0a247ea95f3d446bfd47724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af2546ed535d4f3d80a860a4af5253cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:46.671861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:46.672257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:46.672912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] PATH_INFO: `/v3/projects/95585cd8ec2a4201a369875c050c2126` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:46.674628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95585cd8ec2a4201a369875c050c2126)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:46.677939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:46.764577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95585cd8ec2a4201a369875c050c2126', 'request_id': 'req-b9c4e956-a0d1-446c-af88-599a1a13cbcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.776209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95585cd8ec2a4201a369875c050c2126', 'request_id': 'req-b9c4e956-a0d1-446c-af88-599a1a13cbcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.786640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95585cd8ec2a4201a369875c050c2126', 'request_id': 'req-b9c4e956-a0d1-446c-af88-599a1a13cbcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.811195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] The token cache is being invalidate because project 95585cd8ec2a4201a369875c050c2126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:46.811545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.812504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9c4e956-a0d1-446c-af88-599a1a13cbcd tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:46.818657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3295/6562] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:46 2021] DELETE /identity/v3/projects/95585cd8ec2a4201a369875c050c2126 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:46.822536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:46.824022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:46.938621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d470ef-9451-4bb4-9f57-4ff5d37aec2f tempest-TrustsV3TestJSON-334304323 tempest-TrustsV3TestJSON-334304323-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:47.062206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:47.063611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:47.064046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:47.064473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] PATH_INFO: `/v3/users/18466c2b7a034cc49efac5149f48b7ed` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:47.066129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18466c2b7a034cc49efac5149f48b7ed)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:47.070699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:47.150488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18466c2b7a034cc49efac5149f48b7ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:47.158276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18466c2b7a034cc49efac5149f48b7ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:47.159135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18466c2b7a034cc49efac5149f48b7ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:47.160051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18466c2b7a034cc49efac5149f48b7ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:47.170624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18466c2b7a034cc49efac5149f48b7ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:47.199419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3268/6563] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:46 2021] DELETE /identity/v3/users/18466c2b7a034cc49efac5149f48b7ed => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:47.205070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:47.205868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:47.206297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:47.241246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:47.245275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:47.329053 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3296/6564] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:47.385639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:47.387097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:47.544952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581f147-9033-4987-b6bb-1e3dbc5f4c8f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:47.563099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:47.563836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:47.564118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:47.564387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:47.586245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:47.587689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:47.611267 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3269/6565] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:49.404777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:49.407162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:49.424308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247719e9-62ac-4592-8fa5-d1d6c7bb2379 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:49.430326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:49.431415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:49.431930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:49.432385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] PATH_INFO: `/v3/projects/9a1ba180d9894fecb64af7735d54a0ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:49.433910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1ba180d9894fecb64af7735d54a0ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:49.436388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:49.515935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1ba180d9894fecb64af7735d54a0ba', 'request_id': 'req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.546937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1ba180d9894fecb64af7735d54a0ba', 'request_id': 'req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.568063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1ba180d9894fecb64af7735d54a0ba', 'request_id': 'req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.598306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] The token cache is being invalidate because project 9a1ba180d9894fecb64af7735d54a0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:49.598596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.599964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.603435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3297/6566] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:49 2021] DELETE /identity/v3/projects/9a1ba180d9894fecb64af7735d54a0ba => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:49.607327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:49.621698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c520387-95f7-4d66-b3c6-a32929fcc5c5 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:49.745121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:49.746768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:49.747427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:49.747917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] PATH_INFO: `/v3/users/9514d7a5b0a247ea95f3d446bfd47724` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:49.749766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9514d7a5b0a247ea95f3d446bfd47724)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:49.751850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:49.827535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9514d7a5b0a247ea95f3d446bfd47724'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.846664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9514d7a5b0a247ea95f3d446bfd47724'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.848144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9514d7a5b0a247ea95f3d446bfd47724'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.849725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9514d7a5b0a247ea95f3d446bfd47724'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.874755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f0cba52c-7b37-494c-a8c0-c863f0d333b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9514d7a5b0a247ea95f3d446bfd47724'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:49.914051 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3270/6567] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:49 2021] DELETE /identity/v3/users/9514d7a5b0a247ea95f3d446bfd47724 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:51.188892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:51.191419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:51.211770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd4a6-a2d1-4e7d-9f4d-3a5958026ac0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:51.313661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:51.321139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:51.321139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:51.321417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] PATH_INFO: `/v3/projects/af2546ed535d4f3d80a860a4af5253cd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:51.323707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2546ed535d4f3d80a860a4af5253cd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:51.324746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:51.546035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2546ed535d4f3d80a860a4af5253cd', 'request_id': 'req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:51.552195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2546ed535d4f3d80a860a4af5253cd', 'request_id': 'req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:51.559040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2546ed535d4f3d80a860a4af5253cd', 'request_id': 'req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:51.577480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] The token cache is being invalidate because project af2546ed535d4f3d80a860a4af5253cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:51.578438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:51.579545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0ee990a5-b476-4aa0-a0d4-5da44fb8b78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:51.590021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3298/6568] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:51 2021] DELETE /identity/v3/projects/af2546ed535d4f3d80a860a4af5253cd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:51.591490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:51.592066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:51.592066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:51.637715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:51.638965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:51.823594 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3271/6569] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:51.831378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:51.832787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:51.833275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:51.869932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:51.873364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:51.918808 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3299/6570] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:51.920182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:51.932900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb9cc-b972-498a-a69b-2ce65a2fc081 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:51.950097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:51.950991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:51.951381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:51.951813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:51.952649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:51.953293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:51.954963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:51.985957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3272/6571] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:51.986799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.027258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf618ad-a31f-400f-948b-2083504faa69 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.053640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.060814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.061021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.061257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.062149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.064207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.134109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3300/6572] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:51 2021] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:52.135512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.151051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9995ab-4a37-4507-82dc-3040b6dcf95e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.289077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.290192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.290632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.290984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.291776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.297610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.329755 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3273/6573] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:52 2021] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:52.334977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.354506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225152-b4b4-4f01-ae9f-93a220144c4f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.372599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.373425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.373767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.375932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.378411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.382544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.406022 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3301/6574] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:52 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:52.410899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.423293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810faa-b2db-4cdc-98f4-b432d6b941ca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.447370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.448055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.448335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.448629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.449372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.450955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2169c3-8a8a-46c9-8b82-db4bfbf9f0ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.482360 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3274/6575] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:52 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:52.486691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.507968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fb0e-3690-4932-aff4-d09e919bbe32 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.522316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.524867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.527692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.528148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] PATH_INFO: `/v3/projects/2315a5abb8254ff19aed809f423476a6/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.562108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2315a5abb8254ff19aed809f423476a6, user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.568824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.613673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3302/6576] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:52 2021] PUT /identity/v3/projects/2315a5abb8254ff19aed809f423476a6/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:52.626024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.626936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.627404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.660796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] MFA Rules not processed for user `28ec83f201ef4bfe8b7b9b5a76e65c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:52.662460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:52.754869 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3275/6577] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:52 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:52.755968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.766441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fdd5-16e8-44d0-b70a-9c352b07405e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.773404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.774743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.774977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.775582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.776479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.778431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff43d-422f-4f4a-b315-2c2c60123ad4 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.900474 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3303/6578] 10.222.0.13 () {60 vars in 1313 bytes} [Wed Nov 10 04:19:52 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 789 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:52.901583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:52.918740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4eb0-99df-4865-b607-82bc500f4b8a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:52.927876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:52.930744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.931764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:52.934910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/bffe1d6d90124aa79955ab9a086d5b19` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:52.982003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:get_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=bffe1d6d90124aa79955ab9a086d5b19)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:52.985725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:52.998398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519c44-45ee-451d-8429-df150f94df0e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:52.999322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519c44-45ee-451d-8429-df150f94df0e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.000081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519c44-45ee-451d-8429-df150f94df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.003725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3276/6579] 10.222.0.13 () {58 vars in 1391 bytes} [Wed Nov 10 04:19:52 2021] GET /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/bffe1d6d90124aa79955ab9a086d5b19 => generated 689 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:53.025204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-18519c44-45ee-451d-8429-df150f94df0e None None] MFA Rules not processed for user `28ec83f201ef4bfe8b7b9b5a76e65c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:53.028861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18519c44-45ee-451d-8429-df150f94df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:53.283261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.295827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3304/6580] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:52 2021] POST /identity/v3/auth/tokens => generated 3415 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 10 04:19:53.295982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5926-c0a1-44c8-94d8-8d5cc86205dd tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.302023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.303345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.303787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.304259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/bffe1d6d90124aa79955ab9a086d5b19` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.306022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=bffe1d6d90124aa79955ab9a086d5b19)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.307758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.339485 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3277/6581] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:53 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/bffe1d6d90124aa79955ab9a086d5b19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:53.344430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18519c44-45ee-451d-8429-df150f94df0e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.360674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18519c44-45ee-451d-8429-df150f94df0e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.366609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.367318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.367689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.368091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.368981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.370281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.489778 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3305/6582] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 04:19:53 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 921 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:53.494234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.506283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c52e4-c3a3-4cda-9854-85e28420f40e tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.511588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.512743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.513154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.513664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/ed6162dbcf7949598fddf1c4813e5b61` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.528881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=ed6162dbcf7949598fddf1c4813e5b61)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.530802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.584417 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3278/6583] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:53 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/ed6162dbcf7949598fddf1c4813e5b61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:53.590004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.610997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271868a-01c3-4635-b472-e2dbdd23c108 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.621985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.623242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.623760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.624282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.626119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.627583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.727157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3306/6584] 10.222.0.13 () {60 vars in 1314 bytes} [Wed Nov 10 04:19:53 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 812 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:53.728448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.741798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37412-02b6-4b6b-84f0-d2a20ed3c54b tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.751889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.753773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.754085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.754658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/11ab10f96bfc422f969f6f7072ab6028` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.766417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=11ab10f96bfc422f969f6f7072ab6028)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.768377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.804301 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3279/6585] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:53 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/11ab10f96bfc422f969f6f7072ab6028 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:53.814562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.830959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aee8-53b7-431f-a44b-4b0fb91af8b9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.837625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.839299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.839778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.840058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.841289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.842916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:53.951729 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3307/6586] 10.222.0.13 () {60 vars in 1313 bytes} [Wed Nov 10 04:19:53 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 789 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:53.955953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:53.968444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421d8f-cdd0-4dd6-98dc-78de209b4c83 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:53.974350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:53.975494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:53.975968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:53.976764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:53.978059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:53.979387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.080853 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3280/6587] 10.222.0.13 () {60 vars in 1313 bytes} [Wed Nov 10 04:19:53 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 788 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:54.086372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.098067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940127-4df6-42ca-973b-4aa9188a5fa9 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.106004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.107039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.107326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.107602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.108367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:list_application_credentials(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.110296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.130120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3308/6588] 10.222.0.13 () {58 vars in 1292 bytes} [Wed Nov 10 04:19:54 2021] GET /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 1501 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:54.134547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.146554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9860-39b7-4321-b89b-4ff6626cc7e6 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.151745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.153903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.154381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.155048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/d38c9eabf03e4362ae7ae3ca1e1dc3b0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.169885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=d38c9eabf03e4362ae7ae3ca1e1dc3b0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.171730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.208282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.208430 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3281/6589] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:54 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/d38c9eabf03e4362ae7ae3ca1e1dc3b0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:54.224659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd489193-bebc-4da2-bbb7-56071ba59bdf tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.229392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.231696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.231984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.232265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/fb66c3e1a60b44f5815f68490e77a28e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.261132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=fb66c3e1a60b44f5815f68490e77a28e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.264437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.313175 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3309/6590] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:54 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/fb66c3e1a60b44f5815f68490e77a28e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:54.319221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.333355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a417-eb69-4ae1-b9f9-e129fcbac775 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.352446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.353976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.354446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.354901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.356597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.358885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.493591 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3282/6591] 10.222.0.13 () {60 vars in 1313 bytes} [Wed Nov 10 04:19:54 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 788 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:54.494568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.507973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4159-6c8c-4a37-a3a7-8a89afef6c89 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.513195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.513812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.514087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.514362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.515108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:create_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.516464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.605213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3310/6592] 10.222.0.13 () {60 vars in 1313 bytes} [Wed Nov 10 04:19:54 2021] POST /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials => generated 788 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:54.606693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.620152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7e4d-bc58-4875-9308-4eba8da30329 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.626641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.629299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.629851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.630460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.632501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Adding query filter params (name=tempest-application_credential-559279976) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:54.633107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:list_application_credentials(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.634956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.654839 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3283/6593] 10.222.0.13 () {58 vars in 1383 bytes} [Wed Nov 10 04:19:54 2021] GET /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials?name=tempest-application_credential-559279976 => generated 885 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:54.655341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.671830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2426-9246-4fa3-8894-653ee0b1a831 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.680899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.693461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.694169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.695812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/5c8b26bf77ab473299637c9758825a5b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.755591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=5c8b26bf77ab473299637c9758825a5b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.758014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.803949 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3311/6594] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:54 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/5c8b26bf77ab473299637c9758825a5b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:54.805263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:54.818759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126227cc-20b4-4ce4-8522-e698558e63ac tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:54.830212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ec83f201ef4bfe8b7b9b5a76e65c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2315a5abb8254ff19aed809f423476a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:54.832155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:54.832764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:54.833404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/ff9b1480909d411f87f080c22b7a28d7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:54.871642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorizing `identity:delete_application_credential(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e, application_credential_id=ff9b1480909d411f87f080c22b7a28d7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:54.877489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b632e6-a5a0-4237-a7ae-e7b538331322 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:54.933448 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3284/6595] 10.222.0.13 () {58 vars in 1394 bytes} [Wed Nov 10 04:19:54 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e/application_credentials/ff9b1480909d411f87f080c22b7a28d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:54.934077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:55.174758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf9ed6-c792-431f-8f91-563d533c1917 tempest-ApplicationCredentialsV3Test-209512931 tempest-ApplicationCredentialsV3Test-209512931-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:55.199225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:55.200258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:55.200671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:55.201564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] PATH_INFO: `/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:55.202392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ec83f201ef4bfe8b7b9b5a76e65c5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:55.214216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:55.325234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ec83f201ef4bfe8b7b9b5a76e65c5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:55.341809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ec83f201ef4bfe8b7b9b5a76e65c5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:55.349661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ec83f201ef4bfe8b7b9b5a76e65c5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:55.415485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ec83f201ef4bfe8b7b9b5a76e65c5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:55.438800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ec83f201ef4bfe8b7b9b5a76e65c5e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:55.446588 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3312/6596] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:54 2021] DELETE /identity/v3/users/28ec83f201ef4bfe8b7b9b5a76e65c5e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:55.452137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801b1e-e3db-47a6-8ff6-48762f76d9a9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:55.453437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801b1e-e3db-47a6-8ff6-48762f76d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:55.457115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801b1e-e3db-47a6-8ff6-48762f76d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:55.499547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-89801b1e-e3db-47a6-8ff6-48762f76d9a9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:55.502565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-89801b1e-e3db-47a6-8ff6-48762f76d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:55.655076 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3285/6597] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:55.675847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:55.678055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:55.725990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:55.726277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:55.726553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:55.783039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] MFA Rules not processed for user `ba402aaba0c740449b0652c7fd5ad29b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:55.789711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:55.826355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e3b8-78c5-40a2-ae14-752f8276f56a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:55.836204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:55.840442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:55.840775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:55.841052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:55.866799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:55.869686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:55.928160 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3313/6598] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:55.941342 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3286/6599] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:55 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:55.964900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:55.966394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:56.078984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f4ef-3a7d-4362-a416-9fbeacd0fd8d service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:56.085880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:56.086535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:56.086853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:56.087171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:56.089090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:56.211696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:56.213627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:56.224659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3314/6600] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:55 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:56.727310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:56.729117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:56.773910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54daa62-00b3-42c7-a3d7-896c51ce33a0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:56.808214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:56.809310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:56.811688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:56.812217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] PATH_INFO: `/v3/users/704f4755d3f446429725f2b66cd8a672` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:56.815260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=704f4755d3f446429725f2b66cd8a672)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:56.824483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:56.965874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704f4755d3f446429725f2b66cd8a672'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:56.974358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704f4755d3f446429725f2b66cd8a672'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:56.976674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704f4755d3f446429725f2b66cd8a672'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:56.977697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704f4755d3f446429725f2b66cd8a672'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:56.996208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dc0f48ac-c184-4fca-a54b-95a977ce4612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704f4755d3f446429725f2b66cd8a672'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.025847 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3287/6601] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:56 2021] DELETE /identity/v3/users/704f4755d3f446429725f2b66cd8a672 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:57.384359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:57.398796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2cea9-eeff-4491-a084-6059def04afb service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:57.470387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:57.471241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.471518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.471794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] PATH_INFO: `/v3/projects/e16946d4a8d945b6b316d212abca4f83` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.474712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16946d4a8d945b6b316d212abca4f83)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:57.477275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:57.547576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16946d4a8d945b6b316d212abca4f83', 'request_id': 'req-9b3b632b-05a4-4df1-bd97-62815f351ed3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.556527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16946d4a8d945b6b316d212abca4f83', 'request_id': 'req-9b3b632b-05a4-4df1-bd97-62815f351ed3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.564075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16946d4a8d945b6b316d212abca4f83', 'request_id': 'req-9b3b632b-05a4-4df1-bd97-62815f351ed3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.582600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] The token cache is being invalidate because project e16946d4a8d945b6b316d212abca4f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:57.583082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.583781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.592710 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3315/6602] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:57 2021] DELETE /identity/v3/projects/e16946d4a8d945b6b316d212abca4f83 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:57.593774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd963a2-30ce-4a1c-8fa3-329d146ee9be None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.594290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd963a2-30ce-4a1c-8fa3-329d146ee9be None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.594769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd963a2-30ce-4a1c-8fa3-329d146ee9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.620355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6bd963a2-30ce-4a1c-8fa3-329d146ee9be None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:57.623377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6bd963a2-30ce-4a1c-8fa3-329d146ee9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:57.658391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:57.660206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:57.713071 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3288/6603] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:57.720176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.720467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.720789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.742316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:57.743645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:57.754278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3289/6604] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:57.758141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:57.763136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b632b-05a4-4df1-bd97-62815f351ed3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:57.768532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89fe5a-9104-4ca3-92c3-b361a9215601 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:57.771830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:57.773361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.773640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.774253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] PATH_INFO: `/v3/projects/2315a5abb8254ff19aed809f423476a6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.775108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:57.775644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2315a5abb8254ff19aed809f423476a6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:57.775760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.776143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.776452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.777305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:57.777578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:57.777690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:57.779363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:57.791791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3290/6605] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:19:57.796337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:57.807896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b343-35cf-4983-b337-0d1ecf48b5f6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:57.814469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:57.815139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.815412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.816508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:57.817630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:57.820066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:57.858552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3291/6606] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:57 2021] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:57.860304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2315a5abb8254ff19aed809f423476a6', 'request_id': 'req-ba54e427-d604-4d66-a53e-b7e01d74f24f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.864168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:57.871608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2315a5abb8254ff19aed809f423476a6', 'request_id': 'req-ba54e427-d604-4d66-a53e-b7e01d74f24f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.880791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2315a5abb8254ff19aed809f423476a6', 'request_id': 'req-ba54e427-d604-4d66-a53e-b7e01d74f24f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.910122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] The token cache is being invalidate because project 2315a5abb8254ff19aed809f423476a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:19:57.910528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.911632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ba54e427-d604-4d66-a53e-b7e01d74f24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:57.917461 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3316/6607] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:57 2021] DELETE /identity/v3/projects/2315a5abb8254ff19aed809f423476a6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:57.921619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c706-2de9-4ff2-916d-e6e2e4370889 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:57.921619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c706-2de9-4ff2-916d-e6e2e4370889 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:57.922122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c706-2de9-4ff2-916d-e6e2e4370889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.014885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a501c706-2de9-4ff2-916d-e6e2e4370889 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:58.019727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a501c706-2de9-4ff2-916d-e6e2e4370889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:58.036406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51d8d-72d2-4861-a753-9a051018d7de admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.040746 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3317/6608] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:58.047026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a706d-3082-4766-9774-a5746e64d58e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.057263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a706d-3082-4766-9774-a5746e64d58e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.057723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a706d-3082-4766-9774-a5746e64d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.075277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.077035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.077677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.078731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.084082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.086962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.098950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-624a706d-3082-4766-9774-a5746e64d58e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:58.100809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-624a706d-3082-4766-9774-a5746e64d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:58.114908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3318/6609] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:58.118686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3292/6610] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:57 2021] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:58.119588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a706d-3082-4766-9774-a5746e64d58e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.122686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.126596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:58.133471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a706d-3082-4766-9774-a5746e64d58e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.140878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.141728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.142123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.142515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.151419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438fdec-3723-44fb-b838-51778ac83f24 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.153847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:19:58.154044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.157721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.175614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.176102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3319/6611] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:19:58.182154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.182425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.184939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.186087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.187050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.193557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.195100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b14c7-2ee0-4ec1-9e7f-072992da68de admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.200929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.201801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.202171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.203145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.203656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.206640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.221008 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3293/6612] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:58.226728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.253253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077da1-1cd0-4c84-a546-284a1aaf4465 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.261404 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3320/6613] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:58.264867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.273714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.274950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.275390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.278402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.281352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.283812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.306418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3294/6614] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:58.312509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.330606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec38c-3176-4254-8984-8fccdd5109cb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.368009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92148-5c3d-4c5d-b8f0-3eea0378d39c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.373637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.374582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.374963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.375330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.376165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.378455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.402184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3321/6615] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:58.406654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.408369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.409825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.410106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.410364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] PATH_INFO: `/v3/projects/dc386f457df54810b8e5a3ef0a1211e8/users/8c725a346b61448481c4bbff78c5f27d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.418196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e261535-f48c-42d1-89a3-110a6a9e7644 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.423564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.424228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.424622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.424906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.426239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.427825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.428467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc386f457df54810b8e5a3ef0a1211e8, user_id=8c725a346b61448481c4bbff78c5f27d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.431136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da87f11-6a9d-4195-adb5-f6178869c85b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.439139 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3322/6616] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:58.443221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.453849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a9895-7990-418a-9f53-260f23b7f6d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.462965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3295/6617] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:58 2021] PUT /identity/v3/projects/dc386f457df54810b8e5a3ef0a1211e8/users/8c725a346b61448481c4bbff78c5f27d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:58.466216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.466684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.466963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.501110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] MFA Rules not processed for user `8c725a346b61448481c4bbff78c5f27d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:58.502578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:58.514086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.514757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.515040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.515315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.516050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.517901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.529014 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3323/6618] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:58.533041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.544915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca5db-1f6c-475c-a4f0-de4b5b8d8aff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.550302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.551177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.551443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.551783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] PATH_INFO: `/v3/projects/3672bd50452c45539377d055f3feaf4e/users/66f5d6ab7b3147c8861929488addeac4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.570378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3672bd50452c45539377d055f3feaf4e, user_id=66f5d6ab7b3147c8861929488addeac4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.573956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd6a77-de42-4d52-8cbe-0c824337be37 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.585357 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3296/6619] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:58.590239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.605802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3324/6620] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:58 2021] PUT /identity/v3/projects/3672bd50452c45539377d055f3feaf4e/users/66f5d6ab7b3147c8861929488addeac4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:19:58.607635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.608106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.608560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.623369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160efa-a75f-409f-9384-ad68f89ab2cb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.667315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] MFA Rules not processed for user `66f5d6ab7b3147c8861929488addeac4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:58.669876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:58.793718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.794580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.794859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.796685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.797420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.803441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.869452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3297/6621] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/projects => generated 367 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:19:58.870655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.888412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3325/6622] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:58.889375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:58.901792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63565ddd-1f04-4d05-bb08-f47fbf30bcd5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.975386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fe7fb-f1e4-4114-a4f1-2fe65537e405 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:58.986019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.986997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.988691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f5d6ab7b3147c8861929488addeac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3672bd50452c45539377d055f3feaf4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:58.989155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.989341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:58.989620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:58.989912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.990110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] PATH_INFO: `/v3/auth/catalog` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:58.990882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.991563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:58.992100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.994384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:58.998871 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3326/6623] 10.222.0.13 () {58 vars in 1142 bytes} [Wed Nov 10 04:19:58 2021] GET /identity/v3/auth/catalog => generated 2648 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:19:58.999779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.012533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1119ff-5791-472d-9226-00f1493861f9 tempest-IdentityCatalogTest-935985153 tempest-IdentityCatalogTest-935985153-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.020578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.021998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.022292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.022562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] PATH_INFO: `/v3/users/66f5d6ab7b3147c8861929488addeac4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.024142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f5d6ab7b3147c8861929488addeac4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.026063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.033656 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3298/6624] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:19:58 2021] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:59.038337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.054585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a83aa-a37f-4b80-a0e3-adef8f87a73f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.063134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.064500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.065048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.065598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.067159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.070010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.087713 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3299/6625] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:59.100414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.119729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f5d6ab7b3147c8861929488addeac4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:59.122089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e0969-2a3e-4dfb-bcfb-4d6f58286e4e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.136201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.137389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.137935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.138315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] PATH_INFO: `/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5/users/00d9617ac08640d8a54ab824483e3d6c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.139214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f5d6ab7b3147c8861929488addeac4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:59.140471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f5d6ab7b3147c8861929488addeac4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:59.163310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb551e33ffe4bf6bf34bab1a3da2de5, user_id=00d9617ac08640d8a54ab824483e3d6c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.164601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f5d6ab7b3147c8861929488addeac4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:59.171613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.174325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-34ee08f6-4ede-4724-8114-dd55ece50d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f5d6ab7b3147c8861929488addeac4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:19:59.183989 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3327/6626] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:19:58 2021] DELETE /identity/v3/users/66f5d6ab7b3147c8861929488addeac4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:59.192031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.192390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.192910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.211229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3300/6627] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:59 2021] PUT /identity/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5/users/00d9617ac08640d8a54ab824483e3d6c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:59.214967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.219497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:59.234214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:59.239229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:59.330179 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3328/6628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:19:59.338877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.340837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fb90-6df4-4a30-9a63-a41a549398b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.340953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:59.353327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.354012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.354290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.354564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.358146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.360980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.387875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3301/6629] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:19:59.388880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.404670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb28e04-f6e6-484b-86e3-dd44c5591e36 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.429400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.433105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.435243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.435696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] PATH_INFO: `/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5/users/00d9617ac08640d8a54ab824483e3d6c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.440798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb551e33ffe4bf6bf34bab1a3da2de5, user_id=00d9617ac08640d8a54ab824483e3d6c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.446106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443631-ff46-4ab6-98c6-2f08789dfd97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.477514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3302/6630] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:19:59 2021] PUT /identity/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5/users/00d9617ac08640d8a54ab824483e3d6c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:59.488314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.488802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.506575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.513876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c9e5-4373-478b-accd-6dff6f5749df None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.557012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] MFA Rules not processed for user `00d9617ac08640d8a54ab824483e3d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:19:59.558764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:19:59.600767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.601709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.602203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.602569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.702374 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3303/6631] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:19:59 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:19:59.708422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.731246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0ab69-db06-4d05-80fc-fb4653b04e16 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.745993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.746666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.747229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.747515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.748265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.753176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.789431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.806554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3304/6632] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:19:59 2021] POST /identity/v3/services => generated 240 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:19:59.807315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:19:59.810645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.838407 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3329/6633] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:19:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:19:59.873132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542209-d6cd-4902-bbbf-cc85a61a4fb0 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:19:59.910717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:19:59.911679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:19:59.914019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:19:59.918043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/aeccc0b9a2f54066bf3d80a6288fd71e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:19:59.918993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aeccc0b9a2f54066bf3d80a6288fd71e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:19:59.926603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:19:59.988080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3305/6634] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:19:59 2021] DELETE /identity/v3/services/aeccc0b9a2f54066bf3d80a6288fd71e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:19:59.992967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.009641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9128-249f-4097-ba37-3548319e5241 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.042084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.042446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.042877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.043270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.044131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.051140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.081652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3330/6635] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:19:59 2021] POST /identity/v3/services => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:00.082952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.101149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9034831-b49c-4c83-9595-c9a17b734d97 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.128648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.130017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.130480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.131334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/f7e8f703c21d407684a2b6d1950da2c0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.132382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:update_service(service_id=f7e8f703c21d407684a2b6d1950da2c0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.133924 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:20:00.133924 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:20:00.133924 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:20:00.135208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.175229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3306/6636] 10.222.0.13 () {60 vars in 1251 bytes} [Wed Nov 10 04:20:00 2021] PATCH /identity/v3/services/f7e8f703c21d407684a2b6d1950da2c0 => generated 280 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:00.179211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.202105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5e44-9768-4c9f-b0fc-cc35f09b0bfb tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.235484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.236353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.236651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.236930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/f7e8f703c21d407684a2b6d1950da2c0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.238887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:get_service(service_id=f7e8f703c21d407684a2b6d1950da2c0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.240922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.253481 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3331/6637] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:00 2021] GET /identity/v3/services/f7e8f703c21d407684a2b6d1950da2c0 => generated 280 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:00.254958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.277178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14181-5b8f-42cf-bd86-b0838453bb6c tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.284999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.286536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.287124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.287617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/f7e8f703c21d407684a2b6d1950da2c0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.288803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f7e8f703c21d407684a2b6d1950da2c0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.291449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.336344 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3307/6638] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:00 2021] DELETE /identity/v3/services/f7e8f703c21d407684a2b6d1950da2c0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:00.340291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.353059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4d22-8714-4baa-a8d5-0a2d5ef2e865 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.374006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.374905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.375127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.375396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/f7e8f703c21d407684a2b6d1950da2c0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.377031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:get_service(service_id=f7e8f703c21d407684a2b6d1950da2c0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.379585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.419644 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Could not find service: f7e8f703c21d407684a2b6d1950da2c0.: keystone.exception.ServiceNotFound: Could not find service: f7e8f703c21d407684a2b6d1950da2c0. Nov 10 04:20:00.421343 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3332/6639] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:00 2021] GET /identity/v3/services/f7e8f703c21d407684a2b6d1950da2c0 => generated 113 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:00.428300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.452269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc8f3-6d3e-4cbe-9809-060380996829 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.461127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.462220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.462648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.463035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.464135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.466328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.495801 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3308/6640] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:00 2021] POST /identity/v3/services => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:00.501392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.526186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ae02-a9ff-4c1e-be33-2632eefba434 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.539631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.541588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:00.552206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.553833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.554496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.556050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.557493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.563539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.592269 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3333/6641] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:00 2021] POST /identity/v3/services => generated 273 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:00.596464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.597778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fad9c-20a6-492e-8b81-ea176b649eb6 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.632665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.633525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.633802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.634073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] PATH_INFO: `/v3/projects/3672bd50452c45539377d055f3feaf4e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.638907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3672bd50452c45539377d055f3feaf4e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.642392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.646748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050970b-745f-45fb-ba04-d57e042bf5b4 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.663668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.664492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.664829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.665089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.665821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.671771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.697841 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3334/6642] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:00 2021] POST /identity/v3/services => generated 274 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:00.701720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.733417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589e57-aa5e-4035-9f53-49dcb56ccc7a tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.738741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3672bd50452c45539377d055f3feaf4e', 'request_id': 'req-5a16c1ba-2a20-449f-99fc-5bee8c031895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:00.744574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3672bd50452c45539377d055f3feaf4e', 'request_id': 'req-5a16c1ba-2a20-449f-99fc-5bee8c031895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:00.751409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3672bd50452c45539377d055f3feaf4e', 'request_id': 'req-5a16c1ba-2a20-449f-99fc-5bee8c031895'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:00.776050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] The token cache is being invalidate because project 3672bd50452c45539377d055f3feaf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:00.776424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:00.777056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5a16c1ba-2a20-449f-99fc-5bee8c031895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:00.780320 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3309/6643] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:00 2021] DELETE /identity/v3/projects/3672bd50452c45539377d055f3feaf4e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:00.785941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c560-2e4c-41de-b1cb-9b722e892df8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.786609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c560-2e4c-41de-b1cb-9b722e892df8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.787789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c560-2e4c-41de-b1cb-9b722e892df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.851971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1101c560-2e4c-41de-b1cb-9b722e892df8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:00.854387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.855233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.855816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.856024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1101c560-2e4c-41de-b1cb-9b722e892df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:00.856411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.857303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.859111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:00.885847 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3335/6644] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 04:20:00 2021] GET /identity/v3/services => generated 2977 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:00.896964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:00.899075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:00.940824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74fad-ba63-4388-8e87-2faae4dff015 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:00.968442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:00.969181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:00.969464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:00.969742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:00.973406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1943364172) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:00.973729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:00.981734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.006961 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3336/6645] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Nov 10 04:20:00 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1943364172 => generated 418 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:01.014258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.039087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2fa2-345c-4ebd-88e6-51c8cc38cd08 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.051495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.052178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.052458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.052836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.053567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-380271298) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:01.053868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.055493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.065475 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3337/6646] 10.222.0.13 () {58 vars in 1219 bytes} [Wed Nov 10 04:20:01 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-380271298 => generated 415 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:01.066489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.077617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8bb85-02cb-49b9-a245-9e328e940247 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.092978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.093654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.093935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.094210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.094937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1876705436) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:01.095238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.097479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.113840 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3310/6647] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:00 2021] POST /identity/v3/auth/tokens => generated 3730 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:01.116134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.119639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.120268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.121496 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3338/6648] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Nov 10 04:20:01 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1876705436 => generated 417 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:01.125859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.161689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2da80-5410-430a-b853-6ecb9316770d tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.162374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:01.163833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:01.176853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.177715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.177997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.178271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/58ac2f7ad4a04ec1bfa9a90d25cb0990` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.178937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:delete_service(service_id=58ac2f7ad4a04ec1bfa9a90d25cb0990)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.180542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.189101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3311/6649] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:01 2021] POST /identity/v3/auth/tokens => generated 3730 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:01.202390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.246335 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3339/6650] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:01 2021] DELETE /identity/v3/services/58ac2f7ad4a04ec1bfa9a90d25cb0990 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:01.249696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f6076-b3d3-45bc-b547-43ba2220dfd8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.251417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.299049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.301603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.302118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.303518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.304452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:01.305497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e56038-6cd3-4d11-825e-d27291fc22f8 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.305984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.307801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.319300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.320467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.321138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.321589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/e50c83e102d84d3fbef5d20638ea18a3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.322465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e50c83e102d84d3fbef5d20638ea18a3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.325155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.333373 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3312/6651] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:01.338705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.356237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5424-0dca-4523-b8b4-daf3db3ed3e4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.370117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3340/6652] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:01 2021] DELETE /identity/v3/services/e50c83e102d84d3fbef5d20638ea18a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:01.374824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.405946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.406650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.406932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.407208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.407933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.415631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.430798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c74e-a652-4ae2-8ad4-ffede1b308f3 tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.442273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d9617ac08640d8a54ab824483e3d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.443132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.443921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.444325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] PATH_INFO: `/v3/services/93634370428746e8b75c5882850ed6ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.445399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorizing `identity:delete_service(service_id=93634370428746e8b75c5882850ed6ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.449455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.479855 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3313/6653] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:01 2021] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:01.481484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.512117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3341/6654] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:01 2021] DELETE /identity/v3/services/93634370428746e8b75c5882850ed6ba => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:01.514545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.520244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:01.578398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75992b3a-eef1-44f5-a236-830db7863faf tempest-ServicesTestJSON-417979277 tempest-ServicesTestJSON-417979277-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.642743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1760-a572-4a6a-a925-7d267b127a76 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.658218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.659965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.660310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.661675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] PATH_INFO: `/v3/users/8c725a346b61448481c4bbff78c5f27d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.663000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c725a346b61448481c4bbff78c5f27d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.665120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.668306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.671410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.672237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.672774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.678799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.683383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.738041 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3314/6655] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:01 2021] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:01.743114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.750825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c725a346b61448481c4bbff78c5f27d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:01.774397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dea63-c5f4-4968-998c-bb30af9068bf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.775804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c725a346b61448481c4bbff78c5f27d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:01.779558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c725a346b61448481c4bbff78c5f27d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:01.824964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.825440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.825723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.826000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.826844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.828636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.843040 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3315/6656] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:01 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:01.844241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.861557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9ff7a-d19a-4b97-9f79-27130d635c53 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:01.864371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c725a346b61448481c4bbff78c5f27d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:01.875673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:01.876364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.877391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.877705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.879233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:01.881078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:01.893516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a1923f65-3942-4ec3-ba2c-c43168885518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c725a346b61448481c4bbff78c5f27d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:01.906055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3342/6657] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:01 2021] DELETE /identity/v3/users/8c725a346b61448481c4bbff78c5f27d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:01.908495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3316/6658] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:01 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:01.910773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:01.910773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:01.911212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:01.913804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:01.916812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:01.937263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:01.938725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:01.948707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9392-3c99-446f-b274-8ea1df80f701 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.053488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.054390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.054882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.055001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] PATH_INFO: `/v3/projects/8332b0de468a466898115561e5a16108/users/168d8cc24de94db487623875037dc219/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.068317 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3343/6659] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:02.076135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8332b0de468a466898115561e5a16108, user_id=168d8cc24de94db487623875037dc219, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.079578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88569ca-2a63-4b5f-8646-818ee73d5903 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.079724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.082483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:02.104713 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3317/6660] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:01 2021] PUT /identity/v3/projects/8332b0de468a466898115561e5a16108/users/168d8cc24de94db487623875037dc219/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:02.117121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.117774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.117774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.155497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] MFA Rules not processed for user `168d8cc24de94db487623875037dc219`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:02.156943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:02.217902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82aeff9-d024-4869-8693-b11688f964e9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.257083 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3318/6661] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:02.258440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.267415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f7a4-1c69-4c13-a4a2-efe61849749b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.277921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168d8cc24de94db487623875037dc219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8332b0de468a466898115561e5a16108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.279550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.279952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.280757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] PATH_INFO: `/v3/domains/default` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.282146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.284176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.284334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.284908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.285187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.285461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.290104 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3319/6662] 10.222.0.13 () {58 vars in 1151 bytes} [Wed Nov 10 04:20:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:02.291576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.363592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.364931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3db30-94d0-4c18-b37e-05fb8f892cbb tempest-DefaultDomainTestJSON-1430259808 tempest-DefaultDomainTestJSON-1430259808-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.365352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2daf-67f5-4305-8b85-2f98a8d1900d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.370399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.371502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.372669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.373119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] PATH_INFO: `/v3/users/168d8cc24de94db487623875037dc219` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.375179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168d8cc24de94db487623875037dc219)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.382007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.389791 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3344/6663] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:02.475363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168d8cc24de94db487623875037dc219'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.484067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168d8cc24de94db487623875037dc219'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.484958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168d8cc24de94db487623875037dc219'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.485633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168d8cc24de94db487623875037dc219'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.496321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168d8cc24de94db487623875037dc219'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.517338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3320/6664] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:02 2021] DELETE /identity/v3/users/168d8cc24de94db487623875037dc219 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:02.522769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.524241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.524657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.547516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:02.548855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:02.630245 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3345/6665] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:02.645099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.646495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:02.725172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186bdf-f4ce-40a9-a54f-0db0c8c55048 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.729371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.730761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.731061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.731331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.743752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.745246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.760441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3321/6666] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:02.761251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.763016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:02.796191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b039a3-ddb4-4572-b8ea-22d01257fe63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:02.820588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:02.821715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:02.821950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:02.822209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] PATH_INFO: `/v3/projects/dc386f457df54810b8e5a3ef0a1211e8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:02.829526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc386f457df54810b8e5a3ef0a1211e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:02.832829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:02.926775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc386f457df54810b8e5a3ef0a1211e8', 'request_id': 'req-1062ffb8-6f1c-447f-8cf1-c806e664b959'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.933880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc386f457df54810b8e5a3ef0a1211e8', 'request_id': 'req-1062ffb8-6f1c-447f-8cf1-c806e664b959'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.942751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc386f457df54810b8e5a3ef0a1211e8', 'request_id': 'req-1062ffb8-6f1c-447f-8cf1-c806e664b959'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.967005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] The token cache is being invalidate because project dc386f457df54810b8e5a3ef0a1211e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:02.967454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.968173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:02.973996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3346/6667] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:02 2021] DELETE /identity/v3/projects/dc386f457df54810b8e5a3ef0a1211e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:02.975126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:02.994103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206098d-63e3-4802-8629-763d25f6cd08 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:03.093522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:03.095051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.095051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.095609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] PATH_INFO: `/v3/users/00d9617ac08640d8a54ab824483e3d6c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.097704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d9617ac08640d8a54ab824483e3d6c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:03.100155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:03.172774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:03.174429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:03.182868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d9617ac08640d8a54ab824483e3d6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.197561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062ffb8-6f1c-447f-8cf1-c806e664b959 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:03.197929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d9617ac08640d8a54ab824483e3d6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.198633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d9617ac08640d8a54ab824483e3d6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.199252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d9617ac08640d8a54ab824483e3d6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.206952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:03.208249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.208947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.209169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-accc206c-ccda-49eb-8f5a-0ce5591f7304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d9617ac08640d8a54ab824483e3d6c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.210029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] PATH_INFO: `/v3/projects/8332b0de468a466898115561e5a16108` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.212044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8332b0de468a466898115561e5a16108)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:03.214613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:03.230240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3322/6668] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:02 2021] DELETE /identity/v3/users/00d9617ac08640d8a54ab824483e3d6c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:03.302360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8332b0de468a466898115561e5a16108', 'request_id': 'req-62b13b65-a51c-45cf-8db7-9034e48e3098'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.310979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8332b0de468a466898115561e5a16108', 'request_id': 'req-62b13b65-a51c-45cf-8db7-9034e48e3098'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.320677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8332b0de468a466898115561e5a16108', 'request_id': 'req-62b13b65-a51c-45cf-8db7-9034e48e3098'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.339834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] The token cache is being invalidate because project 8332b0de468a466898115561e5a16108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:03.340130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.340803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62b13b65-a51c-45cf-8db7-9034e48e3098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.344208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3347/6669] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:03 2021] DELETE /identity/v3/projects/8332b0de468a466898115561e5a16108 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:03.352490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.352817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.353094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.374363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:03.376506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:03.508689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3323/6670] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:03.516265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.516554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.516991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.569282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:03.577326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:03.589606 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3348/6671] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:03.594591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:03.620536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d7aad-bdaf-4cc2-89a3-5c83fcfc87b6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:03.637946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:03.639142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.640196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.640637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.644217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:03.644217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:03.647501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:03.660826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:03.662345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:03.676514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3324/6672] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:03.677983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:03.685253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633c01e-0155-41ba-a802-ef9b94477fee None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:03.692562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:03.693691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.694068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.694482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] PATH_INFO: `/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.696722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb551e33ffe4bf6bf34bab1a3da2de5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:03.699730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:03.716428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9c33-3419-4eea-ac7d-07336bca1788 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:03.730346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:03.731093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.731533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.731811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.732750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:03.734916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:03.824927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'request_id': 'req-b4124f6d-cfee-4b64-be29-41e75b431f7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.843999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'request_id': 'req-b4124f6d-cfee-4b64-be29-41e75b431f7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.852204 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3325/6673] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:03 2021] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:03.854363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb551e33ffe4bf6bf34bab1a3da2de5', 'request_id': 'req-b4124f6d-cfee-4b64-be29-41e75b431f7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.861159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:03.885890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] The token cache is being invalidate because project fbb551e33ffe4bf6bf34bab1a3da2de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:03.886963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.887671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b4124f6d-cfee-4b64-be29-41e75b431f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:03.901158 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3349/6674] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:03 2021] DELETE /identity/v3/projects/fbb551e33ffe4bf6bf34bab1a3da2de5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:03.904218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341703-faae-44d9-b473-20a2c93631cb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:03.904548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341703-faae-44d9-b473-20a2c93631cb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:03.904853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341703-faae-44d9-b473-20a2c93631cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:03.967637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a5341703-faae-44d9-b473-20a2c93631cb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:03.969330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5341703-faae-44d9-b473-20a2c93631cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.006318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21331-1190-4919-9ac3-8cdd9e7f223d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.020430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.024421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.025398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.025818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.026869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.032958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.071928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3326/6675] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:03 2021] POST /identity/v3/users => generated 281 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:04.073127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.079893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.088869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3350/6676] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:04.099386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540cd1-0d1d-4ccf-b98b-e20ca2ba81ad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.105338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.106364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.106502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.106600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.106691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.106793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.106913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.108028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.109811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.130191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3327/6677] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:04.132767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.148180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a54c-1dc6-4084-b8aa-f37e780948b3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.150662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.151457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.153771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.154565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.154846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.155124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.156344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.157979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.160676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3351/6678] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:04.164867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.172747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3328/6679] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:04.174126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.175102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48b11-17af-43d1-bc61-aae422be5210 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.179816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.180467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.180830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.181103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.181836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:04.182133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.185801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.187258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ee180-c57d-402c-a415-1fbd118bdc4a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.197674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.200019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.200758 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3352/6680] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:04.200902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.200902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] PATH_INFO: `/v3/projects/886d6f7a2d4a464a80574667e94a79fc/users/da70c224906f41e788dfc2e16d103dd3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.205509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.216503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0b41-fbf9-4c59-a127-9157d1b0cbc8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.221017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886d6f7a2d4a464a80574667e94a79fc, user_id=da70c224906f41e788dfc2e16d103dd3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.222022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.222660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.222956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.223213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.223915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.225681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4f90e-f3a8-4e1e-aa90-854511430043 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.225839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.250053 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3329/6681] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:04 2021] PUT /identity/v3/projects/886d6f7a2d4a464a80574667e94a79fc/users/da70c224906f41e788dfc2e16d103dd3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:04.254749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeaa2a-5888-46a4-987f-1f0ddfa558a7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.255030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeaa2a-5888-46a4-987f-1f0ddfa558a7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.255303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeaa2a-5888-46a4-987f-1f0ddfa558a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.258174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3353/6682] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:04.262907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.289895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0fbeaa2a-5888-46a4-987f-1f0ddfa558a7 None None] MFA Rules not processed for user `da70c224906f41e788dfc2e16d103dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.291185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0fbeaa2a-5888-46a4-987f-1f0ddfa558a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.398511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fed448-5904-4a42-97f5-bbe71bee4118 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.404646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.406640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.406957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.407287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.408027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.410390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.420288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3330/6683] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:04.426825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce89633-83b2-44bd-a4db-652cc85990c7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.427148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce89633-83b2-44bd-a4db-652cc85990c7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.427506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce89633-83b2-44bd-a4db-652cc85990c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.452628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cce89633-83b2-44bd-a4db-652cc85990c7 None None] MFA Rules not processed for user `da70c224906f41e788dfc2e16d103dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.454310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cce89633-83b2-44bd-a4db-652cc85990c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.461567 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3354/6684] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:04.463013 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3331/6685] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:20:04.463544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.464920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.465202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.465474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.485102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] MFA Rules not processed for user `da70c224906f41e788dfc2e16d103dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.486868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.500175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c682ec-f5c2-498a-ac1e-e3c8012e8edf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.501017 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3332/6686] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:20:04.502209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.519827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7744-626f-463b-83f1-5fdd4fd2eab4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.524699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.525499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.525811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.526084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.528506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.529205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.529489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.530459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.530709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.532324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.541003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorizing `identity:check_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.542848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.552463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3333/6687] 10.222.0.13 () {56 vars in 1263 bytes} [Wed Nov 10 04:20:04 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Nov 10 04:20:04.557604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.558183 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3355/6688] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:04.562482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.570778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b687-4ad0-4692-8901-ce856b69dcb2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.576445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.581802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.581802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.581802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.582444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e86d-8e70-47c9-85a2-a90d36d5b1f3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.587037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.587724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.588914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.589045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.590601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.592034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.592254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.594959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.611033 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3334/6690] 10.222.0.13 () {56 vars in 1262 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/auth/tokens => generated 346 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 10 04:20:04.611234 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3356/6690] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:04.611987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.613393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.636069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b62e1-15d0-4e5a-8843-bc79d9db818b tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.645361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001722a-98c5-416d-8de6-0597f62e267d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.652953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.654101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.654101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.654312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.665360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.666279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.666556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.666814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] PATH_INFO: `/v3/projects/f53958fbaa2a430fb1a1b20302201586/users/032a88f694734565944e034d5fb52ce5/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.670911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.677183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.713194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53958fbaa2a430fb1a1b20302201586, user_id=032a88f694734565944e034d5fb52ce5, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:04.721227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3335/6691] 10.222.0.13 () {56 vars in 1265 bytes} [Wed Nov 10 04:20:04 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:04.721675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4228d-6a1c-4e90-8911-4484564d06cc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:04.722874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.741790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae401-c03e-48d0-84bc-8d4cf4a526d2 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:04.769460 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3357/6692] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:04 2021] PUT /identity/v3/projects/f53958fbaa2a430fb1a1b20302201586/users/032a88f694734565944e034d5fb52ce5/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:04.770972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.771254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.771524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.771729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:04.772502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `HEAD` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.772848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.773332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.775634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.792723 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-9ff2cf1e-9fd6-46d7-bba3-9efa6e929b17 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 10 04:20:04.795116 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3336/6693] 10.222.0.13 () {56 vars in 1263 bytes} [Wed Nov 10 04:20:04 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 04:20:04.802527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:04.802907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:04.804487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:04.806235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] MFA Rules not processed for user `032a88f694734565944e034d5fb52ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.807894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.840734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] MFA Rules not processed for user `da70c224906f41e788dfc2e16d103dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:04.842855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:04.855324 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3337/6694] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:20:04.856788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.909270 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3358/6695] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:04 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:04.920384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:04.923250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.011886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e8d6f-3225-4b71-9395-69e7d2ec235c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.023673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.026284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.027471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.028969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.048643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:05.061480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:05.078367 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3338/6696] 10.222.0.13 () {56 vars in 1262 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/auth/tokens => generated 346 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 10 04:20:05.082687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:05.098608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82e7a-3573-4eda-82a1-ff60d2bb391a tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.112497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.113180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.113460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.113737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.125392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3e4ba-f962-4e07-bb67-9102a80710b3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.128707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:05.129727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.130185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:05.130778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.131335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.131623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.148053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:05.149823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:05.167893 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3339/6698] 10.222.0.13 () {56 vars in 1265 bytes} [Wed Nov 10 04:20:05 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:05.168103 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3359/6698] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:04 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:05.169060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:05.188827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e116b7-d369-44fb-a3ee-9c8ef3db7f91 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.200295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da70c224906f41e788dfc2e16d103dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '886d6f7a2d4a464a80574667e94a79fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.201847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.202364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.210024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.212918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.230191 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-42663605-f424-4e26-bb96-ba8133b0acb9 tempest-TokensV3Test-1225928001 tempest-TokensV3Test-1225928001-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 10 04:20:05.235472 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3340/6699] 10.222.0.13 () {56 vars in 1262 bytes} [Wed Nov 10 04:20:05 2021] GET /identity/v3/auth/tokens => generated 80 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 04:20:05.244036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:05.389873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111adf-2e5f-488d-b27e-b9e12597edc7 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.391128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410073e2-f429-400c-b298-89b03869d14b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.391418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410073e2-f429-400c-b298-89b03869d14b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.391719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410073e2-f429-400c-b298-89b03869d14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.396763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.398076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.398619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.399086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] PATH_INFO: `/v3/users/da70c224906f41e788dfc2e16d103dd3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.401688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da70c224906f41e788dfc2e16d103dd3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:05.406849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:05.440996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-410073e2-f429-400c-b298-89b03869d14b None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:05.440996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-410073e2-f429-400c-b298-89b03869d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.510966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da70c224906f41e788dfc2e16d103dd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:05.535640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da70c224906f41e788dfc2e16d103dd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:05.536824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da70c224906f41e788dfc2e16d103dd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:05.567953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da70c224906f41e788dfc2e16d103dd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:05.598704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8195cb5-6bbf-45ca-84ee-25652f4792c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da70c224906f41e788dfc2e16d103dd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:05.611193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3360/6700] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:05 2021] DELETE /identity/v3/users/da70c224906f41e788dfc2e16d103dd3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:05.616760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.616975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.617205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.666015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:05.667899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.671410 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3341/6701] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:20:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:05.718455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410073e2-f429-400c-b298-89b03869d14b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:05.721940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-410073e2-f429-400c-b298-89b03869d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.804930 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3361/6702] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:05.824256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:05.836713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:05.949054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f18c-fb01-4118-80ac-930a92ec6acd None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.953478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:05.954146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:05.955003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:05.955003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:05.957073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410073e2-f429-400c-b298-89b03869d14b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:05.967577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:05.969173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc729d-6d5d-4c35-92fc-9bb4956b7457 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:05.981187 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3362/6703] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:06.061249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:06.061788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:06.062070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:06.062408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:06.130197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:06.131842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:06.148465 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3342/6704] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:20:06.952740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:06.953631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:06.953631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.004445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:07.006632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:07.010457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:07.014235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:07.034819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673954c-bae9-4b3e-a91e-afd153d4c810 service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:07.047162 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3363/6705] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:20:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:07.059642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:07.062261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.063577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.064431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] PATH_INFO: `/v3/projects/886d6f7a2d4a464a80574667e94a79fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.069380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=886d6f7a2d4a464a80574667e94a79fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:07.074913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:07.095909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:07.142793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdd8c2-fbf3-4c69-a685-c7f501ed553c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:07.165277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:07.166548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.168025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.168342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.212064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:07.227742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e788ccf-2490-4d52-8986-75536ed6e074 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:07.250584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3364/6706] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:20:07.255972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886d6f7a2d4a464a80574667e94a79fc', 'request_id': 'req-c03b3add-05f5-403e-81bf-b201b9d83c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:07.263450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886d6f7a2d4a464a80574667e94a79fc', 'request_id': 'req-c03b3add-05f5-403e-81bf-b201b9d83c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:07.271371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886d6f7a2d4a464a80574667e94a79fc', 'request_id': 'req-c03b3add-05f5-403e-81bf-b201b9d83c65'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:07.295310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] The token cache is being invalidate because project 886d6f7a2d4a464a80574667e94a79fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:07.295972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:07.297209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c03b3add-05f5-403e-81bf-b201b9d83c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:07.306672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3343/6707] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:07 2021] DELETE /identity/v3/projects/886d6f7a2d4a464a80574667e94a79fc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:07.314998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.315167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.316044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.357500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:07.359712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:07.571055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3365/6708] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:07.584634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.585750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.586064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.641983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:07.643245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:07.679874 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3344/6709] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:07.683744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:07.703357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c470d-aee9-475f-a880-a8ae36a1a46c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:07.716622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:07.720680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.721124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.721573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.726364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:07.726851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:07.730856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:07.758913 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3366/6710] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:07.760439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:07.778606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75fbc8-aaf8-47d8-9c69-e71293740fb9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:07.793440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:07.794228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:07.794530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:07.794812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:07.798305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:07.805374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1903a7-5930-41eb-b184-da809e9dd8ac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:07.915408 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3345/6711] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:07 2021] POST /identity/v3/projects => generated 397 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:07.916470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:07.935298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee541c-673d-4fd4-b24e-9dc666896a0c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.019245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.019900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.019900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.049335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:08.050605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:08.130648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.131347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.131632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.131907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.132869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.135045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.183800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3367/6712] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:07 2021] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:08.188404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.195088 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3346/6713] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:20:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:08.212068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.213828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:08.214226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4d36-0cb9-47b2-89b7-f1f03a39bbc3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.227335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.228342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.228657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.228928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.229680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.231291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.251597 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3368/6714] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:08.256578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.274859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff870f9b-89d4-4697-9596-6e94900e923e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.290493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.291713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.292183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.292647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] PATH_INFO: `/v3/projects/2a8607ed101144ba98ba7ab08f68a870/users/d4502c95ffbf4f4fb4966966ad413ad1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.332831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8607ed101144ba98ba7ab08f68a870, user_id=d4502c95ffbf4f4fb4966966ad413ad1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.335863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.365911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3369/6715] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:08 2021] PUT /identity/v3/projects/2a8607ed101144ba98ba7ab08f68a870/users/d4502c95ffbf4f4fb4966966ad413ad1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:08.369825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9e633-d28c-42d5-ae07-ca17cac7d004 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.371570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.505399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b9824-8d40-4a8e-b0b7-07c7af5260d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.514206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.515938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.517027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.517027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.517248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.518164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.519723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.519960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.520313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.520595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.539996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3370/6716] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:08.541157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.559006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac74aa-ed82-40c3-a98d-56f8ceb82d5a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:08.589530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:08.590719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.591074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.591357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] PATH_INFO: `/v3/projects/2a8607ed101144ba98ba7ab08f68a870/users/d4502c95ffbf4f4fb4966966ad413ad1/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.593748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8607ed101144ba98ba7ab08f68a870, user_id=d4502c95ffbf4f4fb4966966ad413ad1, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.599913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837236c-e5da-4d09-be20-72c371e9df89 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.642209 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3371/6717] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:08 2021] PUT /identity/v3/projects/2a8607ed101144ba98ba7ab08f68a870/users/d4502c95ffbf4f4fb4966966ad413ad1/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:08.653859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fe7f-e590-49fe-ab5b-dbfd8c28e756 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:08.654041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fe7f-e590-49fe-ab5b-dbfd8c28e756 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:08.654322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fe7f-e590-49fe-ab5b-dbfd8c28e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:08.673335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:08.675164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:08.700318 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3347/6718] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:20:08.709573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f556fe7f-e590-49fe-ab5b-dbfd8c28e756 None None] MFA Rules not processed for user `d4502c95ffbf4f4fb4966966ad413ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:08.711273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f556fe7f-e590-49fe-ab5b-dbfd8c28e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:08.901396 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3372/6719] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:08 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:08.907330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:08.921793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b5f6f-73dd-462a-9739-c4ab2295fb4b service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.024547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.025079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.025325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.058091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:09.059499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:09.080500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.082443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.082992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.083587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.084850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.087778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.138859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3348/6720] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:08 2021] POST /identity/v3/projects => generated 397 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:09.144221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:09.223960 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3373/6721] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:20:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:09.240426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:09.306335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820abf4-1628-42b7-92b2-a3e2da4051e3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.322322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.322952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.323611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.323611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.324200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.326958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.397697 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3349/6722] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:09 2021] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:09.406973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:09.439097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ed4d-e0ba-4544-adaf-7939150b6859 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.457061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385efa-5c32-4d35-99b7-03548b854246 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.467440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.471917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.475842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.476152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.477158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.478994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.505459 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3350/6723] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:09 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:09.507286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:09.522939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251a0a-0048-485b-8920-02c447eb2efb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.540323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.541764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.542052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.542425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.543172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.546078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.587124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3351/6724] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:09 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:09.592942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:09.625429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2877dce-1031-4ec1-99b7-7e21b1633fca admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:09.639566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.640685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.640972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.641473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.648229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:09.649365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.664334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.664334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] PATH_INFO: `/v3/projects/c1e6d1b1e1d948da9202ad5da8c1a6e2/users/9ac2152f763e4b23b408bec91a7de10a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.727220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e6d1b1e1d948da9202ad5da8c1a6e2, user_id=9ac2152f763e4b23b408bec91a7de10a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.750217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6114fef-4cc1-444f-bf46-e49ded7bc372 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.791075 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3352/6725] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:09 2021] PUT /identity/v3/projects/c1e6d1b1e1d948da9202ad5da8c1a6e2/users/9ac2152f763e4b23b408bec91a7de10a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:09.791309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:09.792522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:09.802275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca4dd-eaba-4674-ac8c-618a845bf02d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:09.802657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca4dd-eaba-4674-ac8c-618a845bf02d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:09.803030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca4dd-eaba-4674-ac8c-618a845bf02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:09.823446 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3374/6726] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:20:09.891359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d92ca4dd-eaba-4674-ac8c-618a845bf02d None None] MFA Rules not processed for user `9ac2152f763e4b23b408bec91a7de10a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:09.892850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d92ca4dd-eaba-4674-ac8c-618a845bf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:10.201623 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3353/6727] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:09 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:10.233771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:10.244191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:10.452371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861383f5-229f-4370-a55d-917b3ca308d9 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:10.557710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:10.558599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:10.558923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:10.559203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:10.596464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b936ec-dcd7-421e-9e1e-4df3040c75d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:10.597584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b936ec-dcd7-421e-9e1e-4df3040c75d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:10.598210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b936ec-dcd7-421e-9e1e-4df3040c75d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:10.637817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-78b936ec-dcd7-421e-9e1e-4df3040c75d8 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:10.649474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-78b936ec-dcd7-421e-9e1e-4df3040c75d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:10.713469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:10.727183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:10.745799 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3375/6728] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:10 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:10.772098 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3354/6729] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:20:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 10 04:20:10.793783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:10.959123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb7a20-d790-4038-b306-4fd8c41f139e service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:11.012269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:11.013111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.013600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.013873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.057969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:11.061758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:11.086647 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3376/6730] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:20:11.495720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.496817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.498679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.523643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:11.525347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:11.533716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:11.555811 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3355/6731] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:20:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:11.571744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:11.599686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a119c60-54e1-4c11-8cd5-e61760c6ba0e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:11.613237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:11.614245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.615988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.616408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.638700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:11.641248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:11.665505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3356/6732] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:20:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:20:11.688515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226baba-85c6-418c-9820-7c509d2ed102 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:11.699756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:11.701178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.701953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.702848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] PATH_INFO: `/v3/users/d4502c95ffbf4f4fb4966966ad413ad1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.705330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4502c95ffbf4f4fb4966966ad413ad1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:11.709225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:11.866574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4502c95ffbf4f4fb4966966ad413ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:11.874283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:11.875997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:11.896765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4502c95ffbf4f4fb4966966ad413ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:11.898849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4502c95ffbf4f4fb4966966ad413ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:11.908560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84413d-e709-49f7-9586-6020edc71f2f service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:11.919699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4502c95ffbf4f4fb4966966ad413ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:11.930689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b374c4c3-9a33-41f1-b251-680df77fc72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4502c95ffbf4f4fb4966966ad413ad1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:11.931778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:11.933028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.935417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.935951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] PATH_INFO: `/v3/users/032a88f694734565944e034d5fb52ce5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.938468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=032a88f694734565944e034d5fb52ce5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:11.942943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:11.947610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3377/6733] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:11 2021] DELETE /identity/v3/users/d4502c95ffbf4f4fb4966966ad413ad1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:11.951374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:11.951679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:11.952249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:11.986511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:11.988658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:12.058639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032a88f694734565944e034d5fb52ce5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:12.086527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032a88f694734565944e034d5fb52ce5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:12.088000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032a88f694734565944e034d5fb52ce5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:12.090106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032a88f694734565944e034d5fb52ce5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:12.109448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bff1ff7-0d8b-4e76-a0a7-a69360e8b5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032a88f694734565944e034d5fb52ce5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:12.125216 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3378/6734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:12.138327 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3357/6735] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:11 2021] DELETE /identity/v3/users/032a88f694734565944e034d5fb52ce5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:12.140937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:12.143043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:12.147910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:12.150664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:12.151998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:12.173831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:12.175154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:12.235193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29315a55-be11-4361-9598-e14b646c2f5f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:12.264883 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3358/6736] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:12.279968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:12.302919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:12.304052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:12.304432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:12.305175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:12.318807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:12.320660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:12.353970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3379/6737] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:12.360424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a14f2-a1e7-4912-a97b-7ef7d0ab8e4c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:12.364940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:12.366117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:12.366618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:12.367109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:12.383059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:12.385016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:12.398907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3359/6738] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:13.073828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.076499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.080430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.082519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.093313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bcbe-5edc-4074-8471-161e10f66a92 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.108590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5f1d-6e0e-494a-b8e8-24619e862b05 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.121086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.121966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.122331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.122608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] PATH_INFO: `/v3/projects/2a8607ed101144ba98ba7ab08f68a870` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.123974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8607ed101144ba98ba7ab08f68a870)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.126990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.135727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.136806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.138262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.140435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] PATH_INFO: `/v3/projects/f53958fbaa2a430fb1a1b20302201586` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.142108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53958fbaa2a430fb1a1b20302201586)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.145666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.185134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8607ed101144ba98ba7ab08f68a870', 'request_id': 'req-22447aa2-d79a-4f47-badb-13afb5f4d404'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.192230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8607ed101144ba98ba7ab08f68a870', 'request_id': 'req-22447aa2-d79a-4f47-badb-13afb5f4d404'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.199976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8607ed101144ba98ba7ab08f68a870', 'request_id': 'req-22447aa2-d79a-4f47-badb-13afb5f4d404'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.215865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53958fbaa2a430fb1a1b20302201586', 'request_id': 'req-768eece5-3060-4f50-a773-e76f793a1426'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.218156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] The token cache is being invalidate because project 2a8607ed101144ba98ba7ab08f68a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:13.218450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.219315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.223677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53958fbaa2a430fb1a1b20302201586', 'request_id': 'req-768eece5-3060-4f50-a773-e76f793a1426'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.224432 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3360/6739] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:13 2021] DELETE /identity/v3/projects/2a8607ed101144ba98ba7ab08f68a870 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:13.225303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.226887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.233734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53958fbaa2a430fb1a1b20302201586', 'request_id': 'req-768eece5-3060-4f50-a773-e76f793a1426'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.254827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] The token cache is being invalidate because project f53958fbaa2a430fb1a1b20302201586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:13.255115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.255804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.262162 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3380/6740] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:13 2021] DELETE /identity/v3/projects/f53958fbaa2a430fb1a1b20302201586 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:13.262162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.262162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.341719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eece5-3060-4f50-a773-e76f793a1426 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.349272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.351122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.351756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.352263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] PATH_INFO: `/v3/users/9ac2152f763e4b23b408bec91a7de10a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.353881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac2152f763e4b23b408bec91a7de10a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.360885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22447aa2-d79a-4f47-badb-13afb5f4d404 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.362053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.439527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.440221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.440528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.440805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.441998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac2152f763e4b23b408bec91a7de10a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.443066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.453690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac2152f763e4b23b408bec91a7de10a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.454489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac2152f763e4b23b408bec91a7de10a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.459842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.461454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b746c-044e-4939-9580-1ef3170cbe09 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.474963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac2152f763e4b23b408bec91a7de10a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.475457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3361/6741] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:13.477758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.478281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.478768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.486413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-54f74ad9-a3a2-4c82-8bcd-fdbc00fd9691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac2152f763e4b23b408bec91a7de10a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:13.495662 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3381/6742] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:13 2021] DELETE /identity/v3/users/9ac2152f763e4b23b408bec91a7de10a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:13.500812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:13.502536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.604937 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3362/6743] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:13.612995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.613713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.613999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.642681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:13.644548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:13.653946 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3382/6744] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:13.659990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.678901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098de8-cdad-428d-a7d2-b7e672ae67df None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.711166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.712134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.712673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.713183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.714367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:13.715145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.728419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.756066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3363/6745] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:13.760526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.778808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e62a7-1767-446f-b9ff-a93e33979a4b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.789464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.790989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.791514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:13.792081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:13.793123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:13.795702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:13.881767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3383/6746] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:13 2021] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:13.885626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:13.902245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efcee-fd0b-4006-9190-34163563f8be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:13.998467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:13.999157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:13.999837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.000131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.001071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.003790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.037975 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3364/6747] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:13 2021] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:14.040795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.053832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6766b8-b972-4bab-bdda-218f70c21e2a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.072157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.073542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.074080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.074080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.075080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.076998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.090117 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3384/6748] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:14.094994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.110341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69109d-b997-4a98-ac3d-5f7f82c84858 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.117411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.118365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.120417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.120904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.122494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.124300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.140278 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3365/6749] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:14.144775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.158249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11c35-94d0-4570-8edc-38281c59c86c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.166830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.167728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.168489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.168796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] PATH_INFO: `/v3/projects/6c2605475baf447f8125b8cd08562935/users/c0c81ec189a04f01a2673ae4ced47ca3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.205074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2605475baf447f8125b8cd08562935, user_id=c0c81ec189a04f01a2673ae4ced47ca3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.210095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4a085-06de-4234-909c-568950ce6d51 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.227276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.229124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:14.245805 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3385/6750] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:14 2021] PUT /identity/v3/projects/6c2605475baf447f8125b8cd08562935/users/c0c81ec189a04f01a2673ae4ced47ca3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:14.257242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.257613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.257790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.267031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff5783-d828-4cf4-92ad-615e52e17fab admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.289794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] MFA Rules not processed for user `c0c81ec189a04f01a2673ae4ced47ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:14.291365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:14.385455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.386327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.386606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.386875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] PATH_INFO: `/v3/projects/c1e6d1b1e1d948da9202ad5da8c1a6e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.390387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e6d1b1e1d948da9202ad5da8c1a6e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.392288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.396427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3386/6751] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:14.401797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.414257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccae86-9055-4871-b216-184cd6a80a0f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.426941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.427755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.428908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.429522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.431907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.436789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.482487 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3387/6752] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:14.483728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.493788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e6d1b1e1d948da9202ad5da8c1a6e2', 'request_id': 'req-cf21a7d0-4190-452b-a227-15fcbf4d44ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:14.509236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e6d1b1e1d948da9202ad5da8c1a6e2', 'request_id': 'req-cf21a7d0-4190-452b-a227-15fcbf4d44ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:14.527074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e6d1b1e1d948da9202ad5da8c1a6e2', 'request_id': 'req-cf21a7d0-4190-452b-a227-15fcbf4d44ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:14.552532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] The token cache is being invalidate because project c1e6d1b1e1d948da9202ad5da8c1a6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:14.552872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:14.554193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-cf21a7d0-4190-452b-a227-15fcbf4d44ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:14.558370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3366/6753] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:14 2021] DELETE /identity/v3/projects/c1e6d1b1e1d948da9202ad5da8c1a6e2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:14.564773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71189-04ed-4844-8a93-c7fef9df3ea2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.565606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71189-04ed-4844-8a93-c7fef9df3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.565891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71189-04ed-4844-8a93-c7fef9df3ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.579935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aa32f-4963-433c-aef6-6bbe7c1098e6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.590025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.590962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.591864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.592261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.593258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.595470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.608474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cbf71189-04ed-4844-8a93-c7fef9df3ea2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:14.609444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbf71189-04ed-4844-8a93-c7fef9df3ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:14.630789 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3388/6754] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:14.634978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.638180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:14.638763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3367/6755] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:14.648270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.648724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.649109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.672802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b310-e0d2-44dd-896b-3f81c6f9639d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.684982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.685901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.686304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.686804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.687650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.688752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:14.690534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.691850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:14.709960 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3389/6756] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:14.712513 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3368/6757] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:14.714664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.716307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.746412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d419c-db27-45a7-b14a-e763e80d712a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.747554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b1a-4a07-49f4-993f-6f20f5a90193 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.754898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.763842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.764363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.765171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.765569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.767057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.767386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:14.767749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.768236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.768703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.770512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.771375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.773685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.798334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3390/6758] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:14.799977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.807361 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3369/6759] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:14.809089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.815795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555c285-becd-4435-9213-e776fb134bca admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.823546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.826428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.827032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.827483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] PATH_INFO: `/v3/projects/c3f8475793194a858264c1d6bf7f78b9/users/e15ebe4cb5bc415b8eae9dda9d8d746f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.830981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103f0a-57bb-41a9-9bb0-1b8a11d74d27 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:14.843774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:14.844453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.844851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.845133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.846016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.849663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.858543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8475793194a858264c1d6bf7f78b9, user_id=e15ebe4cb5bc415b8eae9dda9d8d746f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:14.862935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3da9f-8ced-416c-bf23-9c17a160ee1b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:14.891716 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3391/6760] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:14 2021] PUT /identity/v3/projects/c3f8475793194a858264c1d6bf7f78b9/users/e15ebe4cb5bc415b8eae9dda9d8d746f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:14.896440 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3370/6761] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:14.899512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:14.900019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:14.900473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:14.900584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:14.947077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] MFA Rules not processed for user `e15ebe4cb5bc415b8eae9dda9d8d746f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:14.948470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:15.047310 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3392/6762] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:15.059336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463e27f-d8fd-4f6d-8246-4955cbb5bac4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.061257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.064112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:15.071118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.073267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.076166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.076550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.081144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.084865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.118572 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3371/6763] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:14 2021] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:15.121501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.143954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6162d3-8dd6-498e-a93d-15573207d8bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.158316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.159689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.159963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.160232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.161003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.162593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.187677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74d8f6-85b4-45e7-a0fa-fd62d0708d16 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.188233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3372/6764] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:15.190151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.192266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.194122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.194428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.194693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.197049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:15.225867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285b39-4a38-4844-8841-b2520b92a1a9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.240925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.241700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.241984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.242377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.243114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.245426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.277231 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3373/6765] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:15.278977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.303213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d60e8-96a1-4575-8f63-0dc782e668e8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.319669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.320953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.321409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.321898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] PATH_INFO: `/v3/projects/2693615fa44442b6a49d0b811a3ef009/users/86d09286d9344253b48a89f0cc4b8b6d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.344625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.346100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f05b6-22e2-4500-b3ea-5c39184a8774 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.360227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2693615fa44442b6a49d0b811a3ef009, user_id=86d09286d9344253b48a89f0cc4b8b6d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.364508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.370220 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3393/6766] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:15 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:15.386152 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3374/6767] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:15 2021] PUT /identity/v3/projects/2693615fa44442b6a49d0b811a3ef009/users/86d09286d9344253b48a89f0cc4b8b6d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:15.396918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.397224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.397513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.517357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] MFA Rules not processed for user `86d09286d9344253b48a89f0cc4b8b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:15.522089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:15.551534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.680957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3394/6768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:15 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:15.684988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.691365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f30b-3776-447e-8179-5da75bc3f2b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.707652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.708342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.708547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.709112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.890256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82f390-fa51-4d31-8a79-ae8b1a6beed1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:15.920624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:15.921339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:15.921963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:15.922287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:15.923354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.925664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.945733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:15.947381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:15.979498 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3395/6769] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:15 2021] POST /identity/v3/projects => generated 389 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:15.983880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:15.991006 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3375/6770] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:15 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:16.131462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a2ab-eea4-478a-9c8a-72e26ed2e0d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:16.150255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:16.152308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.152787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.153218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.154637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:16.157092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:16.226799 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3396/6771] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:15 2021] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:16.231959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:16.266309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5c4d-0137-455a-a84e-0f711d5587e8 service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:16.323569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:16.325106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.325947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.326091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.326849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:16.330209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:16.349067 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3376/6772] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:16.349695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:16.366915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158042-9845-48d2-94d2-18d1531366fb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:16.394111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:16.395237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.395463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.395837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] PATH_INFO: `/v3/projects/1f8afbda103849a69568b7227b9f2ea2/users/d3d7b46755c240119696d7bcf871c5a9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.434832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8afbda103849a69568b7227b9f2ea2, user_id=d3d7b46755c240119696d7bcf871c5a9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:16.437663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:16.474587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3397/6773] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:16 2021] PUT /identity/v3/projects/1f8afbda103849a69568b7227b9f2ea2/users/d3d7b46755c240119696d7bcf871c5a9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:16.478934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:16.503221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d0e7-870a-4050-9f64-2f5c3e3ea3f4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:16.694967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:16.695862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.696234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.696646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.697584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:16.699933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523da77-b6da-4ae5-90a5-bbbbfc62a8a1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:16.727285 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3377/6774] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:16.732178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:16.754805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4183c-657d-4d31-9f07-f879f088a59a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:16.779414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:16.781631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.782470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.782961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] PATH_INFO: `/v3/projects/1f8afbda103849a69568b7227b9f2ea2/users/d3d7b46755c240119696d7bcf871c5a9/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.787133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8afbda103849a69568b7227b9f2ea2, user_id=d3d7b46755c240119696d7bcf871c5a9, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:16.803964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:16.836332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3398/6775] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:16 2021] PUT /identity/v3/projects/1f8afbda103849a69568b7227b9f2ea2/users/d3d7b46755c240119696d7bcf871c5a9/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:16.849023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:16.849377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:16.849710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:16.934828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] MFA Rules not processed for user `d3d7b46755c240119696d7bcf871c5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:16.936505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:17.286889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3378/6776] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:16 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:17.296414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:17.300153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:17.515387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9875a-6c3a-4da2-a716-25130a73169a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:17.528861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:17.529839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:17.530310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:17.530798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:17.692115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:17.713591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b62844-b362-44ed-bdce-88724acb5f87 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:17.752575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3399/6777] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:17 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:19.469421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:19.632379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21242daa-3804-4ff8-99a0-3490612a599a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:19.645773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:19.649569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:19.652732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:19.653910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] PATH_INFO: `/v3/users/c0c81ec189a04f01a2673ae4ced47ca3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:19.656073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c81ec189a04f01a2673ae4ced47ca3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:19.658835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:19.852958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c81ec189a04f01a2673ae4ced47ca3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:19.888279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c81ec189a04f01a2673ae4ced47ca3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:19.890077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c81ec189a04f01a2673ae4ced47ca3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:19.890987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c81ec189a04f01a2673ae4ced47ca3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:19.906794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c81ec189a04f01a2673ae4ced47ca3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:19.956013 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3379/6778] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:19 2021] DELETE /identity/v3/users/c0c81ec189a04f01a2673ae4ced47ca3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:19.962696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:19.964006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:19.964741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:20.014535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:20.024183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:20.200844 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3400/6779] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:20.222742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:20.226721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:20.376745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a3cd-2e46-4161-ba8e-6ccd04e24d44 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:20.399507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:20.400337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:20.400872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:20.402337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:20.417841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:20.420463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:20.438138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3380/6780] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:21.217719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:21.222980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:21.253801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1cfe-2fc8-4ef4-83a0-ed682bf53196 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:21.269713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:21.274100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:21.274624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:21.275098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] PATH_INFO: `/v3/projects/6c2605475baf447f8125b8cd08562935` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:21.276699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2605475baf447f8125b8cd08562935)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:21.279408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:21.350256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2605475baf447f8125b8cd08562935', 'request_id': 'req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.356835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2605475baf447f8125b8cd08562935', 'request_id': 'req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.364960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2605475baf447f8125b8cd08562935', 'request_id': 'req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.394337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] The token cache is being invalidate because project 6c2605475baf447f8125b8cd08562935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:21.394899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.395883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.402376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:21.403268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3401/6781] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:21 2021] DELETE /identity/v3/projects/6c2605475baf447f8125b8cd08562935 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:21.413954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f888f-d19f-4ffb-8955-0c83e3f1d645 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:21.476472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:21.477248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:21.477844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:21.478275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] PATH_INFO: `/v3/users/e15ebe4cb5bc415b8eae9dda9d8d746f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:21.479664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15ebe4cb5bc415b8eae9dda9d8d746f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:21.482252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:21.568581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15ebe4cb5bc415b8eae9dda9d8d746f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.580101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15ebe4cb5bc415b8eae9dda9d8d746f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.581003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15ebe4cb5bc415b8eae9dda9d8d746f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.581745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15ebe4cb5bc415b8eae9dda9d8d746f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.597105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15ebe4cb5bc415b8eae9dda9d8d746f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:21.636301 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3381/6782] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:21 2021] DELETE /identity/v3/users/e15ebe4cb5bc415b8eae9dda9d8d746f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:22.388207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:22.389667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:22.534085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e777af-dbcd-48e0-aaf1-d3382d6c8618 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:22.618332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:22.619460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:22.619882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:22.620343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:22.623802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:22.641199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:22.643575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:22.658572 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3402/6783] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:23.267565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:23.272062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:23.416025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b11d4-ba9d-45d4-9aa1-08e4eae7df81 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:23.424827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:23.436927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:23.442269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:23.442599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] PATH_INFO: `/v3/projects/c3f8475793194a858264c1d6bf7f78b9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:23.451505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8475793194a858264c1d6bf7f78b9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:23.461063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:23.620070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:23.621555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:23.644911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8475793194a858264c1d6bf7f78b9', 'request_id': 'req-f5971073-aeae-411e-b371-f05e202aaccf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:23.661668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8475793194a858264c1d6bf7f78b9', 'request_id': 'req-f5971073-aeae-411e-b371-f05e202aaccf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:23.683350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8475793194a858264c1d6bf7f78b9', 'request_id': 'req-f5971073-aeae-411e-b371-f05e202aaccf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:23.719107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] The token cache is being invalidate because project c3f8475793194a858264c1d6bf7f78b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:23.720775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:23.722399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f5971073-aeae-411e-b371-f05e202aaccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:23.729110 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3382/6784] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:23 2021] DELETE /identity/v3/projects/c3f8475793194a858264c1d6bf7f78b9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:23.736114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cabf3-04cd-4056-a57c-c9f8bd68d288 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:23.736662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cabf3-04cd-4056-a57c-c9f8bd68d288 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:23.737094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cabf3-04cd-4056-a57c-c9f8bd68d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:23.794032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0c2cabf3-04cd-4056-a57c-c9f8bd68d288 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:23.797022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0c2cabf3-04cd-4056-a57c-c9f8bd68d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:23.892047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f39bf-2e33-4ed4-b0e6-c5e65f72fbe8 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.007241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.007899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.008173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.008438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.012706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:24.035643 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3383/6785] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:24.037957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.038586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.038586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.063994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:24.065498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:24.097087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3384/6786] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:24.098545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.109643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a010a-4325-42b5-a4e4-677a8dcbca36 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.131656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.132457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.132869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.133214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.134025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:24.134517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.137690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.174922 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3385/6787] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:24.182465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.200448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.204987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.228411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c43bd-6318-4956-bd25-fe86212ab33a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.237683 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3403/6788] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:23 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:24.244599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.245271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.245553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.245821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.246515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.248397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.309911 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3386/6789] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:24 2021] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:24.318807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.350528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dace5-52c0-4c48-bbac-f788af1930df service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.504334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.505780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.507452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.507855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.509858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.515839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.565776 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3404/6790] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:24 2021] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:24.569980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.585134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881d9a7-1ba0-4c06-872b-833ceced22fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.598665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.599621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.600081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.611579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.613395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.615199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.628285 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3387/6791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:24.632371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.645857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ffad-3d07-4b61-a238-72802786f804 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.665195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.669082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.671686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.673334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.675012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.681028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d47ed3-61b0-4e9c-8445-066bd9901c6a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.720691 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3405/6792] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:24.722166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:24.739986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c08ae-c5e9-49f0-817c-848ddde20bb4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:24.748264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:24.751180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.751905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.752524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] PATH_INFO: `/v3/projects/fe7f9d71abbe483c98dd79da90e64d7c/users/cccec3cf5c8343c5b6f34ae1b386c3c8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.774812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7f9d71abbe483c98dd79da90e64d7c, user_id=cccec3cf5c8343c5b6f34ae1b386c3c8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:24.777757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:24.819660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3388/6793] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:24 2021] PUT /identity/v3/projects/fe7f9d71abbe483c98dd79da90e64d7c/users/cccec3cf5c8343c5b6f34ae1b386c3c8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:24.838878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:24.839170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:24.839453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:24.906401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] MFA Rules not processed for user `cccec3cf5c8343c5b6f34ae1b386c3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:24.907637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:25.037129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3406/6794] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:24 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:25.041258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.136309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c314-964a-4fb0-870d-c33030e3433b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.144717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.145394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.146050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.146810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.146931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.149611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.187197 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3389/6795] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:25 2021] POST /identity/v3/projects => generated 395 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:25.191288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.204012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadcdda-6081-4298-9032-e38e8ec3970a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.298703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.299692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.300048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.301163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.302344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.304823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.334884 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3407/6796] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:25 2021] POST /identity/v3/users => generated 304 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:25.339062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.354362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d6c3d-9a68-4fdb-9749-08d380a9860e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.362201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.364465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.365157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.366438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.367481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.369576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.390246 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3390/6797] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:25.396502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.414891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6763fe-5f83-4717-a4f4-9872cd92ba70 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.423199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.426303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.426878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.427459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] PATH_INFO: `/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a/users/f0056a4ca35e4e78a241b98a9c80938f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.462952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfcf4fe514b4a38971b84aa0e0de71a, user_id=f0056a4ca35e4e78a241b98a9c80938f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.466961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.494955 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3408/6798] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:25 2021] PUT /identity/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a/users/f0056a4ca35e4e78a241b98a9c80938f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:25.500883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.517060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e8cb6-ffce-43a4-a018-d212fb0938d2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.610200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.611102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.612987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.619608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.620721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.623482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff92b8-d603-4f79-83dd-520edf5254e2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.650594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:25.653453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3391/6799] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:25.663894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa8f3-396b-486d-8394-47f90be7cd1b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:25.687780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:25.692509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.692879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.693168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] PATH_INFO: `/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a/users/f0056a4ca35e4e78a241b98a9c80938f/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.714601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfcf4fe514b4a38971b84aa0e0de71a, user_id=f0056a4ca35e4e78a241b98a9c80938f, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:25.718395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a476a-7f6a-44f3-b9d2-d097b833a262 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:25.730619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.731003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.731391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.734109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3409/6800] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:25 2021] PUT /identity/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a/users/f0056a4ca35e4e78a241b98a9c80938f/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:25.747748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:25.748163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:25.748442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:25.763943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] MFA Rules not processed for user `e39b47dc0794427ca139086096853aab`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:25.771456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:25.808417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] MFA Rules not processed for user `f0056a4ca35e4e78a241b98a9c80938f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:25.809682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:25.908909 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3392/6801] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:26.007707 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3410/6802] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:25 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:26.030467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:26.032080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:26.249356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7946-3cb5-46c3-8328-cebec7e7c37b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:26.269306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:26.270140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:26.270258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:26.277291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:26.396160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:26.398909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f7c38-6f57-4a00-aac8-800f45c03605 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:26.438074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3393/6803] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:26 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:27.762347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:27.764572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:27.985883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2e807-9c59-4976-a4a1-b26cd6d64aa3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:28.003937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:28.004920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:28.005486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:28.008169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:28.029086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:28.030827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:28.053388 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3411/6804] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:27 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:28.287906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:28.289005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:28.289444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:28.327299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] MFA Rules not processed for user `89d53dad7e2b4d0cbeb6703d41da920b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:28.330937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:28.493619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3394/6805] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:28 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:29.304095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:29.306120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:29.430891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c490-68fd-48ca-b030-703b42dfdd39 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:29.436553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:29.437650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:29.438093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:29.438525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] PATH_INFO: `/v3/users/adbcebe49264484fbe6a3720f3238425` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:29.439978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbcebe49264484fbe6a3720f3238425)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:29.442097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:29.500749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbcebe49264484fbe6a3720f3238425'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:29.518956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbcebe49264484fbe6a3720f3238425'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:29.519947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbcebe49264484fbe6a3720f3238425'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:29.535419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbcebe49264484fbe6a3720f3238425'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:29.548305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbcebe49264484fbe6a3720f3238425'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:29.560771 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3412/6806] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:29 2021] DELETE /identity/v3/users/adbcebe49264484fbe6a3720f3238425 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:29.885823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:29.887312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:29.915018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b35fc-f26d-4533-93b9-b5b52375dc36 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.007584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.009900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.009900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.009900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] PATH_INFO: `/v3/users/86d09286d9344253b48a89f0cc4b8b6d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.011514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.013569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.013776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d09286d9344253b48a89f0cc4b8b6d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.020826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.044531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2d47-2684-42a8-be47-477ddb4ee72f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.051548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.052414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.052763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.053375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] PATH_INFO: `/v3/projects/94482b4b4b9c4b0583f87dd15521c5e6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.055738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94482b4b4b9c4b0583f87dd15521c5e6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.057860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.085731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d09286d9344253b48a89f0cc4b8b6d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.095213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d09286d9344253b48a89f0cc4b8b6d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.096344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d09286d9344253b48a89f0cc4b8b6d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.097648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d09286d9344253b48a89f0cc4b8b6d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.106362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c70404ef-17b1-42ba-b17f-f4b2cdce9a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d09286d9344253b48a89f0cc4b8b6d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.110142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94482b4b4b9c4b0583f87dd15521c5e6', 'request_id': 'req-97813055-7026-4a2c-bb75-2dd356d6e80a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.116215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94482b4b4b9c4b0583f87dd15521c5e6', 'request_id': 'req-97813055-7026-4a2c-bb75-2dd356d6e80a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.124193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94482b4b4b9c4b0583f87dd15521c5e6', 'request_id': 'req-97813055-7026-4a2c-bb75-2dd356d6e80a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.129836 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3395/6807] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:29 2021] DELETE /identity/v3/users/86d09286d9344253b48a89f0cc4b8b6d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:30.141548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] The token cache is being invalidate because project 94482b4b4b9c4b0583f87dd15521c5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:30.141909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.142678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97813055-7026-4a2c-bb75-2dd356d6e80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.144319 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3413/6808] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:30 2021] DELETE /identity/v3/projects/94482b4b4b9c4b0583f87dd15521c5e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:30.148364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.148364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.148364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.149982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed17b9-d41e-43ca-9c95-f003d285ba18 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.150262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed17b9-d41e-43ca-9c95-f003d285ba18 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.150540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed17b9-d41e-43ca-9c95-f003d285ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.170783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-caed17b9-d41e-43ca-9c95-f003d285ba18 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:30.171996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-caed17b9-d41e-43ca-9c95-f003d285ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.181334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:30.182531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.249201 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3414/6809] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:30.254757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3396/6810] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:30.257240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.257529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.257803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.265295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.267129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.280707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:30.282065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.292079 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3415/6811] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:30.295808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.306413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c81d4-68ff-4ec6-80a0-1d39555b9ce9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.311922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.312730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.313080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.313362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.314109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:30.314411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.316580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.337106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3416/6812] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:30.341267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df764420-e2ab-44fb-891c-8b0949840882 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.341458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.346269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.346944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.347221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.347488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.353841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722edce-7ba7-4bc5-96a4-49aef98b60a8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.359716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.360403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.360716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.361252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.362633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.362762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.364583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.365957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.383766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3397/6813] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:30.396544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3417/6814] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:30.400935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.413164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d2b1-d26d-45e8-ba10-7510c53ec385 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.494742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.497356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.497745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.498167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.498993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.501380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.540321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3398/6815] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:30.541768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.563146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e879bca-74ba-4697-b430-6946d030f903 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.568737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.569682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.570121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.570582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.571476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.573483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.589883 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3418/6816] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:30.591084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.605691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173611-8235-4f6e-8a5d-dc203bd5f93a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.622322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.623036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.623316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.623583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.624324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.625957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.640284 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3399/6817] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:30.644066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.658085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e275e22-0bda-496a-81b7-031c58aae6bd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.669462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.672207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.672873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.673235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] PATH_INFO: `/v3/projects/abc439ae192f4b22b92936570f8fef60/users/56c4b4a90c484ba89f0f93f7d451463a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.684506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.686882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.715465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845335d-db0e-4ac1-99f7-86b9675ecac5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.722271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.723226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.723430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.723675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] PATH_INFO: `/v3/projects/2693615fa44442b6a49d0b811a3ef009` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.726637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2693615fa44442b6a49d0b811a3ef009)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.728521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.747398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc439ae192f4b22b92936570f8fef60, user_id=56c4b4a90c484ba89f0f93f7d451463a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.757394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6577ca-5e54-4de6-b1ad-1ed10a6341fc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:30.785517 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3419/6818] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:30 2021] PUT /identity/v3/projects/abc439ae192f4b22b92936570f8fef60/users/56c4b4a90c484ba89f0f93f7d451463a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:30.791228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.791606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.792403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.815703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:30.817633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.818325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2693615fa44442b6a49d0b811a3ef009', 'request_id': 'req-4a13940e-385c-48af-8ce7-e05acf3d4f9a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.826425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2693615fa44442b6a49d0b811a3ef009', 'request_id': 'req-4a13940e-385c-48af-8ce7-e05acf3d4f9a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.841350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2693615fa44442b6a49d0b811a3ef009', 'request_id': 'req-4a13940e-385c-48af-8ce7-e05acf3d4f9a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.866371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] The token cache is being invalidate because project 2693615fa44442b6a49d0b811a3ef009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:30.866716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.867477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:30.872713 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3400/6819] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:30 2021] DELETE /identity/v3/projects/2693615fa44442b6a49d0b811a3ef009 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:30.875592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.877067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.916800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3420/6820] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:30.937995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:30.941086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:30.972291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13940e-385c-48af-8ce7-e05acf3d4f9a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:30.978175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:30.979191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:30.979469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:30.979745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] PATH_INFO: `/v3/users/d3d7b46755c240119696d7bcf871c5a9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:30.981435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d7b46755c240119696d7bcf871c5a9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:30.983661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:31.062138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d7b46755c240119696d7bcf871c5a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:31.073874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4e58-4bf5-407d-8e7b-c18513459d71 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:31.079014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d7b46755c240119696d7bcf871c5a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:31.083027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d7b46755c240119696d7bcf871c5a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:31.083854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:31.084512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:31.085623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d7b46755c240119696d7bcf871c5a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:31.086907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:31.087232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:31.091859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:31.101745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d7b46755c240119696d7bcf871c5a9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:31.131044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:31.139673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:31.149284 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3401/6821] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:30 2021] DELETE /identity/v3/users/d3d7b46755c240119696d7bcf871c5a9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:31.173135 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3421/6822] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:31.841634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:31.844022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:31.940933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:31.948976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:32.042420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c525753-b209-4cdf-b4d0-e5e56a4898ff service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.059339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4fcab-6f5f-4e72-8a5e-6a12a0cf3c85 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.082231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.083443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.084392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.084915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.089604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:32.183368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.184368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.184750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.185094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] PATH_INFO: `/v3/projects/1f8afbda103849a69568b7227b9f2ea2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.188076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8afbda103849a69568b7227b9f2ea2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.191947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.262451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.264772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877b775-cd1f-4948-a4e1-ea42dddde550 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.307005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8afbda103849a69568b7227b9f2ea2', 'request_id': 'req-1655616b-8bfc-49ee-a6df-aa8d5405954d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:32.324871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8afbda103849a69568b7227b9f2ea2', 'request_id': 'req-1655616b-8bfc-49ee-a6df-aa8d5405954d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:32.332191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3402/6823] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:32.344124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8afbda103849a69568b7227b9f2ea2', 'request_id': 'req-1655616b-8bfc-49ee-a6df-aa8d5405954d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:32.373049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] The token cache is being invalidate because project 1f8afbda103849a69568b7227b9f2ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:32.373567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:32.374446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1655616b-8bfc-49ee-a6df-aa8d5405954d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:32.384817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3422/6824] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:31 2021] DELETE /identity/v3/projects/1f8afbda103849a69568b7227b9f2ea2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:32.386844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c07-da44-472a-9247-391fad951672 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.387132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c07-da44-472a-9247-391fad951672 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.387428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c07-da44-472a-9247-391fad951672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.429542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7fa06c07-da44-472a-9247-391fad951672 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:32.430942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7fa06c07-da44-472a-9247-391fad951672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:32.547379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3403/6825] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:32.555927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.556215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.556495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.593569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:32.594793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:32.620924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa06c07-da44-472a-9247-391fad951672 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:32.622376 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3423/6826] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:32.632887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa06c07-da44-472a-9247-391fad951672 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.638629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.639677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.640113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.641272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.642362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:32.643403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.645300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.658130 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3404/6827] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:32.663180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:32.673969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e13e-53ff-404c-8988-05a90baaf88d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.680566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.682046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.682331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.682607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.683329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.685455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.729863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3424/6828] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:32 2021] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:32.733899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:32.747110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be128-0c67-4737-aa7a-aabcfb703f95 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.854213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.855106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.855951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.856242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.857001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.858949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.887289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3405/6829] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:32 2021] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:32.891703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:32.904753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebabf-06ba-4015-997b-db3b599242d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.914166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.915107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.915809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.916417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.917718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.920047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:32.940078 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3425/6830] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:32 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:32.943551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:32.959698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf956-aaef-4f96-a55a-7f641aa247c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:32.978408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:32.979082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:32.979362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:32.979637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:32.980384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:32.982070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e511bf2-e0fe-475e-8255-e5927b0d57e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.001626 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3406/6831] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:32 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:33.006962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.022044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ec04-4dae-4a09-9373-cf9193f7764f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.029307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.030600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.031148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.032039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] PATH_INFO: `/v3/projects/5dac4c136237466897a06c302bb62f6b/users/08be18cc2b134bc09c98b8d3ee8f9f8e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.055739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dac4c136237466897a06c302bb62f6b, user_id=08be18cc2b134bc09c98b8d3ee8f9f8e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.059489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.102649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3426/6832] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:33 2021] PUT /identity/v3/projects/5dac4c136237466897a06c302bb62f6b/users/08be18cc2b134bc09c98b8d3ee8f9f8e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:33.112885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.113332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.113578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.156225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] MFA Rules not processed for user `08be18cc2b134bc09c98b8d3ee8f9f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:33.157924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:33.253254 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3407/6833] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:33.257567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.373460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad446-bc1b-400d-9eb5-2407ff3a9677 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.386680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.387394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.387682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.387984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.390378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.399286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5cbea-a946-444c-b146-d1c9b3957fae admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.441479 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3427/6834] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:33 2021] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:33.445575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.461854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13813c-6c7f-4899-98dc-04483c6deba8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.476714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.477179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.477507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.577174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] MFA Rules not processed for user `56c4b4a90c484ba89f0f93f7d451463a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:33.578379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:33.625999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.628295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.628859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.629328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.631766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.636642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.688590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3408/6835] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:33 2021] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:33.690513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.708738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56090f7-e19d-4611-813b-1ccf9d13f646 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.715113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.716930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.717320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.717693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.718709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.720816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.738308 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3428/6836] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:33 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:33.748065 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3409/6837] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:33.750115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.762034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439862da-2602-4f78-8d11-160d511c0fc9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.766687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.768159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.768444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.768758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] PATH_INFO: `/v3/projects/f472eff35c85488cb278efb041ac72c0/users/eef63d4f8f8546a793a7b82a1d4342f8/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.801915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f472eff35c85488cb278efb041ac72c0, user_id=eef63d4f8f8546a793a7b82a1d4342f8, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.805888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.840506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3429/6838] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:33 2021] PUT /identity/v3/projects/f472eff35c85488cb278efb041ac72c0/users/eef63d4f8f8546a793a7b82a1d4342f8/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:33.841710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:33.853637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf198c-6f57-4452-a1ba-932f206b6ac4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:33.951051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:33.951805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:33.952172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:33.952555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:33.955521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:33.955935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a962d-324d-4b35-87ba-111a9e92c361 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:33.967457 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3410/6839] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:33.971361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:34.000773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362434cb-96fd-4e44-89b0-25ac2a07b09f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:34.031082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:34.033839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:34.041667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:34.042168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] PATH_INFO: `/v3/projects/f472eff35c85488cb278efb041ac72c0/users/eef63d4f8f8546a793a7b82a1d4342f8/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:34.050084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f472eff35c85488cb278efb041ac72c0, user_id=eef63d4f8f8546a793a7b82a1d4342f8, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:34.054764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:34.096164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:34.096457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:34.096804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:34.101795 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3430/6840] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:33 2021] PUT /identity/v3/projects/f472eff35c85488cb278efb041ac72c0/users/eef63d4f8f8546a793a7b82a1d4342f8/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:34.147605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] MFA Rules not processed for user `eef63d4f8f8546a793a7b82a1d4342f8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:34.149199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:34.255356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3411/6841] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:34 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:34.295276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:34.297339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:34.395599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2de8f-17d2-4dc0-abed-29cc503e8862 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:34.399942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:34.400735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:34.401486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:34.402184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:34.475386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:34.478117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:34.492498 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3431/6842] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:34 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:35.150870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:35.152202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:35.344678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d98448-f281-41a7-80dc-067fdddedadc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:35.356695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:35.359346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:35.359920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:35.360630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] PATH_INFO: `/v3/users/56c4b4a90c484ba89f0f93f7d451463a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:35.368813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c4b4a90c484ba89f0f93f7d451463a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:35.381148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:35.442781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:35.463645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c4b4a90c484ba89f0f93f7d451463a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:35.465298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314464e-e8fb-496d-aad5-363ceb2aea78 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:35.475168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c4b4a90c484ba89f0f93f7d451463a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:35.476149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c4b4a90c484ba89f0f93f7d451463a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:35.476925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c4b4a90c484ba89f0f93f7d451463a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:35.477258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:35.477930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:35.478208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:35.478482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:35.487718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c4b4a90c484ba89f0f93f7d451463a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:35.496664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:35.517778 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3412/6843] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:35 2021] DELETE /identity/v3/users/56c4b4a90c484ba89f0f93f7d451463a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:35.531432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:35.532927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcf0d-2330-4e26-9153-ec982e608619 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:35.555733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3432/6844] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:35 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:36.316353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.324497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:36.418683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c33a-c3b0-42b6-9754-7e1bf2779c8e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.423372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.424869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.425149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.425423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] PATH_INFO: `/v3/projects/abc439ae192f4b22b92936570f8fef60` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.426654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc439ae192f4b22b92936570f8fef60)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.428528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.489179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc439ae192f4b22b92936570f8fef60', 'request_id': 'req-0c62e829-4eb3-4a0c-bc65-56219312eeda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:36.495761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc439ae192f4b22b92936570f8fef60', 'request_id': 'req-0c62e829-4eb3-4a0c-bc65-56219312eeda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:36.503319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc439ae192f4b22b92936570f8fef60', 'request_id': 'req-0c62e829-4eb3-4a0c-bc65-56219312eeda'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:36.519296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] The token cache is being invalidate because project abc439ae192f4b22b92936570f8fef60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:36.519843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:36.521077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0c62e829-4eb3-4a0c-bc65-56219312eeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:36.522732 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3413/6845] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:36 2021] DELETE /identity/v3/projects/abc439ae192f4b22b92936570f8fef60 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:36.530998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.531446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.532003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.553446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:36.554681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:36.623748 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3433/6846] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:36.632509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.633104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.634132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.657104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:36.661162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:36.679074 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3414/6847] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:36.680117 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.691783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64c2d-4487-4d35-aa2f-465fceb22a68 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.697417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.698331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.698796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.699238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.700280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:36.700780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.702613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.718492 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3434/6848] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:36.723370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.735600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1fe95-cb09-436a-a049-e82d3dd5b057 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.741246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.741985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.742269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.742546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.743492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.745479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.771831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3415/6849] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:36 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:36.775228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.786529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4e99-a6a5-428f-a86d-5085ed4d7fac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.864127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.865492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.867428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.867715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.868471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.870742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.909177 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3435/6850] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:36 2021] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:36.913592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.925944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba115-aee0-42c0-af38-7e42092ec0a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.931528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.932662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.933159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.933683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.934675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.937989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.949408 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3416/6851] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:36.954038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:36.966043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f2d5-93fc-4148-ac00-c2afa8aad63e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:36.972172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:36.972981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:36.973304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:36.973584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:36.974321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:36.976671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789d924-7c3b-46ad-8ce3-a3591777bc04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:36.990106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3436/6852] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:36.993989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:37.005168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1faa-9266-4660-bb43-c87643841556 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:37.012411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:37.013367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:37.013799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:37.014075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] PATH_INFO: `/v3/projects/c1075e0643e54959a5a5fdb8d890b466/users/25618a58d53048d0adb2e99ad35cade0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:37.039217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1075e0643e54959a5a5fdb8d890b466, user_id=25618a58d53048d0adb2e99ad35cade0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:37.044241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:37.066338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3417/6853] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:36 2021] PUT /identity/v3/projects/c1075e0643e54959a5a5fdb8d890b466/users/25618a58d53048d0adb2e99ad35cade0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:37.076271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:37.076562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:37.076919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:37.129750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] MFA Rules not processed for user `25618a58d53048d0adb2e99ad35cade0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:37.130868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:37.254040 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3437/6854] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:37 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:37.268486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:37.270469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:37.387855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323fac-b819-4a76-8f41-3df215e83b3d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:37.396195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:37.397577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:37.398472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:37.398749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:37.419724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:37.421299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc0741-3f07-4387-87a8-f2dd5c6b2345 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:37.444475 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3418/6855] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:37 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:39.251432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:39.253914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:39.395034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f223f5-3e73-4a57-8cbd-7b3639671fca None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:39.407648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:39.410019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:39.410298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:39.410570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] PATH_INFO: `/v3/users/cccec3cf5c8343c5b6f34ae1b386c3c8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:39.414251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccec3cf5c8343c5b6f34ae1b386c3c8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:39.420774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:39.516692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccec3cf5c8343c5b6f34ae1b386c3c8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:39.525524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccec3cf5c8343c5b6f34ae1b386c3c8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:39.526231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccec3cf5c8343c5b6f34ae1b386c3c8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:39.539166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccec3cf5c8343c5b6f34ae1b386c3c8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:39.547254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccec3cf5c8343c5b6f34ae1b386c3c8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:39.555128 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3438/6856] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:39 2021] DELETE /identity/v3/users/cccec3cf5c8343c5b6f34ae1b386c3c8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:39.560697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:39.562755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:39.563908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:39.585999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:39.587352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:39.669514 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3419/6857] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:39.680328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:39.681879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:39.756221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a377d-691a-40dd-9df4-ffbcd8a89ebc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:39.760671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:39.761523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:39.761962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:39.762394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:39.777389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:39.778847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:39.789499 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3439/6858] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:40.094864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:40.097028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:40.112636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be7035-9ecf-4bc0-b3cd-0eabf30cca31 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:40.117677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:40.118577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:40.118863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:40.119151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] PATH_INFO: `/v3/projects/fe7f9d71abbe483c98dd79da90e64d7c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:40.120570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7f9d71abbe483c98dd79da90e64d7c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:40.122541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:40.194360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7f9d71abbe483c98dd79da90e64d7c', 'request_id': 'req-94000209-a706-4be1-b6a6-b12346cba825'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.206704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7f9d71abbe483c98dd79da90e64d7c', 'request_id': 'req-94000209-a706-4be1-b6a6-b12346cba825'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.214682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7f9d71abbe483c98dd79da90e64d7c', 'request_id': 'req-94000209-a706-4be1-b6a6-b12346cba825'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.229666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] The token cache is being invalidate because project fe7f9d71abbe483c98dd79da90e64d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:40.229961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.230610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.234002 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3420/6859] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:40 2021] DELETE /identity/v3/projects/fe7f9d71abbe483c98dd79da90e64d7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:40.238407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:40.249415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38aa02-77f9-411a-a0b0-a56e1a43baff service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:40.309822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:40.310685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:40.311143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:40.311408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] PATH_INFO: `/v3/users/f0056a4ca35e4e78a241b98a9c80938f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:40.312834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0056a4ca35e4e78a241b98a9c80938f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:40.314993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:40.366162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0056a4ca35e4e78a241b98a9c80938f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.373371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0056a4ca35e4e78a241b98a9c80938f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.374069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0056a4ca35e4e78a241b98a9c80938f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.386452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0056a4ca35e4e78a241b98a9c80938f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.394176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-148694ea-f022-4c45-a3bd-52fa2daa5106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0056a4ca35e4e78a241b98a9c80938f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:40.400804 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3440/6860] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:40 2021] DELETE /identity/v3/users/f0056a4ca35e4e78a241b98a9c80938f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:40.846489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:40.858491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:40.884644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000209-a706-4be1-b6a6-b12346cba825 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:40.977746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:40.979120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:40.979409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:40.979694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] PATH_INFO: `/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:40.981531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfcf4fe514b4a38971b84aa0e0de71a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:40.983514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.047463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfcf4fe514b4a38971b84aa0e0de71a', 'request_id': 'req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:41.054125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfcf4fe514b4a38971b84aa0e0de71a', 'request_id': 'req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:41.060718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfcf4fe514b4a38971b84aa0e0de71a', 'request_id': 'req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:41.082697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] The token cache is being invalidate because project 9cfcf4fe514b4a38971b84aa0e0de71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:41.083414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:41.085655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c2f5d6fa-2dfb-407a-a1e8-ccee954f1130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:41.088372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3421/6861] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:40 2021] DELETE /identity/v3/projects/9cfcf4fe514b4a38971b84aa0e0de71a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:41.094693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.094969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.095269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.143038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:41.145001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:41.269975 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3441/6862] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:41.279247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.279578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.279841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.317952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:41.320215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:41.350161 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3422/6863] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:41.354228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.366771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d023-f061-4f1d-bd41-1661032812c0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.373071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.373879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.374159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.374429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.375195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:41.375458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.377805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.397914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.400961 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3442/6864] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:41.410449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc185-de84-4b1a-b586-8448b5a5ba35 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.416748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.417574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.417858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.418133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.418838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.420796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.463974 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3423/6865] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:41.464328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.476312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22a61-34af-4c89-bf0e-ac3ae9f40b06 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.544632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.545400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.545747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.546343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.547212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.550373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.586910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.601080 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3443/6866] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:41.604055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6f3d-cc33-446e-92a3-5222ca1c8229 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.613040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.613715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.613991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.614260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.614996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.616641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.635810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3424/6867] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:41.637109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.654484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0dfd-10ec-4900-8033-6a3fa644803a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.665550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.666823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.667281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.667744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.668757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.670673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012c9c-327d-4848-b123-aa50e3069fc3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.686885 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3444/6868] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:41.690623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:41.703969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81469ca-1fd6-44c9-9399-77ef45c72a56 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:41.710635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:41.711880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.712335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.713108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] PATH_INFO: `/v3/projects/d5ace8edbac44219994906dd62eb4e97/users/b2e430525dc04c82a05d1206ea5c8be9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.747480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ace8edbac44219994906dd62eb4e97, user_id=b2e430525dc04c82a05d1206ea5c8be9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:41.750724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:41.778912 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3425/6869] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:41 2021] PUT /identity/v3/projects/d5ace8edbac44219994906dd62eb4e97/users/b2e430525dc04c82a05d1206ea5c8be9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:41.779604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:41.779883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:41.780375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:41.816395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] MFA Rules not processed for user `b2e430525dc04c82a05d1206ea5c8be9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:41.818301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:41.954646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3445/6870] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:41.959203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.061762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbebc8-e321-4c75-a8cf-0a02bbbfd742 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.068572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.069560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.070058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.070676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.071598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.073730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.115689 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3426/6871] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:41 2021] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:42.119460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.133156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc502b-38b8-44d4-9eae-99d4ea9188c0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.265793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.266821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.267864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.268364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.269403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.271659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.309026 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3446/6872] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:42 2021] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:42.312891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.326878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821ec09-e647-4672-96f8-93bdc02469a1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.337729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.338453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.338737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.339011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.339891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.341572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.369662 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3427/6873] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:42.373923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.397697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a9574-a775-4cd3-af24-5b4bab36165d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.421954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.422848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.423122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.423413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] PATH_INFO: `/v3/projects/ef35e11c8e33433eaf452bd217999a20/users/2faa8598122648a09ac2e1979c7269e3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.449629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35e11c8e33433eaf452bd217999a20, user_id=2faa8598122648a09ac2e1979c7269e3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.452906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.486476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3447/6874] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:42 2021] PUT /identity/v3/projects/ef35e11c8e33433eaf452bd217999a20/users/2faa8598122648a09ac2e1979c7269e3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:42.486652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.502726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772898e-499a-491b-b471-4dbc51f8cd9a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.645767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.646453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.646734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.647008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.647755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.649399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05498be-c3fa-4748-a139-1fe1b8e04dbb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.667398 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3428/6875] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:42.671860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.687449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba6df-da73-47ff-b5e5-8c0b34aba785 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:42.694739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:42.696243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.696886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.697336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] PATH_INFO: `/v3/projects/ef35e11c8e33433eaf452bd217999a20/users/2faa8598122648a09ac2e1979c7269e3/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.699755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35e11c8e33433eaf452bd217999a20, user_id=2faa8598122648a09ac2e1979c7269e3, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:42.702875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:42.717619 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3448/6876] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:42 2021] PUT /identity/v3/projects/ef35e11c8e33433eaf452bd217999a20/users/2faa8598122648a09ac2e1979c7269e3/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:42.730314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:42.730599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:42.730878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:42.815572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] MFA Rules not processed for user `2faa8598122648a09ac2e1979c7269e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:42.817784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:42.908070 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3429/6877] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:42 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:42.921083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:42.922948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:43.010045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d11-81d5-45f4-92db-404c4e1fd9d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:43.014368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:43.015014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:43.015289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:43.015574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:43.026300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:43.027736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:43.043079 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3449/6878] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:42 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:46.028014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.043965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff7b48-defe-4782-924e-462db8e61d20 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:46.055204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:46.055657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.055959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.056263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.150224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:46.151929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:46.165177 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3430/6879] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:46 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:46.374283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.378460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.428938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.442774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881f1f4-9a5f-400e-a930-1ff0501f5faf service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:46.448661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:46.449407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.449758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.450122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.452271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.476435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b7b9-0c2f-4547-9eb0-49ab8f75312b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:46.483190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:46.484286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.484566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.484877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] PATH_INFO: `/v3/users/08be18cc2b134bc09c98b8d3ee8f9f8e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.487091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] RBAC: Authorizing `identity:delete_user(user_id=08be18cc2b134bc09c98b8d3ee8f9f8e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:46.489201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:46.537127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:46.538616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2fd65-2ffe-4606-9844-2d52b9a624ab service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:46.554196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08be18cc2b134bc09c98b8d3ee8f9f8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.561649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08be18cc2b134bc09c98b8d3ee8f9f8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.562403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08be18cc2b134bc09c98b8d3ee8f9f8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.566798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3431/6880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:46 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:46.574791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08be18cc2b134bc09c98b8d3ee8f9f8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.582743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08be18cc2b134bc09c98b8d3ee8f9f8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.591369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3450/6881] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:46 2021] DELETE /identity/v3/users/08be18cc2b134bc09c98b8d3ee8f9f8e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:46.596087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.596377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.596680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.614398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:46.615606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.684665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3432/6882] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:46.693124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.694749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.753948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d916-7983-416c-8277-04e24a09950b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:46.757786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:46.758547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.758912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.759254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.769475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:46.770967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:46.781129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3451/6883] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:46.867914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.869940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.884763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7ed6-bd33-4d00-a236-dbf91eaeeb37 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:46.889530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:46.890626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:46.891018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:46.891378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] PATH_INFO: `/v3/users/25618a58d53048d0adb2e99ad35cade0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:46.893357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25618a58d53048d0adb2e99ad35cade0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:46.896217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:46.956696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25618a58d53048d0adb2e99ad35cade0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.965511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25618a58d53048d0adb2e99ad35cade0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.968142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25618a58d53048d0adb2e99ad35cade0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.969045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25618a58d53048d0adb2e99ad35cade0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:46.976729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:46.978833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:46.990220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5d2c4690-5310-426f-8243-794ad2055689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25618a58d53048d0adb2e99ad35cade0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.010746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3433/6884] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:46 2021] DELETE /identity/v3/users/25618a58d53048d0adb2e99ad35cade0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:47.015374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.015738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.016213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.019123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7e0c-b830-4f29-832f-8837e2c16fcf service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.036398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:47.037441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.099124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.100272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.100658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.101011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] PATH_INFO: `/v3/projects/5dac4c136237466897a06c302bb62f6b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.102792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dac4c136237466897a06c302bb62f6b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.105329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:47.173181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dac4c136237466897a06c302bb62f6b', 'request_id': 'req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.180341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dac4c136237466897a06c302bb62f6b', 'request_id': 'req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.187670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dac4c136237466897a06c302bb62f6b', 'request_id': 'req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.203873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] The token cache is being invalidate because project 5dac4c136237466897a06c302bb62f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:47.204259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.205562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.210334 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3452/6885] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:46 2021] DELETE /identity/v3/projects/5dac4c136237466897a06c302bb62f6b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:47.211769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.213330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.242352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3434/6886] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:47.253340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.254816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.291730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7ebf-9a54-4ef6-aa55-d8058c6f5539 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.296712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.297611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.297893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.298169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] PATH_INFO: `/v3/users/eef63d4f8f8546a793a7b82a1d4342f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.300017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef63d4f8f8546a793a7b82a1d4342f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.301987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:47.323798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6989f-900c-4072-971f-f9674b813fd1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.350730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef63d4f8f8546a793a7b82a1d4342f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.357740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef63d4f8f8546a793a7b82a1d4342f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.358468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef63d4f8f8546a793a7b82a1d4342f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.371887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef63d4f8f8546a793a7b82a1d4342f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.379794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.380589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.380944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.381062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef63d4f8f8546a793a7b82a1d4342f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.381504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.383310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.392581 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3453/6887] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:47 2021] DELETE /identity/v3/users/eef63d4f8f8546a793a7b82a1d4342f8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:47.396431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.397876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611907-504a-4656-b366-2e433b0ad92a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:47.408738 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3435/6888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:47.435868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.438008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.514308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58344-ccec-42b2-a618-879c978df372 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.525469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.526797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.527302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.527736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] PATH_INFO: `/v3/users/b2e430525dc04c82a05d1206ea5c8be9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.529262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e430525dc04c82a05d1206ea5c8be9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.532540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:47.593533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e430525dc04c82a05d1206ea5c8be9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.602068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e430525dc04c82a05d1206ea5c8be9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.602917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e430525dc04c82a05d1206ea5c8be9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.617955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e430525dc04c82a05d1206ea5c8be9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.625267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e430525dc04c82a05d1206ea5c8be9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.632792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3454/6889] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:47 2021] DELETE /identity/v3/users/b2e430525dc04c82a05d1206ea5c8be9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:47.637474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.637951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.638290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.658864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:47.660729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.729897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.731785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.747372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3436/6890] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:47.751972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb485c0b-0e1d-4e82-92dc-0cc70631209f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.757759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.759335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.759899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.761145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.761454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] PATH_INFO: `/v3/projects/f472eff35c85488cb278efb041ac72c0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.761970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.765633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f472eff35c85488cb278efb041ac72c0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.770344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:47.849549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f472eff35c85488cb278efb041ac72c0', 'request_id': 'req-ab280545-080d-4e4b-b548-a07370f51f62'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.862788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f472eff35c85488cb278efb041ac72c0', 'request_id': 'req-ab280545-080d-4e4b-b548-a07370f51f62'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.877254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f8e6f-682b-43cb-ad23-5d69d18ad379 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.879809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f472eff35c85488cb278efb041ac72c0', 'request_id': 'req-ab280545-080d-4e4b-b548-a07370f51f62'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.898206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] The token cache is being invalidate because project f472eff35c85488cb278efb041ac72c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:47.898206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.899098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:47.905499 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3455/6891] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:47 2021] DELETE /identity/v3/projects/f472eff35c85488cb278efb041ac72c0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:47.906787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:47.908848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.949497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.950316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.950885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.951165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.953977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:47.983572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280545-080d-4e4b-b548-a07370f51f62 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:47.989799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:47.990782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:47.991204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:47.991690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] PATH_INFO: `/v3/projects/c1075e0643e54959a5a5fdb8d890b466` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:47.993273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1075e0643e54959a5a5fdb8d890b466)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:47.995344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.021640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.023068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884967c6-cf3a-428f-8015-52199c819928 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.034303 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3437/6892] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:48.035441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa30-7146-4ab3-8f81-c757cac73585 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.035725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa30-7146-4ab3-8f81-c757cac73585 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.036115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa30-7146-4ab3-8f81-c757cac73585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.052016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1075e0643e54959a5a5fdb8d890b466', 'request_id': 'req-50fb41bc-b5a7-4b82-87ee-82c5161451eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.055635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cba2fa30-7146-4ab3-8f81-c757cac73585 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.056898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cba2fa30-7146-4ab3-8f81-c757cac73585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.060511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1075e0643e54959a5a5fdb8d890b466', 'request_id': 'req-50fb41bc-b5a7-4b82-87ee-82c5161451eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.069430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1075e0643e54959a5a5fdb8d890b466', 'request_id': 'req-50fb41bc-b5a7-4b82-87ee-82c5161451eb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.107701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] The token cache is being invalidate because project c1075e0643e54959a5a5fdb8d890b466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:48.108027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.108761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-50fb41bc-b5a7-4b82-87ee-82c5161451eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.112013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3456/6893] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:47 2021] DELETE /identity/v3/projects/c1075e0643e54959a5a5fdb8d890b466 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:48.121517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273028a-50ea-46d1-a70a-d10396c98160 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.122184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273028a-50ea-46d1-a70a-d10396c98160 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.122184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273028a-50ea-46d1-a70a-d10396c98160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.147205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3438/6894] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:48.155074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8273028a-50ea-46d1-a70a-d10396c98160 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.156408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8273028a-50ea-46d1-a70a-d10396c98160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.158939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.159340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.159699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.170424 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3457/6895] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:48.179847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.180333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.181412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.188162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.189625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.203873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3439/6896] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:48.205945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.208165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.209695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.218138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550977-42f4-4267-9219-ee33a5baebb2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.222899 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3458/6897] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:48.227090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.228718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.229843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.230436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.230943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.231971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:48.232577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.234736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.237206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7387ad-074f-486e-8848-90cc2ff82382 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.243623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.244481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.244993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.245491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.246269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:48.246670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.248388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.250549 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3440/6898] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:48.254942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.265331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3459/6899] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:48.269653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864306b-4c18-4a14-b298-3e7b6ef843a8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.271616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.275028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.275767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.276128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.276476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.277289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.279233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.282279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42266db-acb6-4e64-97d8-515bfcdf7c43 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.287792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.288377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.288685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.288961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.289658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.291529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.308663 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3441/6900] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:48.313452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.323493 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3460/6901] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:48.324642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.384180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4584-da5f-4b00-9de2-5ae6f0576fa6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.389912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.390608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.390852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.391121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.391730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699a26-dfbe-4778-be1d-91db8999cad3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.392862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.394987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.397522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.398267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.398620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.398965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.400059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.402061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.418478 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3442/6902] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:48.422600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.427588 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3461/6903] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:48.429443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.435130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0478-26e0-41cf-ace4-c28e33afa29e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.439684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17217-5fd2-4077-9e52-0b3b6b3f9056 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.441051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.441790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.442225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.442570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.443517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.445236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.445766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.446434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.447029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.447305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.448043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.450004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.461963 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3443/6904] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:48.465330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3462/6905] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:48.465480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.467107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.474720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b81a-7188-4a0b-ae6e-bbaef2bc8e50 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.475762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14ecb-6e26-41fe-91c5-a6c75374399d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.479507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.480157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.480425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.480574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.480804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.481103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.481386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.481498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.481667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.482378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.483193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.483944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.495494 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3444/6906] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:48.496863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3463/6907] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:48.500432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.500793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.513866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637729-b5b8-4e13-8b88-e38e3b818b85 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.520531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.521234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36285956-65b5-46fe-9b7b-81cec5a2d4df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.521511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.521790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.522084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] PATH_INFO: `/v3/projects/f5af3cc55a4a46d591d11d43e1bcfda6/users/8056050bef114f6da9da1c5f5edd2afc/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.526911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.527706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.528054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.528574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] PATH_INFO: `/v3/projects/0c57e15af519496da806b41499f6fe80/users/2d499157f918407eae801ada5dc6606d/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.543353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5af3cc55a4a46d591d11d43e1bcfda6, user_id=8056050bef114f6da9da1c5f5edd2afc, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.545175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c57e15af519496da806b41499f6fe80, user_id=2d499157f918407eae801ada5dc6606d, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.546779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.547762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca11d4-5f3c-4b13-b1e4-1b8d7ac247ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.562554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3445/6908] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:48 2021] PUT /identity/v3/projects/f5af3cc55a4a46d591d11d43e1bcfda6/users/8056050bef114f6da9da1c5f5edd2afc/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:48.563519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.564965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3464/6909] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:48 2021] PUT /identity/v3/projects/0c57e15af519496da806b41499f6fe80/users/2d499157f918407eae801ada5dc6606d/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:48.569430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.575184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaacd4f-9625-4efd-8abb-388c1f295bb8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.575466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaacd4f-9625-4efd-8abb-388c1f295bb8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.575808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaacd4f-9625-4efd-8abb-388c1f295bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.603912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cdaacd4f-9625-4efd-8abb-388c1f295bb8 None None] MFA Rules not processed for user `8056050bef114f6da9da1c5f5edd2afc`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.605066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cdaacd4f-9625-4efd-8abb-388c1f295bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.645744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f2c6-3c0b-4824-9d03-0ea8a1bedc19 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.677917 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3465/6910] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:48.683053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.683348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.683846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.709434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.710556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.710826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.711100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] PATH_INFO: `/v3/projects/d5ace8edbac44219994906dd62eb4e97` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.713225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ace8edbac44219994906dd62eb4e97)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.715121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.723414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] MFA Rules not processed for user `2d499157f918407eae801ada5dc6606d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:48.725166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.770324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ace8edbac44219994906dd62eb4e97', 'request_id': 'req-5ca27798-ca3b-4213-87ec-eb5859a67bc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.777510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ace8edbac44219994906dd62eb4e97', 'request_id': 'req-5ca27798-ca3b-4213-87ec-eb5859a67bc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.784558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ace8edbac44219994906dd62eb4e97', 'request_id': 'req-5ca27798-ca3b-4213-87ec-eb5859a67bc3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.804682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] The token cache is being invalidate because project d5ace8edbac44219994906dd62eb4e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:48.804682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.804682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.804682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3446/6911] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:48 2021] DELETE /identity/v3/projects/d5ace8edbac44219994906dd62eb4e97 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:48.804682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.805730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.823718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3466/6912] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:48.824581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.839664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20fb8-3533-4c9f-af6d-b5d4cabd8b29 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.882307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27798-ca3b-4213-87ec-eb5859a67bc3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:48.888439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.889217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.889607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.889907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.890692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.893415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.902710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:48.903673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:48.904018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:48.904359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] PATH_INFO: `/v3/users/2faa8598122648a09ac2e1979c7269e3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:48.905846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2faa8598122648a09ac2e1979c7269e3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:48.908441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:48.936914 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3447/6913] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:48.936914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:48.941894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:48.969825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2faa8598122648a09ac2e1979c7269e3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.978019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2faa8598122648a09ac2e1979c7269e3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.979344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2faa8598122648a09ac2e1979c7269e3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:48.995237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2faa8598122648a09ac2e1979c7269e3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.004337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2faa8598122648a09ac2e1979c7269e3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.010254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b3ee-3f37-45bb-af0c-b5a43edf4a81 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.010988 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3467/6914] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:48 2021] DELETE /identity/v3/users/2faa8598122648a09ac2e1979c7269e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.012105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.013473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.081806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.082545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.082877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.083192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.083869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.087596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.098399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6420-51e7-41b6-8e81-a74285dc6cb9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.103604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.104638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.105084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.105367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.106113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.107998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.129276 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3448/6915] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:48 2021] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:49.139418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3468/6916] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:49 2021] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:49.144967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.147048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.150854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.160090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c222-b658-424c-87d3-492097855cbd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.271825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.272525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.272981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.273271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.274636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.276514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.293965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3469/6917] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:49.297677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.299035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ae44-da34-496a-9d5e-c28451ef5afd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.304300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.305421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.305916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.306412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.307402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.309404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.317306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d6c6-19f5-4141-94f9-50648375735a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.332801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.333698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.333969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.334246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] PATH_INFO: `/v3/projects/eb3a6bc434854a5f9d39e04694d4305d/users/3cdfff9657cb408689f81bfea224b2bf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.346541 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3449/6918] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:49 2021] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:49.360865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.366234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3a6bc434854a5f9d39e04694d4305d, user_id=3cdfff9657cb408689f81bfea224b2bf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.368915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.379053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703931-ab7c-45ab-8aa8-c2fec68afd17 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.390566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.391368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.392972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.393253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.395169 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3470/6919] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:49 2021] PUT /identity/v3/projects/eb3a6bc434854a5f9d39e04694d4305d/users/3cdfff9657cb408689f81bfea224b2bf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.396167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.399600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.399756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.414379 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3450/6920] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:49.418626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.421511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.441761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0e7c-ea64-4033-a056-260427ad188c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.488796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160aed1-2ddc-461e-9330-5e0915bd25eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.494561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.495449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.495834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.496213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.497124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.499744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.516452 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3471/6921] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:49.517952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.531671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5a5dc-bc10-41b0-816c-4f36ff2184b6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.537491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.539477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.539904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.540188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] PATH_INFO: `/v3/projects/4719d135589647c29527b992e56253b2/users/9eababfd395c45de9c9322d827ea836d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.551503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.552695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.553214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.553897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] PATH_INFO: `/v3/projects/ef35e11c8e33433eaf452bd217999a20` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.555268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef35e11c8e33433eaf452bd217999a20)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.557418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.561696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4719d135589647c29527b992e56253b2, user_id=9eababfd395c45de9c9322d827ea836d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.565372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.587251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3472/6922] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:49 2021] PUT /identity/v3/projects/4719d135589647c29527b992e56253b2/users/9eababfd395c45de9c9322d827ea836d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.587831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.619043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef35e11c8e33433eaf452bd217999a20', 'request_id': 'req-0ba899eb-7ebd-4681-ac44-e71c02de36e5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.625156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef35e11c8e33433eaf452bd217999a20', 'request_id': 'req-0ba899eb-7ebd-4681-ac44-e71c02de36e5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.631945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef35e11c8e33433eaf452bd217999a20', 'request_id': 'req-0ba899eb-7ebd-4681-ac44-e71c02de36e5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.648252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] The token cache is being invalidate because project ef35e11c8e33433eaf452bd217999a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:49.648741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.649778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:49.652233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3451/6923] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:49 2021] DELETE /identity/v3/projects/ef35e11c8e33433eaf452bd217999a20 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.654480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.657383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.678571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ad48e-14c0-47b6-a775-73eba7e373d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.746052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba899eb-7ebd-4681-ac44-e71c02de36e5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.753953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.754886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.755352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.755700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.756522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.758241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bbc84-fa99-4a1f-a61f-fc195cd861a0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.771769 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3452/6924] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:49.773376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6986-5628-4ebc-8b22-b1cf20d06229 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.773940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6986-5628-4ebc-8b22-b1cf20d06229 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.774605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6986-5628-4ebc-8b22-b1cf20d06229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.779375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.780461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.780792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.781074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] PATH_INFO: `/v3/projects/eb3a6bc434854a5f9d39e04694d4305d/users/3cdfff9657cb408689f81bfea224b2bf/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.784005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3a6bc434854a5f9d39e04694d4305d, user_id=3cdfff9657cb408689f81bfea224b2bf, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.789269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.800372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1b7a6986-5628-4ebc-8b22-b1cf20d06229 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:49.801986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1b7a6986-5628-4ebc-8b22-b1cf20d06229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.814941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3473/6925] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:49 2021] PUT /identity/v3/projects/eb3a6bc434854a5f9d39e04694d4305d/users/3cdfff9657cb408689f81bfea224b2bf/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.816257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:49.881936 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3453/6926] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:49.883394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.883758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.884256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.894678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217dd1-6a35-48a3-a7bd-f7e9b4117d41 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:49.900759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:49.901868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.902631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.902924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] PATH_INFO: `/v3/projects/4719d135589647c29527b992e56253b2/users/9eababfd395c45de9c9322d827ea836d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.905760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4719d135589647c29527b992e56253b2, user_id=9eababfd395c45de9c9322d827ea836d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:49.908119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471421e-09be-435a-8afe-c5f37f0775f4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:49.920459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3474/6927] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:49 2021] PUT /identity/v3/projects/4719d135589647c29527b992e56253b2/users/9eababfd395c45de9c9322d827ea836d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:49.933859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3458-6e7f-4069-95c1-7567fc2c3e72 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:49.934066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] MFA Rules not processed for user `3cdfff9657cb408689f81bfea224b2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:49.934197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3458-6e7f-4069-95c1-7567fc2c3e72 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:49.934464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3458-6e7f-4069-95c1-7567fc2c3e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:49.936145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:49.956558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0aa3458-6e7f-4069-95c1-7567fc2c3e72 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:49.958899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0aa3458-6e7f-4069-95c1-7567fc2c3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:50.035822 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3475/6928] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:50.035822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.035822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.035822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.047146 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3454/6929] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:49 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:50.047146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.058917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d524ff1-cfff-4e7b-9d91-f016cb8534bf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.065215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.065879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.066157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.066503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.067163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:50.067466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.069081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.080320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] MFA Rules not processed for user `9eababfd395c45de9c9322d827ea836d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:50.081464 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3455/6930] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:50.082654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.083437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:50.085749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:50.158791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bf46-8797-42c0-a771-1b5007c13bd1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.166624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.167282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.167559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.167832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.181288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3476/6931] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:50.181732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.182973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.183123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.195888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02831d-9812-41a2-a7b3-0772b29f9314 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.196744 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3456/6932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:50.197712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.202956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.205629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.206160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.206659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.207757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.209812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad14e-0d34-4f61-bbeb-c5c8ebe2b4e2 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.213150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.216865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.217813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.218307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.218663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.219473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.221493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.255682 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3477/6933] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.257160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.267721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3457/6934] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/projects => generated 350 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.269436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.371696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fb70-e1b6-4ffb-88da-7ca000f5d6dd tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.379589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.381321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.381786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.386400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.389907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.393347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.411548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c4211-3d35-449a-97af-f5d3fd401d3b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.434891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3458/6935] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/projects => generated 351 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.436572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.492161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.493354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.495542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.496049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.497031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.500003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.527623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124f8a-d533-4391-a122-334565b2d855 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.533498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.534900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.535191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.535470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/users/2d499157f918407eae801ada5dc6606d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.536813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:get_user(user_id=2d499157f918407eae801ada5dc6606d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.537596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3478/6936] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.542278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.544012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.546551 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3459/6937] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/users/2d499157f918407eae801ada5dc6606d => generated 287 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:50.552246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.561381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaaea6-02a6-4df2-993d-dee808b4e26a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.574819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5599a-25da-40e1-b5dc-145f89cd374e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.587453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.588225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.588508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.588809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.589550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.591322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.647313 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3460/6938] 10.222.0.13 () {60 vars in 1161 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/credentials => generated 430 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.648260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.667613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad92b69-b634-4de8-b0d3-403eb5f6f255 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.681591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.684043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.684936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.686078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.686649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.687156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.688055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.689380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.690350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.694180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.694579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.696924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.701818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.704686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.721687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3479/6939] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:50.729456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.730864 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3461/6940] 10.222.0.13 () {60 vars in 1357 bytes} [Wed Nov 10 04:20:50 2021] PATCH /identity/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0 => generated 437 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:50.732378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.745909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7b56-23a7-41cc-b4a0-089b3e1d50f9 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.749502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276235-00ae-43e3-9b87-93c297a799f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.754562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.755805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.755953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.756343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.759857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.760800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.761478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.761760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.762039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.762814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.762938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.764384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.766221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3462/6941] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0 => generated 437 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:50.773384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.787666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69cb9-270d-4a67-85d7-8e639ffee8cc tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.789458 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3480/6942] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:50.793853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.796837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.797747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.798027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.798909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.802962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.803597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.812695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23da26-0920-4183-88c8-ff460fe183a4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.829047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.831012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.832232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.832511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] PATH_INFO: `/v3/projects/f9f70aea4a044e1e9fd9e8434be69a75/users/74762f5eb6c843c68a88f79e6a18ba80/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.845939 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3463/6943] 10.222.0.13 () {58 vars in 1337 bytes} [Wed Nov 10 04:20:50 2021] DELETE /identity/v3/credentials/43cbe8b79153b1b8e7c520792083b3d5df503c0b4a74c22fe23a96f7a0479ae0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:50.847735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.864215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f70aea4a044e1e9fd9e8434be69a75, user_id=74762f5eb6c843c68a88f79e6a18ba80, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.867156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1ea9-6764-4402-8b4b-e556c200fa67 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.868005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c351-2d75-40ab-93fc-07ff4787212b tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.875031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:50.877106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.877495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.877870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.878701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:50.880538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:50.888991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3481/6944] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:50 2021] PUT /identity/v3/projects/f9f70aea4a044e1e9fd9e8434be69a75/users/74762f5eb6c843c68a88f79e6a18ba80/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:50.893647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:50.894145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:50.894522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:50.906827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3464/6945] 10.222.0.13 () {60 vars in 1161 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/credentials => generated 430 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:50.908251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:50.922448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29678-082a-41f2-ab6f-496a33ee4da2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:50.927715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] MFA Rules not processed for user `74762f5eb6c843c68a88f79e6a18ba80`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:50.929082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:51.000592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.001386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.001722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.001937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.003179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.004751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.011665 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3482/6946] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:51.023791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3465/6947] 10.222.0.13 () {60 vars in 1161 bytes} [Wed Nov 10 04:20:50 2021] POST /identity/v3/credentials => generated 430 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:51.027964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.030390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.034264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:51.040235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73943e-8b71-4951-9eaa-3ad4d3c79c7b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.045874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.046902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.047298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.047646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.048441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.050072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.058789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.061076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.063049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.065260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.071345 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3483/6948] 10.222.0.13 () {58 vars in 1139 bytes} [Wed Nov 10 04:20:51 2021] GET /identity/v3/credentials => generated 945 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:51.072353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.085277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab9e19-ed5e-4341-8f13-5272d043952e tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.091060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.092241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.092596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.093011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials/931efe507058be2a5ac830fa3fac76347ca980447f66f67d7fd749bb52da2c45` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.096050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=931efe507058be2a5ac830fa3fac76347ca980447f66f67d7fd749bb52da2c45)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.098300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.112172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aae3c-eb89-4f1a-8d27-c17a571e7053 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.116439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.117381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.117668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.117996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.125468 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3484/6949] 10.222.0.13 () {58 vars in 1337 bytes} [Wed Nov 10 04:20:51 2021] DELETE /identity/v3/credentials/931efe507058be2a5ac830fa3fac76347ca980447f66f67d7fd749bb52da2c45 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:51.127484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.129034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.130506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.140374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d861-c238-47cf-9388-f3c6a230ca71 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.142477 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3466/6950] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:51.147205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.148165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.148447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.148951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/credentials/f61879f19d534b5ccd2afd7663741d090a5646f5b2a53e0f6dcae5a893b7959d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.151034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f61879f19d534b5ccd2afd7663741d090a5646f5b2a53e0f6dcae5a893b7959d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.152963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.177882 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3485/6951] 10.222.0.13 () {58 vars in 1337 bytes} [Wed Nov 10 04:20:51 2021] DELETE /identity/v3/credentials/f61879f19d534b5ccd2afd7663741d090a5646f5b2a53e0f6dcae5a893b7959d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:51.182925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.196347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ecb71-5599-47b1-8b74-a218af9f4e3b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.205385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.206766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.207419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.207895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/projects/74bcfce02f7c45e4845ef4bc72d3e724` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.210719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74bcfce02f7c45e4845ef4bc72d3e724)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.213576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.273175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bcfce02f7c45e4845ef4bc72d3e724', 'request_id': 'req-53e00979-9540-495a-a253-ff76a80bf8f2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.280156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bcfce02f7c45e4845ef4bc72d3e724', 'request_id': 'req-53e00979-9540-495a-a253-ff76a80bf8f2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.290287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bcfce02f7c45e4845ef4bc72d3e724', 'request_id': 'req-53e00979-9540-495a-a253-ff76a80bf8f2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.305568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] The token cache is being invalidate because project 74bcfce02f7c45e4845ef4bc72d3e724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:51.305968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.306820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.308837 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3467/6952] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:51 2021] DELETE /identity/v3/projects/74bcfce02f7c45e4845ef4bc72d3e724 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:51.312740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.314575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:51.328474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbdedf-8854-45ee-bca0-f31d97a3b6b3 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.439602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eababfd395c45de9c9322d827ea836d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4719d135589647c29527b992e56253b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.441840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.442385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.443142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] PATH_INFO: `/v3/projects/d07c3ddc88b04b8e8eb8d780a7e6f87b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.445466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d07c3ddc88b04b8e8eb8d780a7e6f87b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.448638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.546128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07c3ddc88b04b8e8eb8d780a7e6f87b', 'request_id': 'req-487b2318-5fcc-44af-b844-43654c0d2a3a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.560673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07c3ddc88b04b8e8eb8d780a7e6f87b', 'request_id': 'req-487b2318-5fcc-44af-b844-43654c0d2a3a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.574281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07c3ddc88b04b8e8eb8d780a7e6f87b', 'request_id': 'req-487b2318-5fcc-44af-b844-43654c0d2a3a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.597138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] The token cache is being invalidate because project d07c3ddc88b04b8e8eb8d780a7e6f87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:51.597678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.607116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-487b2318-5fcc-44af-b844-43654c0d2a3a tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.612371 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3486/6953] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:51 2021] DELETE /identity/v3/projects/d07c3ddc88b04b8e8eb8d780a7e6f87b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:51.613431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:51.615077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:51.717772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00979-9540-495a-a253-ff76a80bf8f2 tempest-CredentialsTestJSON-607902773 tempest-CredentialsTestJSON-607902773-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:51.807558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:51.808637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.809061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.809488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] PATH_INFO: `/v3/users/2d499157f918407eae801ada5dc6606d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.810854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d499157f918407eae801ada5dc6606d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:51.813340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:51.890663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d499157f918407eae801ada5dc6606d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.900309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d499157f918407eae801ada5dc6606d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.901899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d499157f918407eae801ada5dc6606d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.903707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d499157f918407eae801ada5dc6606d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.917883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d499157f918407eae801ada5dc6606d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:51.955986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3468/6954] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:51 2021] DELETE /identity/v3/users/2d499157f918407eae801ada5dc6606d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:51.959990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:51.960280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:51.960552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:51.982165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:51.983404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:52.080940 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3487/6955] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:52.091701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:52.093202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:52.153198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c498b-1f7e-4834-bf52-e7e6f24d334b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:52.156757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:52.157959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:52.158373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:52.158633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:52.169280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:52.170978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb8e6-6352-42af-bdcb-87712e315bbf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:52.188858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3469/6956] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:52.698703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:52.700296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:52.730027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6acf2-e531-4f0a-b6d0-27b35635d314 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:52.747316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:52.748239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:52.748544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:52.748841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] PATH_INFO: `/v3/users/8056050bef114f6da9da1c5f5edd2afc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:52.750302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8056050bef114f6da9da1c5f5edd2afc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:52.752246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:52.850638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8056050bef114f6da9da1c5f5edd2afc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:52.861724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8056050bef114f6da9da1c5f5edd2afc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:52.862991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8056050bef114f6da9da1c5f5edd2afc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:52.881740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8056050bef114f6da9da1c5f5edd2afc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:52.892694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8056050bef114f6da9da1c5f5edd2afc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:52.902397 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3488/6957] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:52 2021] DELETE /identity/v3/users/8056050bef114f6da9da1c5f5edd2afc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:52.907964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:52.908672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:52.909126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:52.944330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:52.946001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:53.016492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:53.018376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:53.070754 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3470/6958] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:53.088884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:53.090890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:53.175800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f792f-1bd3-419d-a119-695701e3ec96 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:53.193051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:53.194516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:53.194737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:53.195409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] PATH_INFO: `/v3/projects/0c57e15af519496da806b41499f6fe80` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:53.199076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c57e15af519496da806b41499f6fe80)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:53.203323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:53.217756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462f24-77b8-4e28-bdbf-91353c5501d0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:53.225121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:53.225787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:53.226062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:53.226333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:53.240990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:53.242425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:53.254763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3471/6959] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:53.308408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c57e15af519496da806b41499f6fe80', 'request_id': 'req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.319207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c57e15af519496da806b41499f6fe80', 'request_id': 'req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.338682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c57e15af519496da806b41499f6fe80', 'request_id': 'req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.361931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] The token cache is being invalidate because project 0c57e15af519496da806b41499f6fe80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:53.362775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.363450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.365331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3489/6960] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:53 2021] DELETE /identity/v3/projects/0c57e15af519496da806b41499f6fe80 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:53.369000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:53.384037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2afde-4336-4fa3-a98e-9f59418291b7 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:53.467564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:53.468749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:53.469080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:53.469354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] PATH_INFO: `/v3/users/9eababfd395c45de9c9322d827ea836d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:53.471199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eababfd395c45de9c9322d827ea836d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:53.473148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:53.528871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eababfd395c45de9c9322d827ea836d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.536451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eababfd395c45de9c9322d827ea836d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.537189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eababfd395c45de9c9322d827ea836d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.537803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eababfd395c45de9c9322d827ea836d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.548206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eababfd395c45de9c9322d827ea836d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.570946 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3472/6961] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:53 2021] DELETE /identity/v3/users/9eababfd395c45de9c9322d827ea836d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:53.720472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:53.723784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:53.748489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8bb3-636e-47cc-9b01-9bd942d8a8f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:53.850033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:53.851540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:53.853022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:53.853653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] PATH_INFO: `/v3/projects/f5af3cc55a4a46d591d11d43e1bcfda6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:53.857356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5af3cc55a4a46d591d11d43e1bcfda6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:53.860871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:53.923370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5af3cc55a4a46d591d11d43e1bcfda6', 'request_id': 'req-042d2008-95ce-400c-b23b-8df4aa43bd5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.929288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5af3cc55a4a46d591d11d43e1bcfda6', 'request_id': 'req-042d2008-95ce-400c-b23b-8df4aa43bd5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.936489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5af3cc55a4a46d591d11d43e1bcfda6', 'request_id': 'req-042d2008-95ce-400c-b23b-8df4aa43bd5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.953515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] The token cache is being invalidate because project f5af3cc55a4a46d591d11d43e1bcfda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:53.954110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.955591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:53.963442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3490/6962] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:53 2021] DELETE /identity/v3/projects/f5af3cc55a4a46d591d11d43e1bcfda6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:53.964365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:53.965999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:53.994717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c1e-ca6a-4582-891d-4bd7bf05c6ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.036921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.038667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:54.112028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.112966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.115454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.115760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] PATH_INFO: `/v3/users/3cdfff9657cb408689f81bfea224b2bf` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.117897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdfff9657cb408689f81bfea224b2bf)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.119874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.149105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2008-95ce-400c-b23b-8df4aa43bd5a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.158127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.159340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.159638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.160283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] PATH_INFO: `/v3/projects/4719d135589647c29527b992e56253b2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.162157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4719d135589647c29527b992e56253b2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.164055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.196778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdfff9657cb408689f81bfea224b2bf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.206193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdfff9657cb408689f81bfea224b2bf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.207174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdfff9657cb408689f81bfea224b2bf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.208800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdfff9657cb408689f81bfea224b2bf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.219258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd2a1cf5-ab0c-4b13-8391-9aeaed5566ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdfff9657cb408689f81bfea224b2bf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.239210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4719d135589647c29527b992e56253b2', 'request_id': 'req-a7fedf36-d5e8-4891-9976-a99a965c417d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.247010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4719d135589647c29527b992e56253b2', 'request_id': 'req-a7fedf36-d5e8-4891-9976-a99a965c417d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.253458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3473/6963] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:53 2021] DELETE /identity/v3/users/3cdfff9657cb408689f81bfea224b2bf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:54.263102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4719d135589647c29527b992e56253b2', 'request_id': 'req-a7fedf36-d5e8-4891-9976-a99a965c417d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.283407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] The token cache is being invalidate because project 4719d135589647c29527b992e56253b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:54.283735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.284646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a7fedf36-d5e8-4891-9976-a99a965c417d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:54.290882 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3491/6964] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:54 2021] DELETE /identity/v3/projects/4719d135589647c29527b992e56253b2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:54.293630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.293927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.294204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.338512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:54.340052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:54.429528 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3474/6965] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:54.441072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.441802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.441802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.460837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:54.461724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:54.473473 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3492/6966] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:54.475074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.486671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d673d5-80db-4f24-b289-e4529b48274c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.494125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.494871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.495232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.495570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.496428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:54.496821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.498466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.520583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3475/6967] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:54.521920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.542619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bef87-ef26-403d-b452-e468a65a4724 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.547612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.549028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.549397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.549679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.550412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.552295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.586194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3493/6968] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:54 2021] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:54.590879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.603854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ad10-c318-49a3-a986-e938b0ac641a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.681100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.681782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.682068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.682345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.683058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.686044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.706846 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3476/6969] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:54 2021] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:54.710835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.721623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545804-0143-41bd-b11d-8c3dd5202b16 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.726603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.727205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.727512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.727992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.728760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.730348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.742272 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3494/6970] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:54.747821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.758188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd111d77-ded4-4058-a0e7-6fe6da4c5d6a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.764484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.765205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.765492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.765771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.767636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.769696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.783930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3477/6971] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:54.788076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.799729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d075a-37a4-4e35-8844-a1e48aa81f24 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.810127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.811020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.811488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.811765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] PATH_INFO: `/v3/projects/4c31e6e373284702a5466635e176d6de/users/9b354367c4804690bbcc541b5b5255ce/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.841852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c31e6e373284702a5466635e176d6de, user_id=9b354367c4804690bbcc541b5b5255ce, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.845861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca9b8-ba77-4223-a848-312556e2a6aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:54.859320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:54.862325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:54.874295 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3495/6972] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:54 2021] PUT /identity/v3/projects/4c31e6e373284702a5466635e176d6de/users/9b354367c4804690bbcc541b5b5255ce/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:54.882453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.882897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.883306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.889865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771043-403b-4db7-aab4-1bbbb96feca1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:54.925935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] MFA Rules not processed for user `9b354367c4804690bbcc541b5b5255ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:54.934600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:54.956736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:54.957604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:54.957880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:54.958149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] PATH_INFO: `/v3/projects/eb3a6bc434854a5f9d39e04694d4305d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:54.959719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3a6bc434854a5f9d39e04694d4305d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:54.961640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.015533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3a6bc434854a5f9d39e04694d4305d', 'request_id': 'req-d69582e9-00f0-43c0-b691-79406fe0e65f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:55.018081 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3496/6973] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:54 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:55.018960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.022912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3a6bc434854a5f9d39e04694d4305d', 'request_id': 'req-d69582e9-00f0-43c0-b691-79406fe0e65f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:55.029462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3a6bc434854a5f9d39e04694d4305d', 'request_id': 'req-d69582e9-00f0-43c0-b691-79406fe0e65f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:55.030158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6510699-734d-49e3-8c6c-4d816911286b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.049192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] The token cache is being invalidate because project eb3a6bc434854a5f9d39e04694d4305d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:55.049476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:55.050212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d69582e9-00f0-43c0-b691-79406fe0e65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:55.053532 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3478/6974] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:54 2021] DELETE /identity/v3/projects/eb3a6bc434854a5f9d39e04694d4305d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:55.059705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817ee6-cdbf-4424-bf09-34d26afea3e5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.060068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817ee6-cdbf-4424-bf09-34d26afea3e5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.061038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817ee6-cdbf-4424-bf09-34d26afea3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.087496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6c817ee6-cdbf-4424-bf09-34d26afea3e5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:55.088877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c817ee6-cdbf-4424-bf09-34d26afea3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:55.095889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.097131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.097647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.098105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.099072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.100093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3479/6975] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:55.101888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.107595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.108159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.108251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.129344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:55.130665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:55.136948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3497/6976] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:55.140933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.143430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:55.150333 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3480/6977] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:55.151618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.163992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765303fa-1d99-4c3b-b21d-9eb3de6a215b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.219656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a931d4-785a-4bb1-a7d4-a52db400dd75 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.225255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.225980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.226264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.226539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.227731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.229552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.257920 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3498/6978] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:55.258894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.259639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.259922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.260198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.261191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:55.261557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.262572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.263198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.278252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6df9-8321-49bb-88c8-06a92435d048 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.280270 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3481/6979] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:55.284791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.285595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.285753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.286067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.286546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.287291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.290212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.299951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2c0-ead9-4573-ad92-7654ce166c28 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.303168 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3499/6980] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:55.308055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.309261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.309940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.310311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.310613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.311502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.314096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.325389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a2b7-2814-48c3-86a1-061297c13e74 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.332751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.333695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.334429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.334429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] PATH_INFO: `/v3/projects/77e87aef57624035b0554b3bc0f36362/users/a191efa18c4447378a985930215eceac/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.349196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3482/6981] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:55.352066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.357570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e87aef57624035b0554b3bc0f36362, user_id=a191efa18c4447378a985930215eceac, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.360745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.383385 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3500/6982] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:55 2021] PUT /identity/v3/projects/77e87aef57624035b0554b3bc0f36362/users/a191efa18c4447378a985930215eceac/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:55.388027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.430868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a092-2faa-4845-84b9-a5a6d1b6367e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.470960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc485-a662-4d68-b919-922d5bde8afa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.476840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.477518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.477792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.478071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.478818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.480411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.512281 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3501/6983] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:55.513516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.531202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.531202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.531202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.531202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.532137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.534529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.539273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95393c5-099b-4d82-bd15-3c78ec57a3ce admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.550700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.551845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.552328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.552831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] PATH_INFO: `/v3/projects/77e87aef57624035b0554b3bc0f36362/users/a191efa18c4447378a985930215eceac/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.558425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e87aef57624035b0554b3bc0f36362, user_id=a191efa18c4447378a985930215eceac, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.564532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a69f9-c063-458c-a533-b02371f73c33 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.572357 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3483/6984] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:55.574961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.586080 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3502/6985] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:55 2021] PUT /identity/v3/projects/77e87aef57624035b0554b3bc0f36362/users/a191efa18c4447378a985930215eceac/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:55.588428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.588990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.589407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.595172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b4af-2d6c-48c3-8a8c-2d494c2b2e75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.640260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] MFA Rules not processed for user `a191efa18c4447378a985930215eceac`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:55.642015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:55.706247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.706934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.707520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.708111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.709110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.711306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.726701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3484/6986] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:55.731790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.746754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b661d-bb47-449b-b891-2ab4f4d31107 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.756303 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3503/6987] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:55.757714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.760764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.761092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.761447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.761795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.763450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.765678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.773287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9cf87-8571-45da-8b4f-8577f1ca03de None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.778795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.779539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.780066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.780415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.781524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.782038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3485/6988] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:55.786620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.787079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.802258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe05bf-7f13-45a4-9042-29daa487bea8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.812589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3504/6989] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/domains => generated 276 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:55.812902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:55.815395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.815910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.816424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] PATH_INFO: `/v3/projects/53cb324db4544be1927edf51212d567f/users/41dff46cd67746848d8da58bffc9db7b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.817731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:55.840254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cb324db4544be1927edf51212d567f, user_id=41dff46cd67746848d8da58bffc9db7b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:55.845898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59b0ab-9526-41ef-872b-d7e43fc69dde admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:55.902328 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3486/6990] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:55 2021] PUT /identity/v3/projects/53cb324db4544be1927edf51212d567f/users/41dff46cd67746848d8da58bffc9db7b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:55.903687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:55.903687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:55.904313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:55.919599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8e8a-8439-4ad7-b860-884e54e47806 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:55.950503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] MFA Rules not processed for user `41dff46cd67746848d8da58bffc9db7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:55.952525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:56.021898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.022588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.022868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.023388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.024151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.026299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.044779 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3487/6991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:56.050234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.060781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3505/6992] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:20:55 2021] POST /identity/v3/domains => generated 276 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.061827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.151067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0fc8a-e90d-4fe6-8a11-b02f69ad2ad0 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.155577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a56de-3d6d-480f-a67b-c9e21264f94a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.157923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.159807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.160279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.161025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.162206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.164729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.187427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3506/6993] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:20:56 2021] POST /identity/v3/domains => generated 277 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.193787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.262512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.263206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.263435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.263705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.264516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.267972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.306650 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3488/6994] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:56 2021] POST /identity/v3/projects => generated 393 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.307012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948023a5-669b-4f62-9c3d-23c2dcc1b03e tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.310234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.393818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.394898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.395345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.395791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.396853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.399338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.405764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cf32-0ca7-4cee-afa1-006d8445c6d8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.414251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.414682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.415059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.415059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.415059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.415059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.427103 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3507/6995] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:20:56 2021] POST /identity/v3/domains => generated 280 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.430661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.448660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3489/6996] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:56 2021] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.452264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.466446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246877-21ba-4840-9735-26236e8300fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.527579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f301c-bfbf-425c-b715-ddcf1ad240b5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.537987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.539437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.539733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.540069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/17bb443e8ebc4d83b264d9bb07de1bfe` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.545631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.546621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.546969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.547304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.548142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.550209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.558247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=17bb443e8ebc4d83b264d9bb07de1bfe)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.559914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.572468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3490/6997] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:56 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:56.578286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.592280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466614e3-6335-4655-8c29-9e10220da16a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.596817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.601221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.601515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.601791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.602885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] PATH_INFO: `/v3/projects/9462515b9fcd48f5b6be24499a604195/users/0db155b701144fadbda8409abb7bce93/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.609599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.622338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9462515b9fcd48f5b6be24499a604195, user_id=0db155b701144fadbda8409abb7bce93, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.625486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.657205 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3491/6998] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:56 2021] PUT /identity/v3/projects/9462515b9fcd48f5b6be24499a604195/users/0db155b701144fadbda8409abb7bce93/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:56.659847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.687524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.694302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.701668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.723591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 17bb443e8ebc4d83b264d9bb07de1bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:56.724362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.725239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.736057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.740465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.741347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '17bb443e8ebc4d83b264d9bb07de1bfe', 'request_id': 'req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:56.754512 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3508/6999] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:56 2021] DELETE /identity/v3/domains/17bb443e8ebc4d83b264d9bb07de1bfe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:56.757425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.760362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:56.778439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae255-12a2-485b-859c-2e33111388ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.868203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2970b-7ab7-4474-9ff1-b499e16c3b56 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:56.879258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.881388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.881782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.882178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.883121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.893199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.894443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:56.895335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:56.895774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:56.896486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:56.897868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:56.901583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:56.922727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3509/7000] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:20:56 2021] POST /identity/v3/domains => generated 248 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:56.927164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.927935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3492/7001] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:56 2021] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:56.929408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:56.932060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:56.955132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bb808-d2c3-4622-9df6-c546007bc82e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.026359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37536-3004-4e71-93be-327f9fa61db6 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.034193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.035105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.035610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.036066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.036295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.036675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.036935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] PATH_INFO: `/v3/projects/9462515b9fcd48f5b6be24499a604195/users/0db155b701144fadbda8409abb7bce93/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.037158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/7a11dae8d6154b76a992c48496580bba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.039445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9462515b9fcd48f5b6be24499a604195, user_id=0db155b701144fadbda8409abb7bce93, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.042498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795f7e1-3647-4289-aa8b-689266ea03a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.051801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7a11dae8d6154b76a992c48496580bba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.053462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.057448 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3493/7002] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:56 2021] PUT /identity/v3/projects/9462515b9fcd48f5b6be24499a604195/users/0db155b701144fadbda8409abb7bce93/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:57.092794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.093808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.139361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.140246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.142894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.145372 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3510/7003] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:56 2021] PATCH /identity/v3/domains/7a11dae8d6154b76a992c48496580bba => generated 249 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:57.149469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.149767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.151788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.155577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.188992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] MFA Rules not processed for user `0db155b701144fadbda8409abb7bce93`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:57.190488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.246890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f911-d437-46a8-ace7-c1a0e5e4e0ff tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.257142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.258033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.258309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.258580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/7a11dae8d6154b76a992c48496580bba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.270849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7a11dae8d6154b76a992c48496580bba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.272876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.289827 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3494/7004] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:57 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:57.301186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.302977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.303739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.307325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7a11dae8d6154b76a992c48496580bba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.383070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.383293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08659b-d3e0-4403-815d-61b4c9f1e32b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.389429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.399582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.413941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 7a11dae8d6154b76a992c48496580bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:57.414309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.415079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.426652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.430763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.431674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7a11dae8d6154b76a992c48496580bba', 'request_id': 'req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.437717 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3511/7005] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:57 2021] DELETE /identity/v3/domains/7a11dae8d6154b76a992c48496580bba => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:57.443305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.449075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.455394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.456151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.456644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.456997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.458936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.557148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.558259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.575933 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3495/7006] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:57 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:57.586925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec589-4ef3-4c71-8756-4dd24a8e7d8b tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.594915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.595789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.596193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.596477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.597529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.598910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.621724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3512/7007] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:20:57 2021] POST /identity/v3/domains => generated 278 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:57.625070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.641089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a097b2-509a-432b-ace6-f1f9985f04dd service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.715574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.716442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.716938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.717089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/5382e31fc2c045d4b450326fda1cef35` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.728670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5382e31fc2c045d4b450326fda1cef35)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.730260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.753337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.754088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.786636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.787262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:57.793236 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3496/7008] 10.222.0.13 () {60 vars in 1249 bytes} [Wed Nov 10 04:20:57 2021] PATCH /identity/v3/domains/5382e31fc2c045d4b450326fda1cef35 => generated 279 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:57.794012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.795911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:57.818798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4213-cc7a-49af-84de-e7e0fb887b11 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.894452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.895664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.896133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.896781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/5382e31fc2c045d4b450326fda1cef35` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.912739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=5382e31fc2c045d4b450326fda1cef35)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.914822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:57.916661 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3513/7009] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:20:57 2021] GET /identity/v3/domains/5382e31fc2c045d4b450326fda1cef35 => generated 279 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:57.920563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:57.931291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247c2f0-8507-495e-8999-35cd6ae50f71 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:57.956116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:57.959799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:57.960039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:57.960455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/5382e31fc2c045d4b450326fda1cef35` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:57.963033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5382e31fc2c045d4b450326fda1cef35)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:57.966446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.012264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.029391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5382e31fc2c045d4b450326fda1cef35'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.068977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.075465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.082456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.102651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 5382e31fc2c045d4b450326fda1cef35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:58.102946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.104344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.121961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.125354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.126747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5382e31fc2c045d4b450326fda1cef35', 'request_id': 'req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.134928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3497/7010] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:57 2021] DELETE /identity/v3/domains/5382e31fc2c045d4b450326fda1cef35 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:58.138963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.140735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:58.153434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df06b-447d-4655-a5dd-57ce51407048 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.210063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.210659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.210941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.211274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.212685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.213601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.226445 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3514/7011] 10.222.0.13 () {58 vars in 1127 bytes} [Wed Nov 10 04:20:58 2021] GET /identity/v3/domains => generated 1347 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:58.230662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.241094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea169f2-0bd6-4fb7-8272-ad4401f30c8c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.245787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.246644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.246925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.247202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/5382e31fc2c045d4b450326fda1cef35` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.254433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:20:58.263467 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find domain: 5382e31fc2c045d4b450326fda1cef35.: keystone.exception.DomainNotFound: Could not find domain: 5382e31fc2c045d4b450326fda1cef35. Nov 10 04:20:58.270902 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3498/7012] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:58 2021] PATCH /identity/v3/domains/5382e31fc2c045d4b450326fda1cef35 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:58.272635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.283086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8c948-4b8d-442a-92ab-2b6598137408 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.287666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.288336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.288631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.288948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.289684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.291247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.309761 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3515/7013] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:20:58 2021] POST /identity/v3/domains => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:58.310997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.321312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f5cd-7795-46b9-8414-f60a7d9ab665 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.362726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.364990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:58.383036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.383705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.383993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.384266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.385034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.386942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.422967 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3499/7014] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:58 2021] POST /identity/v3/users => generated 346 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:58.427291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.436887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429be94-ae1b-4de6-9968-5a04af4bb460 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.441662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.442316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.442619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.442869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.443566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.445492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ec69-cb4c-4da8-97fa-e5762afe5324 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.445645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.450998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.452038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.452361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.452659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] PATH_INFO: `/v3/users/74762f5eb6c843c68a88f79e6a18ba80` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.454362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74762f5eb6c843c68a88f79e6a18ba80)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.456348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.461116 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3500/7015] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:20:58 2021] POST /identity/v3/groups => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:20:58.466120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.478205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e39141-4d60-49e1-8f07-a887900cd499 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.490539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.492502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.492831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.493110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/13b17e280ad647f083f8c5096a862536` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.494596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=13b17e280ad647f083f8c5096a862536)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.496529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.529338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.530289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.548726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74762f5eb6c843c68a88f79e6a18ba80'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.557258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74762f5eb6c843c68a88f79e6a18ba80'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.558610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74762f5eb6c843c68a88f79e6a18ba80'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.573952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.574859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.576924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74762f5eb6c843c68a88f79e6a18ba80'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.580770 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3501/7016] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:58 2021] PATCH /identity/v3/domains/13b17e280ad647f083f8c5096a862536 => generated 276 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:58.584710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.586564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:58.589768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b31ed8b6-5787-4a67-a01e-93973ff5cdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74762f5eb6c843c68a88f79e6a18ba80'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.597343 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3516/7017] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:58 2021] DELETE /identity/v3/users/74762f5eb6c843c68a88f79e6a18ba80 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:58.601904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.602293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.602669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.624057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:58.625540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:58.655654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15926e-8441-4b41-9c11-6c72d3f10550 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.693436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3517/7018] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:58.704900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:58.706344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:58.717162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.718046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.718317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.718591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/13b17e280ad647f083f8c5096a862536` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.730836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13b17e280ad647f083f8c5096a862536)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.732453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.758278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.771488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a42dc-a90d-49ea-abe7-b0db54717b2c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:58.776091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:58.776947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:58.777288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:58.777675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:58.789294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:58.791123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:58.804044 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3518/7019] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:20:58.893158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f51386ae7444c09c41bb74f6ad1fcd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.900499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f51386ae7444c09c41bb74f6ad1fcd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.901278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f51386ae7444c09c41bb74f6ad1fcd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.902391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f51386ae7444c09c41bb74f6ad1fcd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.911661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f51386ae7444c09c41bb74f6ad1fcd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.931289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '13b17e280ad647f083f8c5096a862536'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.977922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.984728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:58.991987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.006189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.008071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.010059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 13b17e280ad647f083f8c5096a862536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:59.010598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.011213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.021171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.024743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.025668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '13b17e280ad647f083f8c5096a862536', 'request_id': 'req-8ee0da31-293e-4819-a491-4292fa86bea9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.028217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d9cc-0369-4782-bf96-1e35c69574bc service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.034865 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3502/7020] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:58 2021] DELETE /identity/v3/domains/13b17e280ad647f083f8c5096a862536 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:59.039014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.040705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.097628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.098399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.098683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.098977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] PATH_INFO: `/v3/projects/f9f70aea4a044e1e9fd9e8434be69a75` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.101027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f70aea4a044e1e9fd9e8434be69a75)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.102914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.111087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0da31-293e-4819-a491-4292fa86bea9 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.118878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.119738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.120962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.121545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/13b17e280ad647f083f8c5096a862536` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.130205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=13b17e280ad647f083f8c5096a862536)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.132206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.148843 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find domain: 13b17e280ad647f083f8c5096a862536.: keystone.exception.DomainNotFound: Could not find domain: 13b17e280ad647f083f8c5096a862536. Nov 10 04:20:59.150532 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3503/7021] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/domains/13b17e280ad647f083f8c5096a862536 => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:59.154244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.159895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f70aea4a044e1e9fd9e8434be69a75', 'request_id': 'req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.165816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f70aea4a044e1e9fd9e8434be69a75', 'request_id': 'req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.167097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439498-b6ff-4bd2-9245-633344a04494 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.172594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f70aea4a044e1e9fd9e8434be69a75', 'request_id': 'req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.187069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] The token cache is being invalidate because project f9f70aea4a044e1e9fd9e8434be69a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:59.187787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.188464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3aa74dae-bb89-4dfb-aa8c-fcb13976100b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.190776 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3519/7022] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:20:59 2021] DELETE /identity/v3/projects/f9f70aea4a044e1e9fd9e8434be69a75 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:20:59.196773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168a56-2807-4eb3-ace5-98ceeeb1969d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.197160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168a56-2807-4eb3-ace5-98ceeeb1969d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.197507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168a56-2807-4eb3-ace5-98ceeeb1969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.218582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe168a56-2807-4eb3-ace5-98ceeeb1969d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:59.221226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe168a56-2807-4eb3-ace5-98ceeeb1969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.233924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.234865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.235143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.236037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/users/36f51386ae7444c09c41bb74f6ad1fcd` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.245597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:get_user(user_id=36f51386ae7444c09c41bb74f6ad1fcd)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.247674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.267514 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find user: 36f51386ae7444c09c41bb74f6ad1fcd.: keystone.exception.UserNotFound: Could not find user: 36f51386ae7444c09c41bb74f6ad1fcd. Nov 10 04:20:59.269476 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3504/7023] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/users/36f51386ae7444c09c41bb74f6ad1fcd => generated 110 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:20:59.272988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.274932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.287364 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3520/7024] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:20:59.288233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcc9e3-7aef-46c0-8735-d782289ef6eb tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.292902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.293898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.294238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.294583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/groups/063abe0a4e3442c3a29719644060e446` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.295195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.295414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.295698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.300013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:get_group(group_id=063abe0a4e3442c3a29719644060e446)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.302109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.314571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:59.315933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.318128 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find group: 063abe0a4e3442c3a29719644060e446.: keystone.exception.GroupNotFound: Could not find group: 063abe0a4e3442c3a29719644060e446. Nov 10 04:20:59.320263 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3505/7025] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/groups/063abe0a4e3442c3a29719644060e446 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:20:59.323905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.324094 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3521/7026] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:59.328391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.336991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae102-5acd-4147-b1b2-19f352d8c23f tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.337922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd9f6-646d-4006-afe8-dfbdb8907618 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.342429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.342602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.343153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.343428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.343703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.344199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.344430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:59.345348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.345742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.346407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/groups/063abe0a4e3442c3a29719644060e446` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.346937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.351566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:20:59.361034 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find group: 063abe0a4e3442c3a29719644060e446.: keystone.exception.GroupNotFound: Could not find group: 063abe0a4e3442c3a29719644060e446. Nov 10 04:20:59.362630 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3522/7027] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:59.363028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3506/7028] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:20:59 2021] DELETE /identity/v3/groups/063abe0a4e3442c3a29719644060e446 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:59.367262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.367422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.379634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a153c-4b15-4292-8d2f-931815f66efd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.379889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bbe4-2747-4237-9c7f-9de0f1e75a73 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.384641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.384796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.385398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.385678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.385803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.385971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/users/36f51386ae7444c09c41bb74f6ad1fcd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.386074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.386224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.387222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.389205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.394554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_user(user_id=36f51386ae7444c09c41bb74f6ad1fcd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.396379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.414928 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find user: 36f51386ae7444c09c41bb74f6ad1fcd.: keystone.exception.UserNotFound: Could not find user: 36f51386ae7444c09c41bb74f6ad1fcd. Nov 10 04:20:59.417181 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3523/7029] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:20:59 2021] DELETE /identity/v3/users/36f51386ae7444c09c41bb74f6ad1fcd => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:59.421193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.424920 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3507/7030] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:20:59 2021] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:59.425981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.432327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c39e1-8e11-48d9-856d-a6321d0e7563 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.495942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfddae-e16c-450c-b1ec-8f73ef8d44a8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.501131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.501961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.502120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.502252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.502526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/13b17e280ad647f083f8c5096a862536` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.503020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.503490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.504023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.504854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.506907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.513686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:20:59.523580 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find domain: 13b17e280ad647f083f8c5096a862536.: keystone.exception.DomainNotFound: Could not find domain: 13b17e280ad647f083f8c5096a862536. Nov 10 04:20:59.529292 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3524/7031] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:59 2021] PATCH /identity/v3/domains/13b17e280ad647f083f8c5096a862536 => generated 112 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:59.530192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.541782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a2269-f443-4261-8c37-0396dc5596c1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.546646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.547312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.547598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.547912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.548655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.550276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.558655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3508/7032] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:20:59 2021] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:20:59.561733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.569684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3525/7033] 10.222.0.13 () {58 vars in 1127 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/domains => generated 1347 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:59.571307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.576088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71ae2a-7939-4f0d-9918-0d7aaa5b8526 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.582283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.582936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.583223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.583498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.584241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876476d-91ae-4ebf-8882-4bbd018b6def tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.584373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.585865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.590349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.591072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.591360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.591640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.592379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:59.592716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.594590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.598055 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3509/7034] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:59.603026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.615576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3526/7035] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:20:59.621392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.622103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509647-209a-4fc2-b4ca-396d80466e34 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.627564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.629080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.629608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.630872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.630872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.632392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.633552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b55a-3b0c-43c2-8b95-f1a3fb3f32de tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.642317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.642989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.643274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.643558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.644287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-944186757) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:20:59.644594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.645523 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3510/7036] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:20:59.646203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.649527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.658340 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3527/7037] 10.222.0.13 () {58 vars in 1196 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/domains?name=tempest-test_domain-944186757 => generated 407 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:20:59.659543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4334f1c-611c-4533-aeb9-4dc6bd4f9463 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.662958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.667020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.667920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.668201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.668476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] PATH_INFO: `/v3/projects/f813ea80b57c4adeb2a4c5c0c7866ff2/users/0560155ce3fa4092900d08c639ec9733/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.673470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6687-1edc-424f-85df-d077eb8adeea tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.678322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.679171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.679458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.679742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/13b17e280ad647f083f8c5096a862536` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.684142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f813ea80b57c4adeb2a4c5c0c7866ff2, user_id=0560155ce3fa4092900d08c639ec9733, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.686795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:20:59.686950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35390f64-584a-4013-bfbb-fb9e409df27f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.696526 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Could not find domain: 13b17e280ad647f083f8c5096a862536.: keystone.exception.DomainNotFound: Could not find domain: 13b17e280ad647f083f8c5096a862536. Nov 10 04:20:59.698097 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3528/7038] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:59 2021] PATCH /identity/v3/domains/13b17e280ad647f083f8c5096a862536 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:20:59.701719 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3511/7039] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:20:59 2021] PUT /identity/v3/projects/f813ea80b57c4adeb2a4c5c0c7866ff2/users/0560155ce3fa4092900d08c639ec9733/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:20:59.701867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.713101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.713386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.713651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.713975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3074f6-0213-438b-aa84-15df26a9637c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.741451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] MFA Rules not processed for user `0560155ce3fa4092900d08c639ec9733`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:20:59.742664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.778108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.778972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.779257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.779543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/8ee1fe5f556c42f9801a43c000fe1685` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.791045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8ee1fe5f556c42f9801a43c000fe1685)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.793265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.834480 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3512/7040] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:20:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:20:59.850525 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3529/7041] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:20:59 2021] PATCH /identity/v3/domains/8ee1fe5f556c42f9801a43c000fe1685 => generated 277 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:20:59.851656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.853334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:20:59.855029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:20:59.864422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded23ea1-e949-4535-a1da-673ad882b370 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.869787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.870787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.871153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.871434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/8ee1fe5f556c42f9801a43c000fe1685` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.885168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8ee1fe5f556c42f9801a43c000fe1685)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.886794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.910112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.920939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdafbe-e7b3-408d-abf3-128fecc7bcd5 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:20:59.921173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.926154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:20:59.926806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:20:59.927088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:20:59.927519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:20:59.937748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:20:59.939938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:20:59.950946 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3530/7042] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:20:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:20:59.962786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.968075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.974950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.988430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 8ee1fe5f556c42f9801a43c000fe1685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:20:59.988951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.989666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:20:59.998511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.002624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.003422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8ee1fe5f556c42f9801a43c000fe1685', 'request_id': 'req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.009507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3513/7043] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:20:59 2021] DELETE /identity/v3/domains/8ee1fe5f556c42f9801a43c000fe1685 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:00.013586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.024872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16642-7bb9-4609-a50c-1a8e9193b36b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.080345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.081234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.081632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.081913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/ca94f11dd2b949f18bcefb6af2212373` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.096717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ca94f11dd2b949f18bcefb6af2212373)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.098383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.117858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.118476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.147922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.148746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.154208 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3531/7044] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:21:00 2021] PATCH /identity/v3/domains/ca94f11dd2b949f18bcefb6af2212373 => generated 277 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:00.155427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.157814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.170649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c3100-d5a1-44aa-9ea2-5a802c7cc603 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.232439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.233460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.233746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.234024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/ca94f11dd2b949f18bcefb6af2212373` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.245384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ca94f11dd2b949f18bcefb6af2212373)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.247010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.269581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.280445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.318196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.326298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.335605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.351620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project ca94f11dd2b949f18bcefb6af2212373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:00.352401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.353085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.360879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.364076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.364933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ca94f11dd2b949f18bcefb6af2212373', 'request_id': 'req-488658b1-f563-40e8-af8f-d2bfd974dd40'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.371270 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3514/7045] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:00 2021] DELETE /identity/v3/domains/ca94f11dd2b949f18bcefb6af2212373 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:00.375050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.377361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.389694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fde20-fb2f-43a4-96dd-fff7c20a57a1 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.440553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.442351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.451287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.452158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.452445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.452762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/0110dfa54bc744ef8990c34b09bbead3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.465890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0110dfa54bc744ef8990c34b09bbead3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.467856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.490088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.490829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.517671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488658b1-f563-40e8-af8f-d2bfd974dd40 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.517889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.519318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.525412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3532/7046] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:21:00 2021] PATCH /identity/v3/domains/0110dfa54bc744ef8990c34b09bbead3 => generated 277 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:00.529173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.530470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.598238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cad12-58f3-40ed-924d-d880b6f1a32c tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.600375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.601424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.601712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.601987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] PATH_INFO: `/v3/users/41dff46cd67746848d8da58bffc9db7b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.603338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dff46cd67746848d8da58bffc9db7b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.603811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a191efa18c4447378a985930215eceac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e87aef57624035b0554b3bc0f36362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.604785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.605143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.605330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.605536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] PATH_INFO: `/v3/domains/0110dfa54bc744ef8990c34b09bbead3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.617593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0110dfa54bc744ef8990c34b09bbead3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.619441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.648539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.652766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.667732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dff46cd67746848d8da58bffc9db7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.677808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dff46cd67746848d8da58bffc9db7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.679023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dff46cd67746848d8da58bffc9db7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.679738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dff46cd67746848d8da58bffc9db7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.688033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2315754e-834b-4615-96ed-0a03423c7fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dff46cd67746848d8da58bffc9db7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.703389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.707607 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3515/7047] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:00 2021] DELETE /identity/v3/users/41dff46cd67746848d8da58bffc9db7b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:00.710555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.712062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.712417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.712797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.717319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.730834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:00.732080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.733189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] The token cache is being invalidate because project 0110dfa54bc744ef8990c34b09bbead3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:00.733560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.734326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.742894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.746509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.747231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0110dfa54bc744ef8990c34b09bbead3', 'request_id': 'req-18fa5012-6b49-4894-b613-a71416c202a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.753018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3533/7048] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:00 2021] DELETE /identity/v3/domains/0110dfa54bc744ef8990c34b09bbead3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:00.757430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.758980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.812395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3516/7049] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:00.822543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:00.823914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:00.836535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5012-6b49-4894-b613-a71416c202a4 tempest-DomainsTestJSON-954724306 tempest-DomainsTestJSON-954724306-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.841711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.842587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.842868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.843149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] PATH_INFO: `/v3/users/9b354367c4804690bbcc541b5b5255ce` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.844467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b354367c4804690bbcc541b5b5255ce)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.847636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.887615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382debc-b04d-4460-90c4-6ba565c598bd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:00.891362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:00.893119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.893119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.893119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.899127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b354367c4804690bbcc541b5b5255ce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.903218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:00.904731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea18a70-41cc-4999-9776-514096001ad1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:00.906684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b354367c4804690bbcc541b5b5255ce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.908810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b354367c4804690bbcc541b5b5255ce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.916223 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3517/7050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:00.922132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b354367c4804690bbcc541b5b5255ce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.930664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b354367c4804690bbcc541b5b5255ce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:00.940768 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3534/7051] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:00 2021] DELETE /identity/v3/users/9b354367c4804690bbcc541b5b5255ce => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:00.942568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:00.943117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:00.943516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:00.964546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:00.967315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.057141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3518/7052] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:01.075702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.081724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.182542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6eb14-580f-498f-a385-a22ad5654833 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:01.189133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:01.189840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.190216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.190497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.221965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:01.223631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:01.237774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.240062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.253034 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3535/7053] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:01.262272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459009-f53d-4013-80d0-2bac45cf1f46 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:01.268100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:01.270179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.270976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.271486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] PATH_INFO: `/v3/projects/53cb324db4544be1927edf51212d567f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.272998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cb324db4544be1927edf51212d567f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:01.275214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:01.343085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cb324db4544be1927edf51212d567f', 'request_id': 'req-2e1d7022-02b9-4247-ae85-98d2281381ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.348989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cb324db4544be1927edf51212d567f', 'request_id': 'req-2e1d7022-02b9-4247-ae85-98d2281381ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.355280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cb324db4544be1927edf51212d567f', 'request_id': 'req-2e1d7022-02b9-4247-ae85-98d2281381ee'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.368689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] The token cache is being invalidate because project 53cb324db4544be1927edf51212d567f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:01.369048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.369758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.372086 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3519/7054] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:01 2021] DELETE /identity/v3/projects/53cb324db4544be1927edf51212d567f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:01.376742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.386625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e517-73d3-4083-b4b5-4b4b1330c718 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:01.446167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:01.446949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.447229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.447501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] PATH_INFO: `/v3/users/0db155b701144fadbda8409abb7bce93` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.449031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db155b701144fadbda8409abb7bce93)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:01.450653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:01.498153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db155b701144fadbda8409abb7bce93'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.506180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db155b701144fadbda8409abb7bce93'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.507010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db155b701144fadbda8409abb7bce93'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.523214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db155b701144fadbda8409abb7bce93'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.531785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db155b701144fadbda8409abb7bce93'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.538288 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3536/7055] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:01 2021] DELETE /identity/v3/users/0db155b701144fadbda8409abb7bce93 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:01.739844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.741343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.757833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d7022-02b9-4247-ae85-98d2281381ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:01.833250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.833642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:01.834499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.834655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.834843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.835089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] PATH_INFO: `/v3/projects/4c31e6e373284702a5466635e176d6de` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.836741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c31e6e373284702a5466635e176d6de)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:01.838823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:01.854120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce4e8c-2f1a-43df-9d7c-db5fa7c84b50 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:01.859578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:01.860996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.861462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.861927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] PATH_INFO: `/v3/projects/9462515b9fcd48f5b6be24499a604195` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.863332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9462515b9fcd48f5b6be24499a604195)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:01.865456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:01.891757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c31e6e373284702a5466635e176d6de', 'request_id': 'req-80971774-a625-47e0-94f4-2cde77412b57'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.898288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c31e6e373284702a5466635e176d6de', 'request_id': 'req-80971774-a625-47e0-94f4-2cde77412b57'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.904662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c31e6e373284702a5466635e176d6de', 'request_id': 'req-80971774-a625-47e0-94f4-2cde77412b57'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.920865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] The token cache is being invalidate because project 4c31e6e373284702a5466635e176d6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:01.921074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.921738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.922390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9462515b9fcd48f5b6be24499a604195', 'request_id': 'req-143ded75-211f-4966-81a9-d38f7447d7d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.924253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3520/7056] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:01 2021] DELETE /identity/v3/projects/4c31e6e373284702a5466635e176d6de => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:01.927861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:01.929171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9462515b9fcd48f5b6be24499a604195', 'request_id': 'req-143ded75-211f-4966-81a9-d38f7447d7d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.929390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:01.935465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9462515b9fcd48f5b6be24499a604195', 'request_id': 'req-143ded75-211f-4966-81a9-d38f7447d7d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.949184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] The token cache is being invalidate because project 9462515b9fcd48f5b6be24499a604195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:01.949590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.950317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-143ded75-211f-4966-81a9-d38f7447d7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:01.952120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3537/7057] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:01 2021] DELETE /identity/v3/projects/9462515b9fcd48f5b6be24499a604195 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:01.957926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b61c-4bf1-47a3-b8a3-27cbcb7c7d0d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:01.958303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b61c-4bf1-47a3-b8a3-27cbcb7c7d0d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:01.958680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b61c-4bf1-47a3-b8a3-27cbcb7c7d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:01.977647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d2d6b61c-4bf1-47a3-b8a3-27cbcb7c7d0d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:01.979041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d2d6b61c-4bf1-47a3-b8a3-27cbcb7c7d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.023797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971774-a625-47e0-94f4-2cde77412b57 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.045507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3538/7058] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:02.053791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.054278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.054873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.077310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:02.079348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.091633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.093193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.093504 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3539/7059] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:02.093645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.093910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] PATH_INFO: `/v3/users/a191efa18c4447378a985930215eceac` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.095739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a191efa18c4447378a985930215eceac)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.097698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.098333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.107662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c80da-fc9f-4371-9ddf-31357ad46f92 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.113667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.114363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.114642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.114908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.115668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:02.115965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.117586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.130369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3540/7060] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:21:02.134903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.145784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16243872-c177-4c32-921c-c7655654abd8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.150948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.151602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.151878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.152149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.152939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.155032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.158813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a191efa18c4447378a985930215eceac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.166839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a191efa18c4447378a985930215eceac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.167724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a191efa18c4447378a985930215eceac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.168813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a191efa18c4447378a985930215eceac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.182329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a191efa18c4447378a985930215eceac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.191869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3541/7061] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:02 2021] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:02.195896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.198068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.206998 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3521/7062] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:01 2021] DELETE /identity/v3/users/a191efa18c4447378a985930215eceac => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:02.270327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438569-1d57-4282-a1ce-ce6163853be5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.338141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.339158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.339661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.340127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.341105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.343239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.371809 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3542/7063] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:02 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:02.374259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.387375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece068f8-88b7-42ec-a625-71dcda36da84 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.393221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.393830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.394112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.394386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.395150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.396828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.407172 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3522/7064] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:02.411653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.421816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b334-b9c5-41ab-93b4-1928bdf29217 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.426562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.427240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.427514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.427783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.428547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.430161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34602bd-7ae7-47fa-ac3c-d45e2d9003bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.440144 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3543/7065] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:02.444232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.455018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287591-45ba-405f-a9b8-4a4578650262 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.459690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.460651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.460877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.461151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] PATH_INFO: `/v3/projects/d8772bee90024dd8b3df501ef5780676/users/a4b866ace75747dd826be1940831944b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.476482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8772bee90024dd8b3df501ef5780676, user_id=a4b866ace75747dd826be1940831944b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.479126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.493119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3523/7066] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:02 2021] PUT /identity/v3/projects/d8772bee90024dd8b3df501ef5780676/users/a4b866ace75747dd826be1940831944b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:02.502977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.503278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.503535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.530743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] MFA Rules not processed for user `a4b866ace75747dd826be1940831944b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:02.532173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.599304 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3544/7067] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:02.611271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.613414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.673401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0226ce-3f7d-4685-9024-19aab30d3128 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.678524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.679286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.679640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.679994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.689787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.691272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:02.691700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2961b4-505a-497e-bd47-81c1ed209581 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.693357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:02.706022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3524/7068] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:02.793603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25717516-718f-4c3c-8cea-74d6b0c939b0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:02.801077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:02.804106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.804106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.804106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] PATH_INFO: `/v3/projects/77e87aef57624035b0554b3bc0f36362` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.805157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e87aef57624035b0554b3bc0f36362)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:02.808524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:02.886249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e87aef57624035b0554b3bc0f36362', 'request_id': 'req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.895764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e87aef57624035b0554b3bc0f36362', 'request_id': 'req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.905136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e87aef57624035b0554b3bc0f36362', 'request_id': 'req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.938727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] The token cache is being invalidate because project 77e87aef57624035b0554b3bc0f36362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:02.939523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.942842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c1c9d5f4-0a20-4b58-ab68-a37f259927a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:02.946868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3545/7069] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:02 2021] DELETE /identity/v3/projects/77e87aef57624035b0554b3bc0f36362 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:02.953508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:02.953687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:02.954019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:02.980400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:02.982155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.114402 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3525/7070] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:03.122334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.122627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.123007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.144915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:03.148572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.156850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3546/7071] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:03.160482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.173986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5cdb-87a2-4768-b0e1-6951ff2e0cff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.182484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.183433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.184146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.184648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.185773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:03.186142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.187898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.244950 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3526/7072] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:03.248976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.262616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569645-45ba-410e-a9f6-6848f5a0da27 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.268851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.269705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.269903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.270268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.274264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.275462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.312657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3547/7073] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:03.317909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.333429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a483c-34b2-4011-87cd-c741df46fe57 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.418574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.419732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.420071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.420353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.421434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.424343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.441356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.442370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.453951 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3527/7074] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:03.458905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.461903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f372-1dc1-4954-a316-1e27aab38a62 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.466742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.468241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.468435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.469371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] PATH_INFO: `/v3/users/a4b866ace75747dd826be1940831944b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.473574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3e16-45b0-47e1-b3d3-14f9c4438317 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.473963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b866ace75747dd826be1940831944b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.475880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.480251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.481207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.481610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.482030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.482744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.484464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.498586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3528/7075] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:03 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:03.502542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.517863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12e6e-45d8-4c26-a25c-82141d725cc1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.523232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.523897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.524180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.524461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.525232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.526857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.544162 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3529/7076] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:03 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:03.548805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.556291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b866ace75747dd826be1940831944b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:03.563125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b696-9456-4d87-854b-145cacfd0a3a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.565267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b866ace75747dd826be1940831944b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:03.565982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b866ace75747dd826be1940831944b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:03.569897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.570924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.571804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.572036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] PATH_INFO: `/v3/projects/1d5828c524054671996015f90e2bb0a2/users/8a79aca3b19f4208b1efa186478c8e26/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.579751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b866ace75747dd826be1940831944b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:03.589248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-92adfb89-0e93-498d-825d-8dd88e0a0dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b866ace75747dd826be1940831944b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:03.590472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5828c524054671996015f90e2bb0a2, user_id=8a79aca3b19f4208b1efa186478c8e26, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.595094 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fee06-271b-4c4a-85c1-756538760cde admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.600007 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3548/7077] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:03 2021] DELETE /identity/v3/users/a4b866ace75747dd826be1940831944b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:03.605347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.606050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.606592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.613209 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3530/7078] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:03 2021] PUT /identity/v3/projects/1d5828c524054671996015f90e2bb0a2/users/8a79aca3b19f4208b1efa186478c8e26/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:03.623810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.624082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.624293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.626486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:03.627818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.651048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] MFA Rules not processed for user `8a79aca3b19f4208b1efa186478c8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:03.652250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.695252 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3549/7079] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:03.705106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.706584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.725101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3531/7080] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:03.729457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.731104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:03.745348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f14ee-7a8f-44bb-9195-004ae992ec6c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.750205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.750921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.751203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.751621 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.752342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.754253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.771892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda1da-d2ba-4a40-9a86-dc9117224592 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.776141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.777093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.777492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.777926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.788349 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3532/7081] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:03.789682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.791671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.793193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.807889 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3550/7082] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:03.869722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7fae-ed54-43c1-a3e7-20dd627f12dc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.874878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.876359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.876359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.876589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.877452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.879458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.903180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3533/7083] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:03 2021] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:03.906197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.918549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbc3a-a5b3-4102-9d33-0c6b94cff77f service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.924162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.925202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.925489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.925760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.926557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.928138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:03.938644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3551/7084] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:03.942807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:03.953407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b49-07e4-47a1-8110-d89f73696453 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:03.958842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:03.959746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:03.960025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:03.960303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] PATH_INFO: `/v3/projects/a56e4d8f8e7349978703e2e4ac39793c/users/1569187ad8a64ffb9bfd283aebec940c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:03.981595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56e4d8f8e7349978703e2e4ac39793c, user_id=1569187ad8a64ffb9bfd283aebec940c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:03.984260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.002027 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3534/7085] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:03 2021] PUT /identity/v3/projects/a56e4d8f8e7349978703e2e4ac39793c/users/1569187ad8a64ffb9bfd283aebec940c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:04.005810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.018283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cda1-491f-48c2-b4db-59ffe6adc9f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.083500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.084319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.084713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.085300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.086292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.088354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.103206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.105357 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3552/7086] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:04.108551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.109790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.123347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca3f44-fb43-442a-985f-9949b3860806 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.129171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.130077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.130354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.131122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] PATH_INFO: `/v3/projects/a56e4d8f8e7349978703e2e4ac39793c/users/1569187ad8a64ffb9bfd283aebec940c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.135138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56e4d8f8e7349978703e2e4ac39793c, user_id=1569187ad8a64ffb9bfd283aebec940c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.135276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863698e-af64-44a3-bc76-171ebb533571 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.138376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968f27-3f98-4192-b57c-254d026c0dc4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.140817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.142291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.142619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.143144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] PATH_INFO: `/v3/projects/d8772bee90024dd8b3df501ef5780676` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.144542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8772bee90024dd8b3df501ef5780676)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.146600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.152691 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3553/7087] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:04 2021] PUT /identity/v3/projects/a56e4d8f8e7349978703e2e4ac39793c/users/1569187ad8a64ffb9bfd283aebec940c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:04.162870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.163294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.163677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.195998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] MFA Rules not processed for user `1569187ad8a64ffb9bfd283aebec940c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:04.196392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8772bee90024dd8b3df501ef5780676', 'request_id': 'req-8421569d-c161-4515-a120-a3a87dbb0d4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.197501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.202089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8772bee90024dd8b3df501ef5780676', 'request_id': 'req-8421569d-c161-4515-a120-a3a87dbb0d4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.209544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8772bee90024dd8b3df501ef5780676', 'request_id': 'req-8421569d-c161-4515-a120-a3a87dbb0d4b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.226219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] The token cache is being invalidate because project d8772bee90024dd8b3df501ef5780676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:04.226559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.227292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8421569d-c161-4515-a120-a3a87dbb0d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.228985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3535/7088] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:04 2021] DELETE /identity/v3/projects/d8772bee90024dd8b3df501ef5780676 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:04.234872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985a32-9711-4d51-ad99-fa768e036a02 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.235221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985a32-9711-4d51-ad99-fa768e036a02 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.235591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985a32-9711-4d51-ad99-fa768e036a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.255833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9f985a32-9711-4d51-ad99-fa768e036a02 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:04.257188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9f985a32-9711-4d51-ad99-fa768e036a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.278151 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3554/7089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:04.283589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.292833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866966-9c51-4e2b-ae29-64648a32321a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.300389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.301981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.302270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.302549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.303387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.305276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.333126 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3555/7090] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/services => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:04.334204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.357417 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3536/7091] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/auth/tokens => generated 3361 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:04.359379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.361081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.361542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.362112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6106d-b4a2-4f36-ae0d-eacc95ce524e tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.368018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.369087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.369374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.369649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.370404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.372152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.377393 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 10 04:21:04.377393 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'type' in schema['properties']['enabled']: Nov 10 04:21:04.377393 ncdv-817176-1 devstack@keystone.service[96285]: {'enum': [True, False, None], 'type': 'boolean'} Nov 10 04:21:04.377393 ncdv-817176-1 devstack@keystone.service[96285]: On instance['enabled']: Nov 10 04:21:04.377393 ncdv-817176-1 devstack@keystone.service[96285]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 10 04:21:04.379129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3556/7092] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/endpoints => generated 283 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 10 04:21:04.383402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:04.383402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.384452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.394590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3537/7093] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/auth/tokens => generated 3361 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:04.398660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.401002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549f95-79ec-44bc-88b9-6cf4cc647b5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.407719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.408242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.408529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.408952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.409355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952ed6-3bcd-4e2f-91d2-bc425347e5ea None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.409711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.411424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.415336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.416092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.416468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.416859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.417066 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 10 04:21:04.417066 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'type' in schema['properties']['enabled']: Nov 10 04:21:04.417066 ncdv-817176-1 devstack@keystone.service[96285]: {'enum': [True, False, None], 'type': 'boolean'} Nov 10 04:21:04.417066 ncdv-817176-1 devstack@keystone.service[96285]: On instance['enabled']: Nov 10 04:21:04.417066 ncdv-817176-1 devstack@keystone.service[96285]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 10 04:21:04.418074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:04.422342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.423595 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3557/7094] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/endpoints => generated 281 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 10 04:21:04.423704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.423816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.437305 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3538/7095] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:04.437504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa6625-0cc8-40c7-a42f-a71d3a14fd91 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.439141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.441336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.441929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.442212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.442545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.443296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.444984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.450199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ef36-ee1d-4957-b195-8aa55aa2696f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.455887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.456528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.456852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.457127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.457825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.460282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.468087 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1272597956. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:04.468087 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:04.468087 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:04.496907 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3539/7096] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:04.498687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.509674 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3558/7097] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/endpoints => generated 360 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:04.515692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.544942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968da77-5c6a-4d24-966a-4f2d48490c2c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.603728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae091c-b44d-40f9-a08d-7a3351e15bee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.616438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.617489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.617647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.618145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/regions/tempest-region-1272597956` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.619100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1272597956)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.620264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.621799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.622528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.622874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.623203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.623968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.624804 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3559/7098] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/regions/tempest-region-1272597956 => generated 180 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:04.625998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.626880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.638212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafa65b-7903-4fa3-a4b6-5ad0fe688a5a tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.644296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.645309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.645586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.645854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints/8651a25b4817497ebab10237e66965c7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.647524 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3540/7099] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:04.651949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.652761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8651a25b4817497ebab10237e66965c7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.654516 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:04.654516 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:21:04.654516 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:04.655636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.662868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b152714-96ff-4b25-bcf4-675992c67774 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.665943 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 10 04:21:04.665943 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'type' in schema['properties']['enabled']: Nov 10 04:21:04.665943 ncdv-817176-1 devstack@keystone.service[96285]: {'enum': [True, False, None], 'type': 'boolean'} Nov 10 04:21:04.665943 ncdv-817176-1 devstack@keystone.service[96285]: On instance['enabled']: Nov 10 04:21:04.665943 ncdv-817176-1 devstack@keystone.service[96285]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 10 04:21:04.670874 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3560/7100] 10.222.0.13 () {60 vars in 1254 bytes} [Wed Nov 10 04:21:04 2021] PATCH /identity/v3/endpoints/8651a25b4817497ebab10237e66965c7 => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 04:21:04.671636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.672214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.672356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.672698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.673093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.673760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.675530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.683118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487962e-5d74-4254-ba17-a4e9649534a1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.689912 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3541/7101] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:04.690928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.691816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.692829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.693900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.693900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints/8651a25b4817497ebab10237e66965c7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.694964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8651a25b4817497ebab10237e66965c7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.696094 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:04.696094 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:21:04.696094 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:04.697241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.703317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64ace-7879-428b-b7d6-f659eb5ddf98 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.709292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8651a25b4817497ebab10237e66965c7', 'request_id': 'req-b0daea77-0cc5-44cb-a610-b29015485d06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:04.710973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.712161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.712473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.712757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.713506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.715455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.728074 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3561/7102] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:21:04 2021] DELETE /identity/v3/endpoints/8651a25b4817497ebab10237e66965c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:04.728274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3542/7103] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:04.731752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.731900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.743055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658af1-c002-4724-8717-b257094e3a8e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.753372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea77-0cc5-44cb-a610-b29015485d06 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.759444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.760519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.761528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.761528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/regions/tempest-region-1272597956` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.761740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.762267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1272597956)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.762402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.762402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.762643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] PATH_INFO: `/v3/projects/5041706996d042f3899c7e51b4cc38e2/users/85029a148fa74afd93e225fc6c5dc300/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.763019 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:04.763019 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:21:04.763019 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:04.764184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.778932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5041706996d042f3899c7e51b4cc38e2, user_id=85029a148fa74afd93e225fc6c5dc300, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.783587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e16d-795d-4109-b15f-533ef3c5a11d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.793886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3562/7104] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:21:04 2021] DELETE /identity/v3/regions/tempest-region-1272597956 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:04.800206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.805706 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3543/7105] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:04 2021] PUT /identity/v3/projects/5041706996d042f3899c7e51b4cc38e2/users/85029a148fa74afd93e225fc6c5dc300/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:04.816040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.816628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.816928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.832890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13933-c44f-4eeb-b13b-7ecf7f1a200c tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.853730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] MFA Rules not processed for user `85029a148fa74afd93e225fc6c5dc300`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:04.855099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.899663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.900831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.901836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.902598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.903471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.905127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.921670 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-748250292. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:04.921670 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:04.921670 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:04.933202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3544/7106] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/auth/tokens => generated 3386 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:04.944352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.945687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:04.949013 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3563/7107] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:04 2021] POST /identity/v3/endpoints => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:04.954260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:04.975435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108e07-168a-4631-9700-8b922f47c672 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:04.980450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:04.981517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:04.981803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:04.982079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/regions/tempest-region-748250292` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:04.982746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-748250292)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:04.983827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:04.986772 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3564/7108] 10.222.0.13 () {58 vars in 1202 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/regions/tempest-region-748250292 => generated 178 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:04.990455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.000948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60774-1e7a-4496-b223-27e2ed69cdbc tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.005855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.006689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.007317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.007766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints/d0210cd630a54a7db16e2ad58e25fa87` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.013318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d0210cd630a54a7db16e2ad58e25fa87)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.014912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.023457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111d91c-c097-4553-985f-a62b49273df3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.025082 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 10 04:21:05.025082 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'type' in schema['properties']['enabled']: Nov 10 04:21:05.025082 ncdv-817176-1 devstack@keystone.service[96285]: {'enum': [True, False, None], 'type': 'boolean'} Nov 10 04:21:05.025082 ncdv-817176-1 devstack@keystone.service[96285]: On instance['enabled']: Nov 10 04:21:05.025082 ncdv-817176-1 devstack@keystone.service[96285]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 10 04:21:05.026352 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3565/7109] 10.222.0.13 () {60 vars in 1254 bytes} [Wed Nov 10 04:21:04 2021] PATCH /identity/v3/endpoints/d0210cd630a54a7db16e2ad58e25fa87 => generated 281 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 04:21:05.030279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.041017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8e4de-61f7-487d-a983-081465f30ab1 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.045006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.045715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.045998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.046305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.046424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.047372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.048668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.049055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/endpoints/d0210cd630a54a7db16e2ad58e25fa87` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.050437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d0210cd630a54a7db16e2ad58e25fa87)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.052137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.058206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.060088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.060980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd0210cd630a54a7db16e2ad58e25fa87', 'request_id': 'req-3346dc30-14ef-4f61-af70-2b133ceac5b8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.071452 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3566/7110] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:21:05 2021] DELETE /identity/v3/endpoints/d0210cd630a54a7db16e2ad58e25fa87 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:05.075655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.081898 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3545/7111] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:04 2021] GET /identity/v3/auth/tokens => generated 3386 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:05.097445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346dc30-14ef-4f61-af70-2b133ceac5b8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.102962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.103795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.104080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.104353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/regions/tempest-region-748250292` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.105056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-748250292)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.106788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.130780 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3567/7112] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:21:05 2021] DELETE /identity/v3/regions/tempest-region-748250292 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:05.135919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.147090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33997602-e9b3-4c8f-ab37-f5ef2d8d8609 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.165857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569187ad8a64ffb9bfd283aebec940c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56e4d8f8e7349978703e2e4ac39793c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.167272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.167628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.167978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] PATH_INFO: `/v3/services/e3c7c081635042b4a7a35dcf45192323` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.168762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e3c7c081635042b4a7a35dcf45192323)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.170574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1abf7e-a6c0-4617-b161-89745a4c4c7d tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.197801 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3546/7113] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:05 2021] DELETE /identity/v3/services/e3c7c081635042b4a7a35dcf45192323 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:05.202024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.204158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:05.288113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973c9e-a978-4378-8e11-1dd56eb50ae8 tempest-EndpointsNegativeTestJSON-941650763 tempest-EndpointsNegativeTestJSON-941650763-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.308271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.309504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.309813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.310066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] PATH_INFO: `/v3/users/8a79aca3b19f4208b1efa186478c8e26` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.311872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a79aca3b19f4208b1efa186478c8e26)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.313976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.397514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a79aca3b19f4208b1efa186478c8e26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.410234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a79aca3b19f4208b1efa186478c8e26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.411147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a79aca3b19f4208b1efa186478c8e26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.428417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a79aca3b19f4208b1efa186478c8e26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.440361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a79aca3b19f4208b1efa186478c8e26'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:05.455026 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3568/7114] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:05 2021] DELETE /identity/v3/users/8a79aca3b19f4208b1efa186478c8e26 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:05.460546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.461124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.461768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.497024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:05.499725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:05.591733 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3547/7115] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:05.607239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:05.611717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:05.725479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c0ac-04b7-4ba8-b092-fe3936df7683 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:05.732749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:05.733557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:05.733903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:05.734242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:05.747847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:05.749636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:05.762109 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3569/7116] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:06.334488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:06.335927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:06.364465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7438a-bbc8-4e6b-9421-6c1fb4ee46dc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:06.372194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:06.373871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:06.374604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:06.375069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] PATH_INFO: `/v3/projects/1d5828c524054671996015f90e2bb0a2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:06.378832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5828c524054671996015f90e2bb0a2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:06.381833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:06.461251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5828c524054671996015f90e2bb0a2', 'request_id': 'req-09f8d89a-48a7-4103-ab28-2a605efcb205'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.473657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5828c524054671996015f90e2bb0a2', 'request_id': 'req-09f8d89a-48a7-4103-ab28-2a605efcb205'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.484950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5828c524054671996015f90e2bb0a2', 'request_id': 'req-09f8d89a-48a7-4103-ab28-2a605efcb205'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.501679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] The token cache is being invalidate because project 1d5828c524054671996015f90e2bb0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:06.501965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.502736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.504910 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3548/7117] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:06 2021] DELETE /identity/v3/projects/1d5828c524054671996015f90e2bb0a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:06.509570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:06.521190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6dd3-cce3-4e5a-85ff-7c1f9a52626a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:06.605260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:06.606176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:06.606435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:06.606745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] PATH_INFO: `/v3/users/1569187ad8a64ffb9bfd283aebec940c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:06.609304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1569187ad8a64ffb9bfd283aebec940c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:06.613148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:06.696457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1569187ad8a64ffb9bfd283aebec940c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.714153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1569187ad8a64ffb9bfd283aebec940c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.715090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1569187ad8a64ffb9bfd283aebec940c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.735206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1569187ad8a64ffb9bfd283aebec940c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.750134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-08bb9b71-8395-4cd4-9f55-0ac45234b212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1569187ad8a64ffb9bfd283aebec940c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:06.765199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3570/7118] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:06 2021] DELETE /identity/v3/users/1569187ad8a64ffb9bfd283aebec940c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:07.126971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.129084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:07.155661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d89a-48a7-4103-ab28-2a605efcb205 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.256020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.258599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.258599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.258599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] PATH_INFO: `/v3/projects/a56e4d8f8e7349978703e2e4ac39793c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.262425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56e4d8f8e7349978703e2e4ac39793c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.265887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.340110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56e4d8f8e7349978703e2e4ac39793c', 'request_id': 'req-368aab15-c689-43fc-a59b-a2c48e8fa927'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:07.347911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56e4d8f8e7349978703e2e4ac39793c', 'request_id': 'req-368aab15-c689-43fc-a59b-a2c48e8fa927'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:07.356774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56e4d8f8e7349978703e2e4ac39793c', 'request_id': 'req-368aab15-c689-43fc-a59b-a2c48e8fa927'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:07.374033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] The token cache is being invalidate because project a56e4d8f8e7349978703e2e4ac39793c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:07.374516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:07.375328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-368aab15-c689-43fc-a59b-a2c48e8fa927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:07.378793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3549/7119] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:07 2021] DELETE /identity/v3/projects/a56e4d8f8e7349978703e2e4ac39793c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:07.384982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.385149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.385398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.411507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:07.414347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:07.512655 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3571/7120] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:07.525570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.526095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.526295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.551709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:07.553560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:07.567294 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3550/7121] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:07.572936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.588483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334499-48d6-4722-977d-79ff118ef1b6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.594529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.595915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.596260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.596659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.597577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:07.598891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.599790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.614795 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3572/7122] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:07.620164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.637943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b1f2-a194-4e6b-8a76-abccfaddf11c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.645681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.646555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.647310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.647876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.649044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.651211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.739549 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3551/7123] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:07 2021] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:07.743697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.760095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8cd2c-47f1-4039-b7a4-00d2c65370c6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.862200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.863373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.863821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.864250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.865236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.867297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.892394 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3573/7124] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:07 2021] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:07.898001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.915665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c23b4-8db5-42f2-956b-fb40f468b57c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.921993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.922819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.923099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.923372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.924180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.926159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.939835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3552/7125] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:07.944516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.957331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e5cd-1ce4-447f-afec-983d957ea084 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:07.966013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:07.966884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:07.967175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:07.967530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:07.968365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:07.970391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79fdca-98d5-465b-a2b4-5da7d7290cc1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:07.982048 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3574/7126] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:07.986302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:07.998488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c52ec-fca6-4a84-88d9-9993df3b7132 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.006141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.007549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.007896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.008233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] PATH_INFO: `/v3/projects/8bfc5789ab1944dfa3c1ff784044e606/users/2efc90dffd2b473faea9e5d8d13e919e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.028846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfc5789ab1944dfa3c1ff784044e606, user_id=2efc90dffd2b473faea9e5d8d13e919e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.031770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.048744 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3553/7127] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:07 2021] PUT /identity/v3/projects/8bfc5789ab1944dfa3c1ff784044e606/users/2efc90dffd2b473faea9e5d8d13e919e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:08.059764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.060081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.060342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.089361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] MFA Rules not processed for user `2efc90dffd2b473faea9e5d8d13e919e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:08.090611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:08.185648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3575/7128] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:08 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:08.191614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.292638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847d71-285c-4595-b023-2f0a21bcfa4f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.302794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.303615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.303896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.304168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.305721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.308501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.359303 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3554/7129] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:08 2021] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:08.360518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.377867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3fe9-7856-471a-9f95-bc9cbc49173a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.466910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.467763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.468196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.468644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.470467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.473108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.498569 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3576/7130] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:08 2021] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:08.504989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.516091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4dfa-a670-484b-abb3-6ff6c172bbac admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.527867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.528747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.528885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.529137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.530065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.531992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.556435 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3555/7131] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:08 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:08.561290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.573313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452891-c5f1-423a-bded-7e9d9ae0cad2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.583951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.585248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.585693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.586292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] PATH_INFO: `/v3/projects/a92f03d2585944c0a156a7c0ecc5381a/users/51f4907754244866a32eaec5d8a8feda/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.612890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92f03d2585944c0a156a7c0ecc5381a, user_id=51f4907754244866a32eaec5d8a8feda, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.616243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.640780 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3577/7132] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:08 2021] PUT /identity/v3/projects/a92f03d2585944c0a156a7c0ecc5381a/users/51f4907754244866a32eaec5d8a8feda/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:08.645026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.657753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110481f-1fce-4e98-b233-81fbdba70a5e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.732831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.733900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.734738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.734738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.735581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.737372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d868a7-165f-43d3-99e9-028bd8f89375 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.749394 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3556/7133] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:08 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:08.756331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:08.769129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59fce-7bd6-4080-99a4-c347a9257877 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:08.775588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:08.776152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.776432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.776784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] PATH_INFO: `/v3/projects/a92f03d2585944c0a156a7c0ecc5381a/users/51f4907754244866a32eaec5d8a8feda/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.778936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92f03d2585944c0a156a7c0ecc5381a, user_id=51f4907754244866a32eaec5d8a8feda, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:08.782197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:08.808716 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3578/7134] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:08 2021] PUT /identity/v3/projects/a92f03d2585944c0a156a7c0ecc5381a/users/51f4907754244866a32eaec5d8a8feda/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:08.822690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:08.822988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:08.823257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:08.887671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] MFA Rules not processed for user `51f4907754244866a32eaec5d8a8feda`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:08.889489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:09.032871 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3557/7135] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:08 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:09.037519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.055025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b8c73-4a3b-442c-8c9c-1f85a8b39c4f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.065172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.066022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.066342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.066578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.067323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.068321 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:09.068321 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:21:09.068321 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:09.069335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.102666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3579/7136] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:21:09 2021] POST /identity/v3/regions => generated 224 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:09.103975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.118115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd655-951c-47dd-8093-e3a6500379e1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.136911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.137381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.137675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.137952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.138706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.140420 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:09.140420 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:21:09.140420 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:09.141941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.168876 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3558/7137] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:21:09 2021] POST /identity/v3/regions => generated 224 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:09.173426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.194230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250d9aa-45a5-4d41-9799-14c4f734fed9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.230630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.231781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.232465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.232465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/7fcdfabe-5dea-4f31-a333-0222eabcd094` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.234651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:create_region(region_id=7fcdfabe-5dea-4f31-a333-0222eabcd094)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.236345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.281363 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3580/7138] 10.222.0.13 () {60 vars in 1258 bytes} [Wed Nov 10 04:21:09 2021] PUT /identity/v3/regions/7fcdfabe-5dea-4f31-a333-0222eabcd094 => generated 230 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:09.283705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.302176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37261-f5b2-49cb-bafe-462157297b1c tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.325476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.326500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.327037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.327415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/7fcdfabe-5dea-4f31-a333-0222eabcd094` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.329564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7fcdfabe-5dea-4f31-a333-0222eabcd094)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.330706 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:09.330706 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:21:09.330706 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:09.333998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.371066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3559/7139] 10.222.0.13 () {58 vars in 1241 bytes} [Wed Nov 10 04:21:09 2021] DELETE /identity/v3/regions/7fcdfabe-5dea-4f31-a333-0222eabcd094 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:09.378169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.395779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859ab8-28d4-477b-b3b9-efa55c5a83f3 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.433433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.434115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.436770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.437111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.437914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.441145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.472200 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3581/7140] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:21:09 2021] POST /identity/v3/regions => generated 254 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:09.477748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.495249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3f8d-e8fe-47bd-90df-962d747d5353 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.517681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.518129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.518515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.518913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.519779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:update_region(region_id=f45cb5046ecb4d9e9f7ec179c5e5e5db)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.521128 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:09.521128 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:21:09.521128 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:09.522644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.557844 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3560/7141] 10.222.0.13 () {60 vars in 1249 bytes} [Wed Nov 10 04:21:09 2021] PATCH /identity/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db => generated 254 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:09.561418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.578357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac6e-51c2-40dd-a4d3-7e17b1ce1230 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.607118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.608004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.608333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.609383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.610289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:get_region(region_id=f45cb5046ecb4d9e9f7ec179c5e5e5db)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.612184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.623784 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3582/7142] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:21:09 2021] GET /identity/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db => generated 254 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:09.628034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.682563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614ee0-4a83-4fc9-8fd9-99f6e33dbb1d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.690052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.691446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.692140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.692598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.693479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f45cb5046ecb4d9e9f7ec179c5e5e5db)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.695473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.731949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3561/7143] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:09 2021] DELETE /identity/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:09.737779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.757544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789098-5a41-441e-b901-e4bb4cebc41a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.794178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.800174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.801287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.802199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.803329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.804865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.819792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3583/7144] 10.222.0.13 () {58 vars in 1127 bytes} [Wed Nov 10 04:21:09 2021] GET /identity/v3/regions => generated 670 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:09.824793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.837665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb727-9112-48c9-9d4b-bd5d183507cb tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.855107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.858946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.859517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.861469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.862517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f45cb5046ecb4d9e9f7ec179c5e5e5db)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.866458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.903537 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Could not find region: f45cb5046ecb4d9e9f7ec179c5e5e5db.: keystone.exception.RegionNotFound: Could not find region: f45cb5046ecb4d9e9f7ec179c5e5e5db. Nov 10 04:21:09.906891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3562/7145] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:09 2021] DELETE /identity/v3/regions/f45cb5046ecb4d9e9f7ec179c5e5e5db => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:21:09.914434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.931991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585c648-ce9f-4d49-9510-03ac3eb66995 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:09.943412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:09.944575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:09.945145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:09.945584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:09.946500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:09.947912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:09.967367 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3584/7146] 10.222.0.13 () {58 vars in 1127 bytes} [Wed Nov 10 04:21:09 2021] GET /identity/v3/regions => generated 670 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:09.973564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:09.990666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a4dd-7976-4702-94a8-7ae2043c7d74 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.010215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.010901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.011195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.011507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.012248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.013860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.091567 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3563/7147] 10.222.0.13 () {60 vars in 1149 bytes} [Wed Nov 10 04:21:09 2021] POST /identity/v3/regions => generated 254 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:10.097914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.118659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be126c2-21bb-4552-9cd4-1d8bce734aa9 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.182312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.183945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.185071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.185789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.186913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Adding query filter params (parent_region_id=be5cb026c4c84832852c20f95a30fa67) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:10.187456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.189174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.201154 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3585/7148] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:21:10 2021] GET /identity/v3/regions?parent_region_id=be5cb026c4c84832852c20f95a30fa67 => generated 400 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:10.207508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.230921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f791-1624-4432-bd07-1a2c9181a9d1 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.237886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.239058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.239524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.239978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/e1aa20408c0e47dfbbd3c60e0bf6ba33` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.241078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e1aa20408c0e47dfbbd3c60e0bf6ba33)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.244158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.293456 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3564/7149] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:10 2021] DELETE /identity/v3/regions/e1aa20408c0e47dfbbd3c60e0bf6ba33 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:10.299531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.311424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95cfc-77be-4afe-a26a-5d27a467479a tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.350257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.351136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.351419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.351693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/40eb36a2ecbd49f7aacdb4972fea54ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.352456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=40eb36a2ecbd49f7aacdb4972fea54ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.354434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.393377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3586/7150] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:10 2021] DELETE /identity/v3/regions/40eb36a2ecbd49f7aacdb4972fea54ba => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:10.396810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.409430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f759b-c5c3-47ca-bb3d-267c6ceb3a3d tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.436994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f4907754244866a32eaec5d8a8feda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92f03d2585944c0a156a7c0ecc5381a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.437991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.438357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.438633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] PATH_INFO: `/v3/regions/be5cb026c4c84832852c20f95a30fa67` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.439305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorizing `identity:delete_region(region_id=be5cb026c4c84832852c20f95a30fa67)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.446319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1712a45-92b1-4895-a0c0-bab36b0b5039 tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.477264 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3565/7151] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:21:10 2021] DELETE /identity/v3/regions/be5cb026c4c84832852c20f95a30fa67 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:10.483009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.592481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f7418-4325-4f6a-8c18-7a6aecfef67b tempest-RegionsTestJSON-197944181 tempest-RegionsTestJSON-197944181-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.611808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.612845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.613392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.613858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] PATH_INFO: `/v3/users/2efc90dffd2b473faea9e5d8d13e919e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.615531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efc90dffd2b473faea9e5d8d13e919e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.617456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:10.704084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efc90dffd2b473faea9e5d8d13e919e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:10.715142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efc90dffd2b473faea9e5d8d13e919e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:10.716175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efc90dffd2b473faea9e5d8d13e919e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:10.732304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efc90dffd2b473faea9e5d8d13e919e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:10.745915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efc90dffd2b473faea9e5d8d13e919e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:10.755287 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3587/7152] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:10 2021] DELETE /identity/v3/users/2efc90dffd2b473faea9e5d8d13e919e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:10.760915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.761858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.762853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.784840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:10.785998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:10.870761 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3566/7153] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:10.885617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:10.887330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:10.970094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3aef-5c72-4d2f-926b-625a2d325b30 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:10.979083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:10.980130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:10.981259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:10.983224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:10.997383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:10.999169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:11.015844 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3588/7154] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:12.150031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:12.152128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:12.213971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a74a-6fb3-4dc0-b49d-e63b8f61abf4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:12.221927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:12.223660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:12.223961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:12.224228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] PATH_INFO: `/v3/projects/8bfc5789ab1944dfa3c1ff784044e606` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:12.225854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfc5789ab1944dfa3c1ff784044e606)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:12.228837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:12.312696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfc5789ab1944dfa3c1ff784044e606', 'request_id': 'req-6bee8af5-afe4-431c-9802-0cf94ebf7852'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.323747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfc5789ab1944dfa3c1ff784044e606', 'request_id': 'req-6bee8af5-afe4-431c-9802-0cf94ebf7852'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.336776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfc5789ab1944dfa3c1ff784044e606', 'request_id': 'req-6bee8af5-afe4-431c-9802-0cf94ebf7852'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.366208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] The token cache is being invalidate because project 8bfc5789ab1944dfa3c1ff784044e606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:12.366498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.367279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.370573 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3567/7155] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:12 2021] DELETE /identity/v3/projects/8bfc5789ab1944dfa3c1ff784044e606 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:12.374552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:12.393301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916983a5-7894-46ae-8476-9ef45d34bfec service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:12.493834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:12.495366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:12.495874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:12.496383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] PATH_INFO: `/v3/users/51f4907754244866a32eaec5d8a8feda` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:12.497961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f4907754244866a32eaec5d8a8feda)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:12.501343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:12.570751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f4907754244866a32eaec5d8a8feda'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.582312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f4907754244866a32eaec5d8a8feda'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.583303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f4907754244866a32eaec5d8a8feda'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.605562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f4907754244866a32eaec5d8a8feda'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.615248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b32af91c-1644-45a8-b888-7acfcd6ff67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f4907754244866a32eaec5d8a8feda'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:12.624298 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3589/7156] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:12 2021] DELETE /identity/v3/users/51f4907754244866a32eaec5d8a8feda => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:13.343971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:13.345546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:13.369459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8af5-afe4-431c-9802-0cf94ebf7852 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:13.511674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:13.513419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:13.513419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:13.513922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] PATH_INFO: `/v3/projects/a92f03d2585944c0a156a7c0ecc5381a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:13.515530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92f03d2585944c0a156a7c0ecc5381a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:13.525022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:13.637123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92f03d2585944c0a156a7c0ecc5381a', 'request_id': 'req-48c46f46-08a1-4ef2-836e-fb09551d94df'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:13.648197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92f03d2585944c0a156a7c0ecc5381a', 'request_id': 'req-48c46f46-08a1-4ef2-836e-fb09551d94df'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:13.658343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92f03d2585944c0a156a7c0ecc5381a', 'request_id': 'req-48c46f46-08a1-4ef2-836e-fb09551d94df'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:13.686538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] The token cache is being invalidate because project a92f03d2585944c0a156a7c0ecc5381a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:13.687115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:13.690051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48c46f46-08a1-4ef2-836e-fb09551d94df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:13.695730 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3568/7157] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:13 2021] DELETE /identity/v3/projects/a92f03d2585944c0a156a7c0ecc5381a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:13.701501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:13.702030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:13.702030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:13.721982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:13.723500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:13.815956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:13.816593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:13.817046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:13.818977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3590/7158] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:13.844311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:13.847467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:13.865297 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3569/7159] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:13.869478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:13.886144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a5b2-da3d-4b76-b5bb-3a49b07b708a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:13.897568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:13.899368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:13.899992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:13.900651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:13.902893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:13.903586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:13.906464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:13.927409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3591/7160] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:21:13.933741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:13.950403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254629dd-650a-4e07-965d-52fa0a10e64c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:13.966421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:13.967280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:13.967715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:13.968149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:13.969956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:13.972914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.020549 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3570/7161] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:13 2021] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:14.025120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.038151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a9353-cf7e-4575-b676-68a494b88e55 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.146732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.147589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.148231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.148556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.149450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.151783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.180400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3592/7162] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:14 2021] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:14.184822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.199899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b773-48d1-423e-b001-263262e8953f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.209013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.210265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.210831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.211521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.213030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.215061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.232115 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3571/7163] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:14 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:14.236912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.252913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9df2-083c-491d-a4e7-82f7ba91fe51 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.258439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.259120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.259423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.259730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.260844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.262658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5fb8-2972-46ad-b66c-ef5aeae38cd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.274506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3593/7164] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:14 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:14.279571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.299659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52e9a6-0d26-4eba-8e34-2b4871060d81 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.306665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.307985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.308501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.308960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] PATH_INFO: `/v3/projects/30903e13a5f044239b1ca8854058cfc7/users/aa1b7f7ba3894b00abb8a9fb4cd5f9be/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.350099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30903e13a5f044239b1ca8854058cfc7, user_id=aa1b7f7ba3894b00abb8a9fb4cd5f9be, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.352926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.375592 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3572/7165] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:14 2021] PUT /identity/v3/projects/30903e13a5f044239b1ca8854058cfc7/users/aa1b7f7ba3894b00abb8a9fb4cd5f9be/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:14.385649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.385875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.386304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.436178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] MFA Rules not processed for user `aa1b7f7ba3894b00abb8a9fb4cd5f9be`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:14.437743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:14.530770 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3594/7166] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:14 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:14.536907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.658781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc92ff3-2f97-42dc-a1de-55b23479324b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.665438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.666608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.666774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.666963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.669107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.671795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.715474 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3573/7167] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:14 2021] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:14.716900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.753206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4b8b-bd57-4c2c-b197-c8652a1d448d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.847013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.848864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.849353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.849840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.851225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.853908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.898633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3595/7168] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:14 2021] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:14.899934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.915562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3232af-2115-4679-a4a0-75cefd3da956 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.921954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.924738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.925706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.925706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.926338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.928086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:14.948089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:14.961408 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3574/7169] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:14 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:14.962583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e48d-3ff3-4593-bf8f-0373d39de059 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:14.969054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:14.970712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:14.971090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:14.971687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] PATH_INFO: `/v3/projects/683485d6511e4ebcbc58d2edd095ad3a/users/1af3a091505f4d9fa0a662ef7b01e451/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:14.995009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683485d6511e4ebcbc58d2edd095ad3a, user_id=1af3a091505f4d9fa0a662ef7b01e451, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:14.997912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.023339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3596/7170] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:14 2021] PUT /identity/v3/projects/683485d6511e4ebcbc58d2edd095ad3a/users/1af3a091505f4d9fa0a662ef7b01e451/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:15.028980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.045228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032a75-f414-4942-987b-ee5075fc13f7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.116751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.117661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.119080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.119080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.119080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.121065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6637-325b-4054-8a93-cb1f5dc54cfe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.133655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3575/7171] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:15 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:15.137841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.153484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9828f7-cb44-42a4-b8d7-8dd5dc466a45 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.161362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.162942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.163085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.163346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] PATH_INFO: `/v3/projects/683485d6511e4ebcbc58d2edd095ad3a/users/1af3a091505f4d9fa0a662ef7b01e451/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.166228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683485d6511e4ebcbc58d2edd095ad3a, user_id=1af3a091505f4d9fa0a662ef7b01e451, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.169649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.184178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3597/7172] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:15 2021] PUT /identity/v3/projects/683485d6511e4ebcbc58d2edd095ad3a/users/1af3a091505f4d9fa0a662ef7b01e451/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:15.195836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.196051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.196373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.236665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] MFA Rules not processed for user `1af3a091505f4d9fa0a662ef7b01e451`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:15.238169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:15.350112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.383180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3576/7173] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:15 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:15.389185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820704-652f-4a4b-aec6-0587872c4b72 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.400328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.401977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.402277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.403268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.405321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.408434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.448751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3598/7174] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:15 2021] POST /identity/v3/projects => generated 360 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:15.455993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.489067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16caf2-d4c5-4fd7-ae59-4108a167b284 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.669615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.670190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.670510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.670792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.671495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.673763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.725146 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3577/7175] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:15 2021] POST /identity/v3/users => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:15.725395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.738797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bae5-64d5-437b-85ac-ebb021bf7b57 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.748063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.748834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.749110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.749607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.750965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:15.751808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.754336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67574078-22d4-4fda-a94b-ade5bc13fdb9 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.789066 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3599/7176] 10.222.0.13 () {58 vars in 1156 bytes} [Wed Nov 10 04:21:15 2021] GET /identity/v3/users?domain_id=default => generated 6873 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:15.794035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:15.820262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34966e-b888-4715-b473-d63ea1b6de84 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:15.836400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:15.837353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.837585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.837899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/users/be356ed3d61342e7b7da1c68c6503eca` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.857797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:update_user(user_id=be356ed3d61342e7b7da1c68c6503eca)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:15.859101 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:15.859101 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:21:15.859101 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:15.862410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:15.915874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:15.938823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invalidating the token cache because user be356ed3d61342e7b7da1c68c6503eca was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:15.938823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:15.941697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:15.948255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3578/7177] 10.222.0.13 () {60 vars in 1243 bytes} [Wed Nov 10 04:21:15 2021] PATCH /identity/v3/users/be356ed3d61342e7b7da1c68c6503eca => generated 485 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:15.953939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:15.954163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:15.954428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:15.977069 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.auth.plugins.core [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] User is disabled: be356ed3d61342e7b7da1c68c6503eca: AssertionError: User is disabled: be356ed3d61342e7b7da1c68c6503eca Nov 10 04:21:15.997212 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 10 04:21:16.006196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:16.008355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:16.017111 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3600/7178] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:15 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 65 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 10 04:21:16.031237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57b73-f1dc-4f74-8115-a4a548e8301b tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:16.044517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:16.046440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:16.048428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:16.048930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/users/be356ed3d61342e7b7da1c68c6503eca` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:16.084278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:delete_user(user_id=be356ed3d61342e7b7da1c68c6503eca)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:16.087938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:16.170079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.181126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.181803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.182603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.195680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be356ed3d61342e7b7da1c68c6503eca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.222790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3579/7179] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:16 2021] DELETE /identity/v3/users/be356ed3d61342e7b7da1c68c6503eca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:16.224723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:16.227482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:16.355482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e660-7b71-44a2-96d8-f8ce3a51e616 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:16.362917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:16.364253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:16.364601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:16.364930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/projects/18f16a208fda40c2b12b8ed7483f68b7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:16.366763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18f16a208fda40c2b12b8ed7483f68b7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:16.368838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:16.445091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f16a208fda40c2b12b8ed7483f68b7', 'request_id': 'req-81a8b12d-b03e-41ab-a1d7-c82e72afd067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.452356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f16a208fda40c2b12b8ed7483f68b7', 'request_id': 'req-81a8b12d-b03e-41ab-a1d7-c82e72afd067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.463099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f16a208fda40c2b12b8ed7483f68b7', 'request_id': 'req-81a8b12d-b03e-41ab-a1d7-c82e72afd067'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.486672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] The token cache is being invalidate because project 18f16a208fda40c2b12b8ed7483f68b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:16.487310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.488176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.491571 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3601/7180] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:16 2021] DELETE /identity/v3/projects/18f16a208fda40c2b12b8ed7483f68b7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:16.500278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:16.515269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928129-4764-4012-8126-1218b5305bce tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:16.598616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af3a091505f4d9fa0a662ef7b01e451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683485d6511e4ebcbc58d2edd095ad3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:16.599119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:16.599403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:16.599678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:16.601823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:16.602815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:16.617338 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-0442692a-72a9-4202-912e-c9d155c5288a tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Could not find domain: 9aed7a65253c46cab3a5402ec8140bae.: keystone.exception.DomainNotFound: Could not find domain: 9aed7a65253c46cab3a5402ec8140bae. Nov 10 04:21:16.620739 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3580/7181] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:16 2021] POST /identity/v3/users => generated 112 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:21:16.627700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:16.630247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:16.709870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8b12d-b03e-41ab-a1d7-c82e72afd067 tempest-UsersNegativeTest-775142585 tempest-UsersNegativeTest-775142585-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:16.715944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:16.716969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:16.717363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:16.717598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] PATH_INFO: `/v3/users/aa1b7f7ba3894b00abb8a9fb4cd5f9be` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:16.720165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1b7f7ba3894b00abb8a9fb4cd5f9be)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:16.722191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:16.791753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1b7f7ba3894b00abb8a9fb4cd5f9be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.810711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1b7f7ba3894b00abb8a9fb4cd5f9be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.811749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1b7f7ba3894b00abb8a9fb4cd5f9be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.840284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1b7f7ba3894b00abb8a9fb4cd5f9be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.850663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1b7f7ba3894b00abb8a9fb4cd5f9be'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:16.859673 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3602/7182] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:16 2021] DELETE /identity/v3/users/aa1b7f7ba3894b00abb8a9fb4cd5f9be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:16.864322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:16.864675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:16.865005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:16.891880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:16.893421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:16.976351 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3581/7183] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:17.012137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:17.013664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:17.087375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601ab7-80f0-46d1-b6dc-4d4e2676b927 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:17.091407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:17.092291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:17.092574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:17.092882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:17.104725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:17.106839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:17.118312 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3603/7184] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:18.043155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:18.044807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:18.059397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195210bd-ed5a-45e4-98d8-d7e6a36bbc5a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:18.065943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:18.067039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:18.067501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:18.067945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] PATH_INFO: `/v3/projects/30903e13a5f044239b1ca8854058cfc7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:18.069346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30903e13a5f044239b1ca8854058cfc7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:18.071530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:18.145547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30903e13a5f044239b1ca8854058cfc7', 'request_id': 'req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.152259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30903e13a5f044239b1ca8854058cfc7', 'request_id': 'req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.160006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30903e13a5f044239b1ca8854058cfc7', 'request_id': 'req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.178492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] The token cache is being invalidate because project 30903e13a5f044239b1ca8854058cfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:18.178914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.179618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.181404 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3582/7185] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:18 2021] DELETE /identity/v3/projects/30903e13a5f044239b1ca8854058cfc7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:18.185512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:18.195579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b38566-4bea-4cfd-ac63-a18c4c204528 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:18.290067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:18.291178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:18.291630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:18.292192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] PATH_INFO: `/v3/users/1af3a091505f4d9fa0a662ef7b01e451` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:18.295073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af3a091505f4d9fa0a662ef7b01e451)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:18.298856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:18.371178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af3a091505f4d9fa0a662ef7b01e451'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.395753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af3a091505f4d9fa0a662ef7b01e451'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.397505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af3a091505f4d9fa0a662ef7b01e451'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.416980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af3a091505f4d9fa0a662ef7b01e451'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.429704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af3a091505f4d9fa0a662ef7b01e451'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:18.442687 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3604/7186] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:18 2021] DELETE /identity/v3/users/1af3a091505f4d9fa0a662ef7b01e451 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:19.239866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.244324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.267967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ebbc-b6b7-4e31-b544-37d6b30ca54b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:19.383894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:19.385287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.385537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.385968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] PATH_INFO: `/v3/projects/683485d6511e4ebcbc58d2edd095ad3a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.387296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683485d6511e4ebcbc58d2edd095ad3a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:19.389764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:19.460195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683485d6511e4ebcbc58d2edd095ad3a', 'request_id': 'req-6858c793-0247-4b10-be22-96e148e26344'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.467474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683485d6511e4ebcbc58d2edd095ad3a', 'request_id': 'req-6858c793-0247-4b10-be22-96e148e26344'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.476751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683485d6511e4ebcbc58d2edd095ad3a', 'request_id': 'req-6858c793-0247-4b10-be22-96e148e26344'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.492173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.494586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.498798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] The token cache is being invalidate because project 683485d6511e4ebcbc58d2edd095ad3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:19.499180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.500097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6858c793-0247-4b10-be22-96e148e26344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.503850 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3583/7187] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:19 2021] DELETE /identity/v3/projects/683485d6511e4ebcbc58d2edd095ad3a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:19.515321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba9b4-4df0-4d3c-8a2e-32a4847c222d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.515811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba9b4-4df0-4d3c-8a2e-32a4847c222d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.518111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba9b4-4df0-4d3c-8a2e-32a4847c222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.539882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3306-f6ce-4a9d-8c3e-e6cc4b11b880 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:19.545815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7f2ba9b4-4df0-4d3c-8a2e-32a4847c222d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:19.547247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f2ba9b4-4df0-4d3c-8a2e-32a4847c222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.643790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3584/7188] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:19.652823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.658629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.660964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.689194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:19.690084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.690432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.690702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] PATH_INFO: `/v3/users/85029a148fa74afd93e225fc6c5dc300` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.692157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85029a148fa74afd93e225fc6c5dc300)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:19.694687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:19.703922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:19.705333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.721234 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3585/7189] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:19.722241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.734026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66538e8-3dfb-4c2e-ac6a-ddcca10b105b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:19.740117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:19.741078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.741358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.741631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.742423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:19.742728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:19.745008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:19.760855 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3586/7190] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:19.766379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.778713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85029a148fa74afd93e225fc6c5dc300'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.789701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19dc7-c165-479e-b196-3d78fc8fbfd9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:19.793322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85029a148fa74afd93e225fc6c5dc300'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.795316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85029a148fa74afd93e225fc6c5dc300'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.797978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:19.799425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.799882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.810303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.811160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:19.817446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:19.833873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85029a148fa74afd93e225fc6c5dc300'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.842313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3e98fda3-cd71-4d83-b62a-b49d62217174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85029a148fa74afd93e225fc6c5dc300'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:19.849199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3605/7191] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:19 2021] DELETE /identity/v3/users/85029a148fa74afd93e225fc6c5dc300 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:19.853788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.854174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.854542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.854746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3587/7192] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:19 2021] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:19.859693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.862733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.879343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:19.880729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.952189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab49d3-e640-4bec-9c69-a1aac05a36c8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:19.956777 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3606/7193] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:19.963623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:19.964681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:19.965044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:19.965378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:19.966068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:19.968353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:19.968775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:19.972041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:19.996872 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3588/7194] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:19 2021] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:19.999641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.015017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f74b57-b603-4faa-a36f-ffd940e95e44 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.022494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.023225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.023570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.023948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.025303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.027406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.044179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3589/7195] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:19 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:20.045209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.055896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b0ab-ac0d-43c0-8ee4-06676f156e82 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.062674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.064427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.064840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.065072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377abdb-f641-4a3d-afea-a93570c790d4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.065295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] PATH_INFO: `/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6/users/ef6250a3283b485db1025f33803ca55d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.071968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.073079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.073731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.074102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.086143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48a273ca6524f0db8d8b53cf1a2baf6, user_id=ef6250a3283b485db1025f33803ca55d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.089266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.090141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.091987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.105872 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3607/7196] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:20.113930 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3590/7197] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:20 2021] PUT /identity/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6/users/ef6250a3283b485db1025f33803ca55d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:20.120529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.134533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3e02-b2bb-48ec-934f-bbcca5c06377 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.212679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.213278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.213555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.213852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.214741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.216532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ced8-ba7a-4faa-b07e-320c7dd998d0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.229836 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3608/7198] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:20.234452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.244991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38b09-21d3-44be-9854-3b361bb2a656 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.250163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.251569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.251841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.252282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] PATH_INFO: `/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6/users/ef6250a3283b485db1025f33803ca55d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.255103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48a273ca6524f0db8d8b53cf1a2baf6, user_id=ef6250a3283b485db1025f33803ca55d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.258339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.285409 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3591/7199] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:20 2021] PUT /identity/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6/users/ef6250a3283b485db1025f33803ca55d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:20.289172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.289562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.290014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.322409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] MFA Rules not processed for user `ef6250a3283b485db1025f33803ca55d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:20.323837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:20.421879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3609/7200] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:20 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:20.423893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.504379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4f73-95b5-4302-8824-4bcf8a6adc98 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.513551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.514882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.515398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.516005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.518217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.523308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.553692 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3592/7201] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:20 2021] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:20.557863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.571015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7573-95f9-4422-9b6b-e8379154b20d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.638669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.639405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.639685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.639953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.640767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.643068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.668495 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3610/7202] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:20 2021] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:20.677326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.688226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cb4fd-9d3c-4ecc-9a02-ba8ab498e3a5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.693585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.694273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.694603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.694948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.695586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.697299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.709824 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3593/7203] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:20.713879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.727266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61dc11-2cfd-478d-abb2-34a08b768583 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.733177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.733865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.734469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.734469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.736096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.737508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb860db-f80a-4eec-bba1-37e7e5643476 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.748712 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3611/7204] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:20.752921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.764561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413246-1bb4-42bc-8c56-ea969f4c1446 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:20.770679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:20.771594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.771894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.772149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] PATH_INFO: `/v3/projects/bdb65bbad966481181baef47d6797a1d/users/4abe86c856bc416187ca529b9abb8cef/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.791925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb65bbad966481181baef47d6797a1d, user_id=4abe86c856bc416187ca529b9abb8cef, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:20.794853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:20.813758 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3594/7205] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:20 2021] PUT /identity/v3/projects/bdb65bbad966481181baef47d6797a1d/users/4abe86c856bc416187ca529b9abb8cef/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:20.824595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:20.824828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:20.825198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:20.857299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] MFA Rules not processed for user `4abe86c856bc416187ca529b9abb8cef`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:20.858637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:20.933105 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3612/7206] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:20 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:20.947644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:20.950028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:21.030370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.033516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:21.043053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ed52-6718-4735-8481-1c6542fa6db8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.047514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.048362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.048739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.049107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.126692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c20f-2288-4a46-a607-a6be60102f98 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.128371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.138302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140069-b20f-4168-96b3-abb8803a58e9 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.152834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.155075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.155431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.155737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] PATH_INFO: `/v3/projects/5041706996d042f3899c7e51b4cc38e2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.160318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5041706996d042f3899c7e51b4cc38e2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.163574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.173271 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3595/7207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:20 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:21.237803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5041706996d042f3899c7e51b4cc38e2', 'request_id': 'req-fe12ddbb-675d-4c68-8930-a3709d0ae32a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:21.246004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5041706996d042f3899c7e51b4cc38e2', 'request_id': 'req-fe12ddbb-675d-4c68-8930-a3709d0ae32a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:21.255932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5041706996d042f3899c7e51b4cc38e2', 'request_id': 'req-fe12ddbb-675d-4c68-8930-a3709d0ae32a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:21.283869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] The token cache is being invalidate because project 5041706996d042f3899c7e51b4cc38e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:21.284357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:21.285240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fe12ddbb-675d-4c68-8930-a3709d0ae32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:21.287152 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3613/7208] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:21 2021] DELETE /identity/v3/projects/5041706996d042f3899c7e51b4cc38e2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:21.293411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.293980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.294180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.315269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:21.317684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:21.399046 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3596/7209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:21.408503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.409256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.410188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.432865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:21.434031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:21.449158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.455868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3614/7210] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:21.463763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c808-b186-4fc7-bdc6-0299062a7e67 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.469474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.470327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.470544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.470763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.471585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:21.471833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.473609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.492207 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3597/7211] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:21.497242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.511412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef82b3-7794-43a6-b4d2-641e35b9c56c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.525109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.526113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.526807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.527223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.529055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.532879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.592981 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3615/7212] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:21 2021] POST /identity/v3/projects => generated 359 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:21.596858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.609517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f2f-cea7-4612-84d9-e02fb9b5925e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.693699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.694301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.694574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.694986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.695918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.697927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.728665 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3598/7213] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:21 2021] POST /identity/v3/users => generated 280 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:21.731530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.743032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda9c2-09f1-492e-b295-fbbea2b91617 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.749610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.750885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.751020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.751279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.752007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.753698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.769967 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3616/7214] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:21 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:21.773915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.787929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c33c8-98b1-4340-8311-a4ecb05145dd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.794410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.795338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.795824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.796166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.798516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.800708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4d67f-169e-4a6c-995a-72668b2e5a84 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.825218 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3599/7215] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:21 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:21.836366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.849530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83fa11-a123-40bd-9fd5-1283534d382f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:21.858841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:21.860640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.861070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.861702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] PATH_INFO: `/v3/projects/d6079106071d44e1a6fe8129f5361860/users/a57ceb47f6c84e4bbcd8627f2f397e50/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.887038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6079106071d44e1a6fe8129f5361860, user_id=a57ceb47f6c84e4bbcd8627f2f397e50, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:21.892051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:21.921933 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3617/7216] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:21 2021] PUT /identity/v3/projects/d6079106071d44e1a6fe8129f5361860/users/a57ceb47f6c84e4bbcd8627f2f397e50/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:21.934190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:21.934454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:21.935325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:21.945512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:21.947217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:21.982669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] MFA Rules not processed for user `a57ceb47f6c84e4bbcd8627f2f397e50`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:21.984124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:22.080762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dec9-29a0-4ba6-8f51-a16f671d35aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:22.091173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:22.092056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:22.093083 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3600/7217] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:21 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:22.093238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:22.093353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] PATH_INFO: `/v3/users/ef6250a3283b485db1025f33803ca55d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:22.094905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6250a3283b485db1025f33803ca55d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:22.097075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:22.130014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:22.131779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:22.207574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6250a3283b485db1025f33803ca55d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:22.226049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6250a3283b485db1025f33803ca55d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:22.229583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6250a3283b485db1025f33803ca55d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:22.271201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6250a3283b485db1025f33803ca55d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:22.274816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce15f2-b591-4147-971a-3b8647a71778 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:22.280755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:22.282592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:22.283174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-72aae32a-663a-46bf-b6aa-495e20b830b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6250a3283b485db1025f33803ca55d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:22.283306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:22.284011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:22.286924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:22.295483 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3618/7218] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:21 2021] DELETE /identity/v3/users/ef6250a3283b485db1025f33803ca55d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:22.304205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:22.304545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:22.305204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:22.331201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:22.332877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:22.339867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:22.345975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:22.369993 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3601/7219] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:22 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:22.494854 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3619/7220] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:22.542872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:22.544836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:22.575403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485687d-8744-49e4-a18a-6f5a46806f3c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:22.741090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:22.742206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:22.742723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:22.743212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:22.758495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:22.761139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:22.774783 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3602/7221] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:23.845706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:23.850818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:23.873588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1945ae-a924-48a4-a8bb-c76f4eda4fdb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:23.885942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:23.887106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:23.887496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:23.887860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] PATH_INFO: `/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:23.889495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48a273ca6524f0db8d8b53cf1a2baf6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:23.893484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:24.002953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48a273ca6524f0db8d8b53cf1a2baf6', 'request_id': 'req-8a774654-eda5-4b24-9b98-8d991739bfcb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.017357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48a273ca6524f0db8d8b53cf1a2baf6', 'request_id': 'req-8a774654-eda5-4b24-9b98-8d991739bfcb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.029266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48a273ca6524f0db8d8b53cf1a2baf6', 'request_id': 'req-8a774654-eda5-4b24-9b98-8d991739bfcb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.056796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] The token cache is being invalidate because project b48a273ca6524f0db8d8b53cf1a2baf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:24.058302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.058550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.060903 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3620/7222] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:23 2021] DELETE /identity/v3/projects/b48a273ca6524f0db8d8b53cf1a2baf6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:24.064960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:24.094927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f32c-09ba-4422-ac30-b15061e4ba3b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:24.209148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:24.210921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:24.211623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:24.212138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] PATH_INFO: `/v3/users/4abe86c856bc416187ca529b9abb8cef` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:24.215142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abe86c856bc416187ca529b9abb8cef)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:24.217933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:24.326781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abe86c856bc416187ca529b9abb8cef'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.341958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abe86c856bc416187ca529b9abb8cef'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.345727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abe86c856bc416187ca529b9abb8cef'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.347029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abe86c856bc416187ca529b9abb8cef'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.364638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa32a6b3-c861-47f0-8740-422a7b00236d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abe86c856bc416187ca529b9abb8cef'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:24.408463 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3603/7223] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:24 2021] DELETE /identity/v3/users/4abe86c856bc416187ca529b9abb8cef => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:24.860335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:24.862013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:24.881771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774654-eda5-4b24-9b98-8d991739bfcb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:24.972779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:24.974549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:24.974956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:24.975446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] PATH_INFO: `/v3/users/e39b47dc0794427ca139086096853aab` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:24.981389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39b47dc0794427ca139086096853aab)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:24.984858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:25.051046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39b47dc0794427ca139086096853aab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.066761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39b47dc0794427ca139086096853aab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.067997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39b47dc0794427ca139086096853aab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.086787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39b47dc0794427ca139086096853aab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.097065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39b47dc0794427ca139086096853aab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.105928 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3621/7224] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:24 2021] DELETE /identity/v3/users/e39b47dc0794427ca139086096853aab => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:25.111521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.112436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.112764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.140595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:25.143290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.228753 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3604/7225] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:25.251809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.253877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.338728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.340196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.350398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075b09-9a29-4117-85e3-a4ae94ba62c7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:25.355361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e1120-e321-4b95-b9c2-5d627cc45df8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:25.359497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:25.360162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.361009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.361930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.367526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:25.369108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.373234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.373695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] PATH_INFO: `/v3/projects/bdb65bbad966481181baef47d6797a1d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.376485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb65bbad966481181baef47d6797a1d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:25.378775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:25.385217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:25.386899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013ae2-3b2d-4ca1-b309-310eec9cbc98 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:25.411450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3622/7226] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:25.458713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb65bbad966481181baef47d6797a1d', 'request_id': 'req-a3431202-0146-498d-8f12-ddf0d6f87ae6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.468537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb65bbad966481181baef47d6797a1d', 'request_id': 'req-a3431202-0146-498d-8f12-ddf0d6f87ae6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.476494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb65bbad966481181baef47d6797a1d', 'request_id': 'req-a3431202-0146-498d-8f12-ddf0d6f87ae6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.494682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] The token cache is being invalidate because project bdb65bbad966481181baef47d6797a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:25.495337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.496398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3431202-0146-498d-8f12-ddf0d6f87ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:25.499590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3605/7227] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:25 2021] DELETE /identity/v3/projects/bdb65bbad966481181baef47d6797a1d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:25.506665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.507730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.508133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.536785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:25.538338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.617764 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3623/7228] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:25.628803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.628803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.628803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.653918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:25.655558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.665461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3606/7229] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:25.669734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.694805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b01b5-a513-44d6-aec5-600ef8cf519e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:25.711420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770169-0298-455f-afba-993eda618853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:25.712509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770169-0298-455f-afba-993eda618853 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.712850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770169-0298-455f-afba-993eda618853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.713109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770169-0298-455f-afba-993eda618853 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.713925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770169-0298-455f-afba-993eda618853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:25.714286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770169-0298-455f-afba-993eda618853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:25.715894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770169-0298-455f-afba-993eda618853 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:25.735839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3624/7230] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:21:25.741496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.754449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fce9a-20f6-4ce3-b4c0-cfacd433a5ae None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:25.766994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:25.767663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.767945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.768320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.769603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:25.771595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:25.840508 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3607/7231] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:25 2021] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:25.845934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770169-0298-455f-afba-993eda618853 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.864128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770169-0298-455f-afba-993eda618853 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:25.869953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:25.882476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:25.990432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:25.991750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:25.992412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:25.992982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:25.994629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.008805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.030960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923656f-e54c-4ced-8f7b-00d0f9082a41 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.038096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.039619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.039619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.039994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] PATH_INFO: `/v3/projects/6c0528b04d134afa8397951de3d7922f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.041556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0528b04d134afa8397951de3d7922f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.044412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.065628 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3625/7232] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:25 2021] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:26.067874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.097448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdccafe-1e84-44f8-9417-de7727d95c24 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.106144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.107577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.108132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.112389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.113446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.118896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.120102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0528b04d134afa8397951de3d7922f', 'request_id': 'req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.128005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0528b04d134afa8397951de3d7922f', 'request_id': 'req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.136484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0528b04d134afa8397951de3d7922f', 'request_id': 'req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.146153 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3626/7233] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:26 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:26.147906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.158941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] The token cache is being invalidate because project 6c0528b04d134afa8397951de3d7922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:26.159596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.160548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.166373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473c686-80f5-4f2e-9470-65d93ca18876 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.167593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3608/7234] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:25 2021] DELETE /identity/v3/projects/6c0528b04d134afa8397951de3d7922f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:26.168863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.171512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:26.257919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.259005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.259499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.260003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb76d6-6ab1-48fe-a708-9e13a0ba6b9e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.260338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.261286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.264507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.274797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.275978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.276284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.276563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] PATH_INFO: `/v3/users/ad91e08b56aa4da48dd10d6341512c6a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.277914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad91e08b56aa4da48dd10d6341512c6a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.278446 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3627/7235] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:26 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:26.280085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.282379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.284324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:26.299098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23140-5105-43a8-883a-274ae9f5edeb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.308399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.309504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.309898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.310202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] PATH_INFO: `/v3/projects/dd646c44c1354cd7936b0c333d71cc17/users/432f2969e69245939015b346e8a73ec2/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.331286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd646c44c1354cd7936b0c333d71cc17, user_id=432f2969e69245939015b346e8a73ec2, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.336057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dee1e-50fa-476e-84be-2f655ab18ecd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.337700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad91e08b56aa4da48dd10d6341512c6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.347327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad91e08b56aa4da48dd10d6341512c6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.347855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad91e08b56aa4da48dd10d6341512c6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.348512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad91e08b56aa4da48dd10d6341512c6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.355381 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3628/7236] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:26 2021] PUT /identity/v3/projects/dd646c44c1354cd7936b0c333d71cc17/users/432f2969e69245939015b346e8a73ec2/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:26.365037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad91e08b56aa4da48dd10d6341512c6a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.367801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.368103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.368821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.391754 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3609/7237] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:26 2021] DELETE /identity/v3/users/ad91e08b56aa4da48dd10d6341512c6a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:26.402057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] MFA Rules not processed for user `432f2969e69245939015b346e8a73ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:26.403362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:26.484688 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3629/7238] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:26.488074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.490424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:26.566749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3847e1-5d25-4df0-ab50-e86e63e36bf8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.574886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.575988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.575988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.576206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.576838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.579694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.615340 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3610/7239] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:26 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:26.616594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.630227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d4760-8a07-46e2-a9e4-5620682f6ef0 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.727302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.728290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.728436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.728870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.730085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.732430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.760889 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3630/7240] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:26 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:26.764447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.767529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.769571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:26.783047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665f8e-eef3-485a-9f1a-d615ee5d6786 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.786157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc3f6-0da8-4649-856a-d237d30bd862 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.792455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.794180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.795010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.795400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] PATH_INFO: `/v3/projects/64e130cb763148bc9ab88adb1d883d76` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.796827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e130cb763148bc9ab88adb1d883d76)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.799275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.805330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:26.806133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:26.806429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:26.823287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:26.825159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:26.830987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:26.866650 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3611/7241] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:26 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:26.868679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:26.880093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e130cb763148bc9ab88adb1d883d76', 'request_id': 'req-aca3b45e-7775-4e99-83bb-814500d5aef3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.888401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e130cb763148bc9ab88adb1d883d76', 'request_id': 'req-aca3b45e-7775-4e99-83bb-814500d5aef3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.899424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e130cb763148bc9ab88adb1d883d76', 'request_id': 'req-aca3b45e-7775-4e99-83bb-814500d5aef3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.900587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb9fdc-8126-40f8-843c-d1505b9a8295 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:26.925550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] The token cache is being invalidate because project 64e130cb763148bc9ab88adb1d883d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:26.927381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.930548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:26.934250 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3631/7242] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:26 2021] DELETE /identity/v3/projects/64e130cb763148bc9ab88adb1d883d76 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:27.028652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:27.030421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:27.031736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:27.032649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:27.034047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:27.036182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0fedf-c9a0-4bf0-9c2e-4dc41f3a2574 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:27.057066 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3612/7243] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:26 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:27.061599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:27.063640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:27.090729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b45e-7775-4e99-83bb-814500d5aef3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:27.107242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:27.110954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:27.111799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:27.113264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] PATH_INFO: `/v3/projects/d438956061164a69bb4ee041b54cf5b8/users/9f02e97a420d4080a9cc875ecb7b7c4f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:27.147960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d438956061164a69bb4ee041b54cf5b8, user_id=9f02e97a420d4080a9cc875ecb7b7c4f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:27.151003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:27.173549 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3632/7244] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:27 2021] PUT /identity/v3/projects/d438956061164a69bb4ee041b54cf5b8/users/9f02e97a420d4080a9cc875ecb7b7c4f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:27.189995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:27.192121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:27.192579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:27.235333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] MFA Rules not processed for user `9f02e97a420d4080a9cc875ecb7b7c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:27.237484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:27.426280 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3613/7245] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:27.456991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:27.467301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:27.590229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a376d9-9717-431e-9445-5d5f9ff8271e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:27.600367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:27.601532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:27.601848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:27.602585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:27.605561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:27.679424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:27.680821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:27.690243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3633/7246] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:27.796670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:27.818361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfec5-888e-4714-948f-7a74a6ed775b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:27.829515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:27.829515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:27.829515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:27.829515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:27.843435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:27.845571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97663875-596b-4995-97d0-97669c34c9d8 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:27.856471 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3614/7247] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:28.253125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:28.340121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c8698-fedc-4fad-8c1b-b8844ea368fa service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:28.348471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:28.349961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:28.350593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:28.351043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] PATH_INFO: `/v3/users/432f2969e69245939015b346e8a73ec2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:28.352531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] RBAC: Authorizing `identity:delete_user(user_id=432f2969e69245939015b346e8a73ec2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:28.354660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:28.435540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432f2969e69245939015b346e8a73ec2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:28.446634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432f2969e69245939015b346e8a73ec2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:28.447512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432f2969e69245939015b346e8a73ec2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:28.466809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432f2969e69245939015b346e8a73ec2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:28.480018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432f2969e69245939015b346e8a73ec2'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:28.492078 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3634/7248] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:28 2021] DELETE /identity/v3/users/432f2969e69245939015b346e8a73ec2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:28.494078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:28.494565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:28.494565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:28.518507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:28.520070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:28.624679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3615/7249] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:28.634858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:28.637236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:28.746687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11816-55d6-4d56-9776-29001909413c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:28.753682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:28.754543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:28.754880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:28.755160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:28.769159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:28.771310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:28.786230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3635/7250] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:29.378171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:29.380384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:29.411742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54615870-f0d7-4e01-8e7c-797a887e65bf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:29.421096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:29.423625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:29.424079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:29.424411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] PATH_INFO: `/v3/projects/dd646c44c1354cd7936b0c333d71cc17` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:29.426180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd646c44c1354cd7936b0c333d71cc17)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:29.428922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:29.506010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd646c44c1354cd7936b0c333d71cc17', 'request_id': 'req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.512244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd646c44c1354cd7936b0c333d71cc17', 'request_id': 'req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.520289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd646c44c1354cd7936b0c333d71cc17', 'request_id': 'req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.536040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] The token cache is being invalidate because project dd646c44c1354cd7936b0c333d71cc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:29.536358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.537145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.539371 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3616/7251] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:29 2021] DELETE /identity/v3/projects/dd646c44c1354cd7936b0c333d71cc17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:29.543439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:29.555891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f2a4-5dc9-4439-8b10-da21bcdfef54 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:29.629550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:29.631050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:29.631343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:29.631682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] PATH_INFO: `/v3/users/9f02e97a420d4080a9cc875ecb7b7c4f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:29.633801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f02e97a420d4080a9cc875ecb7b7c4f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:29.637304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:29.719392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f02e97a420d4080a9cc875ecb7b7c4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.728709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f02e97a420d4080a9cc875ecb7b7c4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.729445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f02e97a420d4080a9cc875ecb7b7c4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.744445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f02e97a420d4080a9cc875ecb7b7c4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.755370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b3217941-f1ed-4d03-b980-92986aafa0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f02e97a420d4080a9cc875ecb7b7c4f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:29.762286 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3636/7252] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:29 2021] DELETE /identity/v3/users/9f02e97a420d4080a9cc875ecb7b7c4f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:30.322351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:30.324182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:30.360324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cde5c-ecaf-47fa-a9f8-23cbf04cc60a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:30.499421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:30.500821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:30.501345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:30.501629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] PATH_INFO: `/v3/projects/d438956061164a69bb4ee041b54cf5b8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:30.503176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d438956061164a69bb4ee041b54cf5b8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:30.505591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:30.584314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd438956061164a69bb4ee041b54cf5b8', 'request_id': 'req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:30.592407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd438956061164a69bb4ee041b54cf5b8', 'request_id': 'req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:30.601091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd438956061164a69bb4ee041b54cf5b8', 'request_id': 'req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:30.625201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] The token cache is being invalidate because project d438956061164a69bb4ee041b54cf5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:30.625491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:30.626337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0cf0f1d-4fe5-4fa6-818c-58886aad0cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:30.629814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3617/7253] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:30 2021] DELETE /identity/v3/projects/d438956061164a69bb4ee041b54cf5b8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:30.636711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:30.637217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:30.637303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:30.660258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:30.662404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:30.755367 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3637/7254] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:30.764798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:30.766419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:30.767012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:30.807030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:30.807030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:30.815681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3618/7255] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:30.820340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:30.832479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c9e30-8f4c-4243-95e7-83b923e851fb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:30.839284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:30.841808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:30.841808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:30.841808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:30.841808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:30.842459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:30.844972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:30.859480 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3638/7256] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:30.863830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:30.875506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f69414-78a4-4d90-8ad3-58e70bdfea4f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:30.892395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:30.893806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:30.895416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:30.895935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:30.897942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:30.902265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:30.957409 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3619/7257] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:30 2021] POST /identity/v3/projects => generated 357 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:30.961383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:30.974085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800f0b-863e-4f17-af72-7bff67e20199 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.046664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.047863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.048374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.048944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.049931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.054491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.087564 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3639/7258] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:30 2021] POST /identity/v3/users => generated 279 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:31.091656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.107039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a7c3f-83d1-4c37-8b01-2e2a464fafb0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.113290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.116357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.116941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.117344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.118203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.119997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.165288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3620/7259] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:31.169804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.181697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc6cc-a8a5-407b-85a8-c5fff0cd1710 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.194359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.195833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.196003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.196403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.201257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.204687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81f0ad-4ce2-4930-8d84-e59739c987b7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.230761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.232502 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3640/7260] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:31.247593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69906-de97-4bea-a14f-a8fda5b75118 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.254161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.255475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.256038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.256844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] PATH_INFO: `/v3/projects/feee4eef2afc4792a2b78ec019a1ae22/users/46a53b003542415b8ac0a419e546c321/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.276423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feee4eef2afc4792a2b78ec019a1ae22, user_id=46a53b003542415b8ac0a419e546c321, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.280009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.300631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3621/7261] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:31 2021] PUT /identity/v3/projects/feee4eef2afc4792a2b78ec019a1ae22/users/46a53b003542415b8ac0a419e546c321/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:31.315525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.316055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.316496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.351580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] MFA Rules not processed for user `46a53b003542415b8ac0a419e546c321`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:31.352988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:31.431490 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3641/7262] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:31 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:31.436031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.514963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622247f5-8d33-46a3-bfd2-09909a7ef7d8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.526159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.528211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.528764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.529052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.530220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.532365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.579511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3622/7263] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:31 2021] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:31.583528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.596170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf640fc-2aec-465d-8fba-2375ed573340 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.677856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.679015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.679299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.679635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.680589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.683091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.716660 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3642/7264] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:31 2021] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:31.719698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.732109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2843-0b80-488c-8c68-f35d0a17bb30 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.739802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.740588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.740740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.740943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.741875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.743500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.756138 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3623/7265] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:31.761386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.773613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f221-018c-47e9-93c7-958683b60712 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.779234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.780336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.780634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.780923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] PATH_INFO: `/v3/projects/586ea3cb247148e1a163b97b97680c14/users/ba5f7158192044528cbc400f16edfc82/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.798571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=586ea3cb247148e1a163b97b97680c14, user_id=ba5f7158192044528cbc400f16edfc82, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.801664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.822783 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3643/7266] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:31 2021] PUT /identity/v3/projects/586ea3cb247148e1a163b97b97680c14/users/ba5f7158192044528cbc400f16edfc82/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:31.829074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.841948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5443-76eb-4667-9f06-62c8df3c9580 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.910889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.911612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.911934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.912343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.913159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.914756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e1eed-40ef-45f2-be69-7aafbef179f2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.926637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3624/7267] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:31.931206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:31.944468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3127c-a0d9-4dd3-b689-ec98bb3a4ace admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:31.951366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:31.952671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.953733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.954084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] PATH_INFO: `/v3/projects/586ea3cb247148e1a163b97b97680c14/users/ba5f7158192044528cbc400f16edfc82/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:31.960288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] RBAC: Authorizing `identity:create_grant(project_id=586ea3cb247148e1a163b97b97680c14, user_id=ba5f7158192044528cbc400f16edfc82, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:31.960288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:31.975569 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3644/7268] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:31 2021] PUT /identity/v3/projects/586ea3cb247148e1a163b97b97680c14/users/ba5f7158192044528cbc400f16edfc82/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:31.989770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:31.990493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:31.990774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.022739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] MFA Rules not processed for user `ba5f7158192044528cbc400f16edfc82`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:32.024196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:32.128639 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3625/7269] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:31 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:32.132575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:32.144556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f556-c968-465c-98ac-bdbd8c63585c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:32.150001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5f7158192044528cbc400f16edfc82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ea3cb247148e1a163b97b97680c14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:32.150871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:32.151162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:32.151450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.152260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:32.152686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:32.154353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:32.172679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3645/7270] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:32.175705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:32.187544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218c7cc-0e7e-4870-8403-963a197758f3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:32.193048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5f7158192044528cbc400f16edfc82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ea3cb247148e1a163b97b97680c14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:32.193886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:32.194558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:32.194912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.195685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:32.197905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:32.229786 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3626/7271] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:32 2021] POST /identity/v3/projects => generated 349 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:32.235886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:32.249557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37cc3-b28a-486e-b3ee-66cdc6d4d424 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:32.333268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5f7158192044528cbc400f16edfc82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ea3cb247148e1a163b97b97680c14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:32.334358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:32.334829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:32.335413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.336323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:32.336853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:32.339250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:32.356565 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3646/7272] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:32.370340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:32.372969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:32.500536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0557b3-0daf-4fc0-82a7-e591b31c4f73 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:32.504966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:32.505659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:32.506482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:32.507085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.517559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:32.519221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:32.530296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3627/7273] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:32 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:32.675050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:32.686618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08762-5085-41cc-9f58-8ec2f675974d tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:32.693244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5f7158192044528cbc400f16edfc82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ea3cb247148e1a163b97b97680c14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:32.694081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:32.694366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:32.694758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] PATH_INFO: `/v3/projects/9d7cd6772cd24c1484afc62726d01041` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:32.695847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d7cd6772cd24c1484afc62726d01041)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:32.698484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:32.754922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7cd6772cd24c1484afc62726d01041', 'request_id': 'req-7c05737e-048d-4af9-9ac2-df24956d9664'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:32.761917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7cd6772cd24c1484afc62726d01041', 'request_id': 'req-7c05737e-048d-4af9-9ac2-df24956d9664'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:32.772470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7cd6772cd24c1484afc62726d01041', 'request_id': 'req-7c05737e-048d-4af9-9ac2-df24956d9664'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:32.788699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] The token cache is being invalidate because project 9d7cd6772cd24c1484afc62726d01041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:32.789182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:32.789810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7c05737e-048d-4af9-9ac2-df24956d9664 tempest-QuotasTest-2123693268 tempest-QuotasTest-2123693268-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:32.791802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3647/7274] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:32 2021] DELETE /identity/v3/projects/9d7cd6772cd24c1484afc62726d01041 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:33.110758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:33.196176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b52de4-ac5c-48fa-99da-003edf8a8e09 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:33.260495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:33.261405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:33.261690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:33.261968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] PATH_INFO: `/v3/users/46a53b003542415b8ac0a419e546c321` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:33.263206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a53b003542415b8ac0a419e546c321)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:33.265161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:33.318669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a53b003542415b8ac0a419e546c321'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:33.326243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a53b003542415b8ac0a419e546c321'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:33.327221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a53b003542415b8ac0a419e546c321'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:33.328418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a53b003542415b8ac0a419e546c321'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:33.336584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a53b003542415b8ac0a419e546c321'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:33.359146 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3628/7275] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:33 2021] DELETE /identity/v3/users/46a53b003542415b8ac0a419e546c321 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:33.361558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:33.362191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:33.362539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:33.389444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:33.392765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:33.497172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3648/7276] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:33.511767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:33.514062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:33.599346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf4fc-e36a-4046-b965-3fb0ea6e8b5e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:33.606228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:33.607035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:33.607371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:33.607659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:33.620098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:33.621537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:33.631295 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3629/7277] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:34.205874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:34.211086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:34.249304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae52b0b-71f3-40c8-962b-340a14b326b4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:34.262193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:34.263208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:34.263808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:34.264092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] PATH_INFO: `/v3/projects/feee4eef2afc4792a2b78ec019a1ae22` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:34.266904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feee4eef2afc4792a2b78ec019a1ae22)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:34.269700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:34.373283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feee4eef2afc4792a2b78ec019a1ae22', 'request_id': 'req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.383096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feee4eef2afc4792a2b78ec019a1ae22', 'request_id': 'req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.394608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:34.395893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feee4eef2afc4792a2b78ec019a1ae22', 'request_id': 'req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.397240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:34.412325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] The token cache is being invalidate because project feee4eef2afc4792a2b78ec019a1ae22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:34.412630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.413061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea756ff-f4ca-47b8-b5ce-d92b22c25ad0 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:34.413506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.415279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3649/7278] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:34 2021] DELETE /identity/v3/projects/feee4eef2afc4792a2b78ec019a1ae22 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:34.419200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:34.421645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:34.488449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:34.489384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:34.489676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:34.489970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] PATH_INFO: `/v3/users/a57ceb47f6c84e4bbcd8627f2f397e50` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:34.491360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57ceb47f6c84e4bbcd8627f2f397e50)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:34.493491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:34.499244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e12cf-e1bd-4277-91b2-7d30cdde0894 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:34.505794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:34.506999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:34.507377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:34.507663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] PATH_INFO: `/v3/users/ba5f7158192044528cbc400f16edfc82` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:34.509074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5f7158192044528cbc400f16edfc82)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:34.511402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:34.559040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57ceb47f6c84e4bbcd8627f2f397e50'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.569461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57ceb47f6c84e4bbcd8627f2f397e50'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.570263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57ceb47f6c84e4bbcd8627f2f397e50'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.570927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57ceb47f6c84e4bbcd8627f2f397e50'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.574306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5f7158192044528cbc400f16edfc82'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.582778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76fe2ccd-d84f-42de-9b67-d87d16a192c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57ceb47f6c84e4bbcd8627f2f397e50'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.585058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5f7158192044528cbc400f16edfc82'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.597741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5f7158192044528cbc400f16edfc82'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.603627 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3630/7279] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:34 2021] DELETE /identity/v3/users/a57ceb47f6c84e4bbcd8627f2f397e50 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:34.609068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:34.610136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:34.610506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:34.628843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5f7158192044528cbc400f16edfc82'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.643780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:34.645348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:34.647690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5f7158192044528cbc400f16edfc82'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:34.655119 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3650/7280] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:34 2021] DELETE /identity/v3/users/ba5f7158192044528cbc400f16edfc82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:34.851352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3631/7281] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:34.864984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:34.866496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:34.964349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c991e-9baa-4292-b99c-c0b444dc27d1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:34.971228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:34.972158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:34.972530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:34.972913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.072438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.074303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6f02-fc59-4456-bab6-81a29371729a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.086470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3651/7282] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:35.135918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.137622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.150251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eefae-8ea7-4f4d-8254-afee94c1e9d5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.157255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.157699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.158217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.158742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] PATH_INFO: `/v3/projects/586ea3cb247148e1a163b97b97680c14` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.160713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586ea3cb247148e1a163b97b97680c14)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.163503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.225669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586ea3cb247148e1a163b97b97680c14', 'request_id': 'req-9715f71f-8637-4f53-8cf8-be9c57092102'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.232694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586ea3cb247148e1a163b97b97680c14', 'request_id': 'req-9715f71f-8637-4f53-8cf8-be9c57092102'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.240384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586ea3cb247148e1a163b97b97680c14', 'request_id': 'req-9715f71f-8637-4f53-8cf8-be9c57092102'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.257375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] The token cache is being invalidate because project 586ea3cb247148e1a163b97b97680c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:35.258478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.259346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.268360 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3632/7283] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:35 2021] DELETE /identity/v3/projects/586ea3cb247148e1a163b97b97680c14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:35.268859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659174-a094-4269-891c-cd62d34299a0 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.269268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659174-a094-4269-891c-cd62d34299a0 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.269409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659174-a094-4269-891c-cd62d34299a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.292118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ea659174-a094-4269-891c-cd62d34299a0 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:35.294071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea659174-a094-4269-891c-cd62d34299a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.373299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.375101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.379330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3652/7284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:35.387880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.388420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.388970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.395940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f71f-8637-4f53-8cf8-be9c57092102 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.410294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.411453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.411917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.412353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] PATH_INFO: `/v3/projects/d6079106071d44e1a6fe8129f5361860` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.415277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6079106071d44e1a6fe8129f5361860)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.417162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.437645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:35.440795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.451251 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3653/7285] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:35.456827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.470341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802422-d7a3-48df-9b82-4a796196bc1c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.478690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6079106071d44e1a6fe8129f5361860', 'request_id': 'req-b69ec153-daeb-4539-b142-cf46583a3621'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.484771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6079106071d44e1a6fe8129f5361860', 'request_id': 'req-b69ec153-daeb-4539-b142-cf46583a3621'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.491150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6079106071d44e1a6fe8129f5361860', 'request_id': 'req-b69ec153-daeb-4539-b142-cf46583a3621'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.506020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] The token cache is being invalidate because project d6079106071d44e1a6fe8129f5361860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:35.506862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.507543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b69ec153-daeb-4539-b142-cf46583a3621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:35.510130 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3633/7286] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:35 2021] DELETE /identity/v3/projects/d6079106071d44e1a6fe8129f5361860 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:35.516715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88454a9-db1d-4f4c-87c4-3b640fde4385 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.517207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88454a9-db1d-4f4c-87c4-3b640fde4385 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.517481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88454a9-db1d-4f4c-87c4-3b640fde4385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.537374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e88454a9-db1d-4f4c-87c4-3b640fde4385 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:35.538578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e88454a9-db1d-4f4c-87c4-3b640fde4385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.539427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.540244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.540587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.541011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.541810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:35.542306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.543937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.547703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3634/7287] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:35.555384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.555743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.556100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.560075 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3654/7288] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:35.561027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.563013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.574529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:35.575719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:35.575870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117514-50b9-4a04-b71c-8adead15588a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.581346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.581992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.582271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.582545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.583241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.584839 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3635/7289] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:35.585168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.589408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.598886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3345d-d446-46e1-a9ff-f25ab02e6564 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.603549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.604465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.604841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.605184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.605925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:35.606229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.607860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.623580 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3655/7290] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:35.623792 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3636/7291] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:21:35.625496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.628266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.639855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fde37-0b5d-4794-be4d-6fc93eb3cd16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.697994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2652-be6a-45ac-b1bf-40046429f515 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.700956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.701644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.701920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.702215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.703683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.704827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.705586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.706041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.706516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.707044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.707927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.710078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.736756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3656/7292] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:35.737623 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3637/7293] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:35.741986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.743174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.753953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfaae-f9bf-4b63-a38d-5844f6af6dd1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.815136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0fbf-6068-4bf8-83a1-e14f0ac8a7e0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.817733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.818415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.818698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.818988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.819849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.821512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.822526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.823756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.824113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.824467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.825501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.827511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.837037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3657/7294] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:35.840925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.851803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105497b-d5f7-4f6a-9feb-02df463abb9c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.856469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3638/7295] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:35 2021] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:35.857863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.861815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.862746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.863235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.863837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.864963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.866827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.869744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf3279-2058-47b9-b02c-2db33eb4e66b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.874622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.875369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.875652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.876004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.876713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.878360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.879875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3658/7296] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:35.884316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.892763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3639/7297] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:35.893928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.896084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50deb93-7eee-43b1-b4f2-586730792b96 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.901249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.902231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.902585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.902932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] PATH_INFO: `/v3/projects/aaaf3adfda8344c4bd30410f3efd5da7/users/6f8ed0f366b7444fa425e7fa7c11fda6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.904397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb4e9-107c-4aa6-8a6c-114f5a738f4f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.910064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:35.910741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:35.911019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:35.911291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:35.912028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.914193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.921463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaaf3adfda8344c4bd30410f3efd5da7, user_id=6f8ed0f366b7444fa425e7fa7c11fda6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:35.926028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ae20-839a-459a-a5ed-a2924994f6ab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:35.929479 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3640/7298] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:35.930521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:35.941843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0fa2-65d1-45a4-b96d-2f7b6220c947 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:35.956735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3659/7299] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:35 2021] PUT /identity/v3/projects/aaaf3adfda8344c4bd30410f3efd5da7/users/6f8ed0f366b7444fa425e7fa7c11fda6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:36.022248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.023168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.023394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.023677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] PATH_INFO: `/v3/projects/3bf4f1e8cbb34e34badcd24b94d58594/users/912609aed9594307b1ed510d673334ff/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.037166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.037887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.038229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.044742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf4f1e8cbb34e34badcd24b94d58594, user_id=912609aed9594307b1ed510d673334ff, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.048161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d42b3b-5da1-42e8-90c3-b0e8ef39a16a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.067493 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3641/7300] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:35 2021] PUT /identity/v3/projects/3bf4f1e8cbb34e34badcd24b94d58594/users/912609aed9594307b1ed510d673334ff/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:36.082500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] MFA Rules not processed for user `6f8ed0f366b7444fa425e7fa7c11fda6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:36.083535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.083754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.084970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.085414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.120467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] MFA Rules not processed for user `912609aed9594307b1ed510d673334ff`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:36.122335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.175238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3660/7301] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:36 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:36.186955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.188692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.208964 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3642/7302] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:36.230907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.232837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.257338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0263854-456a-4047-8eec-dc91d893e0e9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.263428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.264091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.264466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.264773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.276839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.278322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.289865 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3661/7303] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:36 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:36.299664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bcc5a-9383-467a-9379-4d548365dd24 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.303409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.304055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.304337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.304637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.313496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.314960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.324251 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3643/7304] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:36 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:36.335118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.338941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.417472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c203-02fb-4d7d-838f-6bc45303a49c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.424975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.425967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.426305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.426641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] PATH_INFO: `/v3/users/912609aed9594307b1ed510d673334ff` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.428199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] RBAC: Authorizing `identity:delete_user(user_id=912609aed9594307b1ed510d673334ff)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.429817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12edd-c9d7-415c-b747-ab3aa5c438f4 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.430772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.438553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.439052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.440214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.440386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] PATH_INFO: `/v3/users/6f8ed0f366b7444fa425e7fa7c11fda6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.441679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8ed0f366b7444fa425e7fa7c11fda6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.445523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.509670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912609aed9594307b1ed510d673334ff'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.518891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912609aed9594307b1ed510d673334ff'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.519855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912609aed9594307b1ed510d673334ff'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.520671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912609aed9594307b1ed510d673334ff'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.530106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2df5fef-256c-457d-a7dd-2fbafbb7989b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912609aed9594307b1ed510d673334ff'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.547373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8ed0f366b7444fa425e7fa7c11fda6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.558081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3644/7305] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:36 2021] DELETE /identity/v3/users/912609aed9594307b1ed510d673334ff => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:36.559371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.559803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.560160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.576079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8ed0f366b7444fa425e7fa7c11fda6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.577605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8ed0f366b7444fa425e7fa7c11fda6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.579863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:36.581191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.604045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8ed0f366b7444fa425e7fa7c11fda6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.615187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7e5cf1c9-6018-45d5-a7de-391a9430ebe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8ed0f366b7444fa425e7fa7c11fda6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:36.629164 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3662/7306] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:36 2021] DELETE /identity/v3/users/6f8ed0f366b7444fa425e7fa7c11fda6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:36.634742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.635024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.635298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.655986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:36.657433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.668186 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3645/7307] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:36.680714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.682181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.741507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3663/7308] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:36.761573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:36.767149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:36.770205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46611-54f5-4a42-9751-bdfca6daac22 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.850258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31775e63-ac4c-40ab-b302-7016afeccc46 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:36.859989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.860962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.861453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.861931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.866781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:36.867425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:36.867697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:36.867963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:36.878082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.878487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:36.879572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.879911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:36.893582 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3664/7309] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:21:36.897119 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3646/7310] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:37.393104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.395432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.416035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22016689-2def-47be-a025-d647964cfa27 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.424015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.425171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.425557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.426063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] PATH_INFO: `/v3/projects/aaaf3adfda8344c4bd30410f3efd5da7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.427387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaaf3adfda8344c4bd30410f3efd5da7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.429560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.473178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.475355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.491758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9b55-742b-42ee-97d0-1271f9b1dba3 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.494536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaaf3adfda8344c4bd30410f3efd5da7', 'request_id': 'req-b388644f-5de7-4f5b-967b-c18af5b5ff55'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.500854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaaf3adfda8344c4bd30410f3efd5da7', 'request_id': 'req-b388644f-5de7-4f5b-967b-c18af5b5ff55'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.512350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaaf3adfda8344c4bd30410f3efd5da7', 'request_id': 'req-b388644f-5de7-4f5b-967b-c18af5b5ff55'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.527634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] The token cache is being invalidate because project aaaf3adfda8344c4bd30410f3efd5da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:37.527934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.528836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b388644f-5de7-4f5b-967b-c18af5b5ff55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.532658 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3665/7311] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:37 2021] DELETE /identity/v3/projects/aaaf3adfda8344c4bd30410f3efd5da7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:37.537711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188b36-8a2a-4154-914d-12e1b96121b9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.538093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188b36-8a2a-4154-914d-12e1b96121b9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.538562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188b36-8a2a-4154-914d-12e1b96121b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.564282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.564636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-b7188b36-8a2a-4154-914d-12e1b96121b9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:37.565502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.565956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.566265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] PATH_INFO: `/v3/projects/3bf4f1e8cbb34e34badcd24b94d58594` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.567308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b7188b36-8a2a-4154-914d-12e1b96121b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.568205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf4f1e8cbb34e34badcd24b94d58594)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.570169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.576998 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3666/7312] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:37.586068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.586546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.586888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.607345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:37.608909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.620137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf4f1e8cbb34e34badcd24b94d58594', 'request_id': 'req-00bcb425-f4bb-4df1-a51b-b54352e5702b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.626362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf4f1e8cbb34e34badcd24b94d58594', 'request_id': 'req-00bcb425-f4bb-4df1-a51b-b54352e5702b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.633216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf4f1e8cbb34e34badcd24b94d58594', 'request_id': 'req-00bcb425-f4bb-4df1-a51b-b54352e5702b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.649413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] The token cache is being invalidate because project 3bf4f1e8cbb34e34badcd24b94d58594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:37.650153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.650818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-00bcb425-f4bb-4df1-a51b-b54352e5702b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:37.657823 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3647/7313] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:37 2021] DELETE /identity/v3/projects/3bf4f1e8cbb34e34badcd24b94d58594 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:37.659302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018f5c-24d0-491f-ab4e-50d48edabffe None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.659650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018f5c-24d0-491f-ab4e-50d48edabffe None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.660010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018f5c-24d0-491f-ab4e-50d48edabffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.671183 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3667/7314] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:37.675753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.683229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b5018f5c-24d0-491f-ab4e-50d48edabffe None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:37.684422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b5018f5c-24d0-491f-ab4e-50d48edabffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.684992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de962251-ce3d-442c-9e4f-d9389e1cfa3a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.689734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.690448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.690766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.690998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.691726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:37.692022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.693225 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3648/7315] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:37.693616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.700903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.701197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.701475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.708651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3668/7316] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:21:37.710983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.721878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e815d2-b8a1-4f0d-a2db-0f6ecb901675 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.724389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:37.725611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:37.726838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.727513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.727790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.728063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.728857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.730714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.734313 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3649/7317] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:37.738573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.749870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660d2a9-ae3e-4e7b-9f7b-db1abda55748 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.755588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.756250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.756526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.756826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.757564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:37.757863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.759431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.764437 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3669/7318] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:37.769953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.772347 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3650/7319] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:37.776648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.786651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785551d-06d4-47ad-9931-787442a522b1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.857040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.857704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.857984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.858257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.858388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d34d-1dc8-4070-a0de-18df748433a9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.859090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.860881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.864350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.864717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.864936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.865208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.866170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.867800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.890136 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3651/7320] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:37.893759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3670/7321] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:37.894884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.897843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:37.909735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653aa8-b12b-4ee6-a395-f3b96f3a39d3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.966861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab8ef-a3f5-463a-af9e-da16087060c9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:37.974006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.974842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.975001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:37.975186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.975639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.975882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:37.976218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:37.976547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.976707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:37.977423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:37.979545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.980362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:37.993881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3671/7322] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:37.994958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.006176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7898-78f7-4b1e-a2d5-e05c0274613a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.010160 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3652/7323] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:37 2021] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:38.011161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.011368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.011850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.012135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.012414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.013413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.015095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.022336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fb27-81e3-4bd8-909b-0a6bc8ae7eef admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.029477 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3672/7324] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:38.030832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.031274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.031712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.032076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.032383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.033220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.035164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.041063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331221-b374-4b30-b738-517dec91e810 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.046538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.050264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.050428 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3653/7325] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:38.050533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.050533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] PATH_INFO: `/v3/projects/5f0086badb384462a555d4217768d9c9/users/d6964370cbfa41899352ae2097d95922/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.052372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.064735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0086badb384462a555d4217768d9c9, user_id=d6964370cbfa41899352ae2097d95922, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.065000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6de6-7800-4116-bd68-d65b1425f501 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.068201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.071558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.072187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.072536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.072857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.073603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.075282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de9d1-5d15-486d-872d-22295a3194c9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.086697 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3673/7326] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:38 2021] PUT /identity/v3/projects/5f0086badb384462a555d4217768d9c9/users/d6964370cbfa41899352ae2097d95922/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:38.099181 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3654/7327] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:38.099301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.100485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.100851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.101129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.133500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] MFA Rules not processed for user `d6964370cbfa41899352ae2097d95922`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:38.135257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:38.175435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8475-8625-4984-a826-01e7a6cff58c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.180270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.181644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.182179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.182179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] PATH_INFO: `/v3/projects/78ed2d7c01b6441f9e0b1cca0d272c2b/users/ae9d7f5f1d3b4665b8865e4d9aa6020b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.198729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ed2d7c01b6441f9e0b1cca0d272c2b, user_id=ae9d7f5f1d3b4665b8865e4d9aa6020b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.201396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b90357-0d85-4b93-9849-6e45ded93d85 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.210448 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3655/7328] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:38 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:38.218074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.219546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:38.220624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3674/7329] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:38 2021] PUT /identity/v3/projects/78ed2d7c01b6441f9e0b1cca0d272c2b/users/ae9d7f5f1d3b4665b8865e4d9aa6020b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:38.230689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.231050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.231521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.258240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] MFA Rules not processed for user `ae9d7f5f1d3b4665b8865e4d9aa6020b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:38.259501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:38.300768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4745-6b56-457d-b6b8-2447ba7a915e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.333561 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3675/7330] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:38 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:38.337947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.351493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.352144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.352423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.352731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.409009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a797a5-0c27-439e-9967-d4344e6d83f7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.414210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.414991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.415336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.415676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.416486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.418676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.432527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.434023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.447806 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3656/7331] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:38.453102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3676/7332] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:38 2021] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:38.457694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.472324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833cbe-9fe2-4ac4-a88a-86a298452e46 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.565080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.565842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.566168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.566497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.567246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.569379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.595607 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3657/7333] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:38 2021] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:38.596714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.609688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad1d3-ef0d-460c-8d2c-445bde060b09 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.615012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.615868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.616033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.616993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.617361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.619173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.636031 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3677/7334] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:21:38.640395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.652441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d8b3-03ab-445e-a753-991ce1d1e961 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.657862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.658884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.659251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.659700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] PATH_INFO: `/v3/projects/476a603d283d48f99a74c898a1fc9fba/users/0ecf5f06384647f2afb638017faf1978/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.696259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a603d283d48f99a74c898a1fc9fba, user_id=0ecf5f06384647f2afb638017faf1978, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.699022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.717455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3658/7335] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:38 2021] PUT /identity/v3/projects/476a603d283d48f99a74c898a1fc9fba/users/0ecf5f06384647f2afb638017faf1978/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:38.719992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.730648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc9b53-23af-4dc1-be94-8c7074288c66 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.795066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.795739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.796015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.796310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.797611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.799187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ef825-7ffd-4ad5-b53d-e35e15bddb02 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.819243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3678/7336] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:38.820820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.841528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052198-2f64-4d13-9124-7caf5f4ec31e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:38.847880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:38.848818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.849096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.849371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] PATH_INFO: `/v3/projects/476a603d283d48f99a74c898a1fc9fba/users/0ecf5f06384647f2afb638017faf1978/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.851435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a603d283d48f99a74c898a1fc9fba, user_id=0ecf5f06384647f2afb638017faf1978, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:38.854067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:38.872093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3659/7337] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:38 2021] PUT /identity/v3/projects/476a603d283d48f99a74c898a1fc9fba/users/0ecf5f06384647f2afb638017faf1978/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:38.881118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:38.881432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:38.881671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:38.910982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] MFA Rules not processed for user `0ecf5f06384647f2afb638017faf1978`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:38.912640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:38.982804 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3679/7338] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:38 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:38.993762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:38.995437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:39.075825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf90791-9b74-402e-a278-5e26dd136519 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:39.080449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:39.081126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:39.081407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:39.081681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:39.091111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:39.092530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:39.104080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3660/7339] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:38 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:39.183767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:39.195359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261aa9b-b06b-46cd-b3ab-b8aa6c265eaf None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:39.198904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:39.199534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:39.199810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:39.200082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:39.255579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:39.257068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:39.266796 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3680/7340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:39 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:50.126289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:50.205744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1500291-30a0-429d-b07e-694f1a8ce0d3 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:50.210232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:50.210914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:50.211299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:50.211648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:50.213628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:50.306322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:50.308510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:50.345821 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3661/7341] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:21:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:21:56.501935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:56.504753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:56.525097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6f55-4abd-4272-b81d-8edd2b770ee0 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:56.536525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:56.537593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:56.538052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:56.538332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] PATH_INFO: `/v3/users/694bd6d882cd4099b51d58a50f6f1ebd` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:56.540104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694bd6d882cd4099b51d58a50f6f1ebd)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:56.542044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:56.599806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694bd6d882cd4099b51d58a50f6f1ebd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:56.611228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694bd6d882cd4099b51d58a50f6f1ebd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:56.612738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694bd6d882cd4099b51d58a50f6f1ebd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:56.650397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694bd6d882cd4099b51d58a50f6f1ebd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:56.677635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-63a8c2e4-ebd9-46b0-8ceb-548fd53cbe98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694bd6d882cd4099b51d58a50f6f1ebd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:56.696051 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3681/7342] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:21:56 2021] DELETE /identity/v3/users/694bd6d882cd4099b51d58a50f6f1ebd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:57.135422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.152533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092d028-68e0-455b-afca-da7c73cb6884 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.240451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.240451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.240451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.240451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] PATH_INFO: `/v3/projects/a7a2ec0afddf403183d9d44778510b6e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.241423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a2ec0afddf403183d9d44778510b6e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.243685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.308028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a2ec0afddf403183d9d44778510b6e', 'request_id': 'req-76809289-d3ed-457b-b762-915a7b630de6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:57.313822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a2ec0afddf403183d9d44778510b6e', 'request_id': 'req-76809289-d3ed-457b-b762-915a7b630de6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:57.320823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a2ec0afddf403183d9d44778510b6e', 'request_id': 'req-76809289-d3ed-457b-b762-915a7b630de6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:57.338403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] The token cache is being invalidate because project a7a2ec0afddf403183d9d44778510b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:21:57.338719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:57.339550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-76809289-d3ed-457b-b762-915a7b630de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:57.341765 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3662/7343] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:57 2021] DELETE /identity/v3/projects/a7a2ec0afddf403183d9d44778510b6e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:57.347908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.348196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.348472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.371635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:57.373902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:57.462172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3682/7344] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:57.470511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.470897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.471271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.498143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:57.500132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:57.510716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3663/7345] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:57.515253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.528876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e99c52-9de3-4021-9ec4-02cd9b67e7a4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.535254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.536149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.536433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.536912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.537662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:57.537973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.539563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.576756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3683/7346] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:21:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:57.579276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.595932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067d005-74a9-49ff-9e0b-36b360845140 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.601711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.603736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.604189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.604637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.605952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.608245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.653708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3664/7347] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:57 2021] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:57.658173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.682855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f78d9-5434-481e-9e9d-77ed6eaf054d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.762221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.763477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.764433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.765384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.766302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.769091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.797637 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3684/7348] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:57 2021] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:57.799048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.811008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b6d8-d213-4509-9bb9-14eaab243c9a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.816016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.816712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.817203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.817481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.818227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.819994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.832655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3665/7349] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:57.836929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.852420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e73f-b038-45c4-bb3b-3f3d66539571 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.858476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.859214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.859711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.860064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.861038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.862708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442c1ad-3166-4640-afb2-94c9318d962f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.873959 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3685/7350] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:57.878401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:57.891471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f2922-4e8a-40ae-9fe4-e773afb6d080 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:57.897297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:57.898829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.899231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.899796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] PATH_INFO: `/v3/projects/0a21737bf8b04c24b5a6bd80650ef570/users/2c14d7265573400bbbf6a60ced36fdfb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:57.931807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a21737bf8b04c24b5a6bd80650ef570, user_id=2c14d7265573400bbbf6a60ced36fdfb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:57.937082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:57.960899 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3666/7351] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:57 2021] PUT /identity/v3/projects/0a21737bf8b04c24b5a6bd80650ef570/users/2c14d7265573400bbbf6a60ced36fdfb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:57.975411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:57.976155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:57.977192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.018479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] MFA Rules not processed for user `2c14d7265573400bbbf6a60ced36fdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:58.020702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:58.118733 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3686/7352] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:57 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:21:58.123124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.208403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de47a7-3cb2-4778-ac89-7e5757228eeb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.216488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.217532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.218509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.218982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.219922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.222402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.261679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3667/7353] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:58 2021] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:58.264951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.281487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96946-fa64-4f38-b2a2-f286b1179a0d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.362061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.363165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.363165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.364110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.365042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.368574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.409184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3687/7354] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:21:58 2021] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:58.409612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.428519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10926ff-56db-4a71-9137-e8889c960a47 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.435535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.436461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.437166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.437604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.438524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.441020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.457345 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3668/7355] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:58 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:58.459213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.470826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a35d-8760-4d4c-8b06-f0445d9da0f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.475985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.477153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.477634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.478085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] PATH_INFO: `/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c/users/5c084bc63b094b66b3216867a5f0dfd7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.499609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c2e19e092f458d8d0eb562cc7e273c, user_id=5c084bc63b094b66b3216867a5f0dfd7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.503524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.523601 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3688/7356] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:58 2021] PUT /identity/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c/users/5c084bc63b094b66b3216867a5f0dfd7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:58.528513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.544970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf1dd-65f5-4d2a-862a-fdccda15128b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.625253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.626083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.626469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.626859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.627966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.631320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3f786-b84a-4d44-b146-39887ee44748 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.649193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.649725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3669/7357] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:21:58 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:58.664207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be87da-ec62-4a04-96dc-fd9ded6c344c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.670905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.672481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.672900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.673284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] PATH_INFO: `/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c/users/5c084bc63b094b66b3216867a5f0dfd7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.676088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c2e19e092f458d8d0eb562cc7e273c, user_id=5c084bc63b094b66b3216867a5f0dfd7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.679729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.706371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.707135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.707698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.709341 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3689/7358] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:21:58 2021] PUT /identity/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c/users/5c084bc63b094b66b3216867a5f0dfd7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:58.739338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] MFA Rules not processed for user `5c084bc63b094b66b3216867a5f0dfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:21:58.740943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:21:58.865655 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3670/7359] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:21:58 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:21:58.870010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.887395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ada5f-0a21-4a7d-8130-d3874810d7cf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:58.921760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:58.922454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:58.922737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:58.924525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:58.926807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:58.930670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:58.969145 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3690/7360] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:58 2021] POST /identity/v3/services => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:58.972985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:58.982962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2a187-e468-4bf6-a4a4-7dc49d751d7f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.004586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.005864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.006238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.006587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.007891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.010167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.031689 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1817120209. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:59.031689 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:59.031689 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:59.063432 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3671/7361] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:58 2021] POST /identity/v3/endpoints => generated 361 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:59.066579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.079317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be073f2-a6d7-4dd8-8d0b-2c60f8575bcd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.099960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.101436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.101740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.101972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1817120209` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.102686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1817120209)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.103755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.120492 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3691/7362] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/regions/tempest-region-1817120209 => generated 180 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:59.120708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.136829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc896c9-9493-4e07-8485-0d89152b1344 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.159729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.160413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.160723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.161000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.161757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.163340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.186975 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3672/7363] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:21:59 2021] POST /identity/v3/services => generated 287 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:21:59.190631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.206888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9c87-dcd3-4e7a-a812-98d40168f487 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.226764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.227439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.227864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.228140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.230479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.232307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.254751 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1133077617. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:59.254751 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:59.254751 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:59.305308 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3692/7364] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:59 2021] POST /identity/v3/endpoints => generated 362 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:59.312339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.327832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2d29-36d5-4ba6-bef7-b26950c9e9e6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.351452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.353115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.353628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.354124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1133077617` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.356893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1133077617)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.358732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.362187 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3673/7365] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/regions/tempest-region-1133077617 => generated 180 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:59.369621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.386206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dec3d3-ed88-496d-abb1-f32b1b95d67f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.393713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.394784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.395121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.395728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.397452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.404531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.447828 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1056103296. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:59.447828 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:59.447828 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:21:59.487647 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3693/7366] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:21:59 2021] POST /identity/v3/endpoints => generated 361 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:21:59.489490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.501507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721b7c-a9f4-4f7e-9996-f74cbe1ed93e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.531325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.532307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.532809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.533607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1056103296` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.534604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1056103296)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.543252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.549805 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3674/7367] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/regions/tempest-region-1056103296 => generated 180 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:59.550061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.574330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528fd7f-435d-4e0f-a7dc-d8b972c1a4b1 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.602377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.603062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.603522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.603795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.604954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.606804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.617670 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3694/7368] 10.222.0.13 () {58 vars in 1133 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints => generated 4388 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:59.621682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.633781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2356c-afd2-4ad4-8bd4-2649eae6ed23 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.648287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.649487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.649781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.650058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.665448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=9828f7c7c7904aa9b04df33404a150d1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.666813 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:21:59.666813 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:21:59.666813 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:59.667705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.670498 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3675/7369] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1 => generated 361 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:59.674579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.684517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c99a1-51fb-49db-999c-8313f20b279b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.699116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.700212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.700716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.701165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.703590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9828f7c7c7904aa9b04df33404a150d1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.705433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.730394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9828f7c7c7904aa9b04df33404a150d1', 'request_id': 'req-25b0c14b-acf9-4afa-a327-b93835d4b890'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:21:59.746100 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3695/7370] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:21:59 2021] DELETE /identity/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:21:59.747673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.758340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a286-5fa6-469a-b537-27ec8e0199b6 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.785477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.786779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.787116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.787491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.788643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.791027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.801901 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3676/7371] 10.222.0.13 () {58 vars in 1133 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints => generated 4040 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:59.807018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.820375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c14b-acf9-4afa-a327-b93835d4b890 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.830847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.831857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.832324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.832826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.840268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:21:59.849857 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Could not find endpoint: 9828f7c7c7904aa9b04df33404a150d1.: keystone.exception.EndpointNotFound: Could not find endpoint: 9828f7c7c7904aa9b04df33404a150d1. Nov 10 04:21:59.851594 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3696/7372] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:21:59 2021] DELETE /identity/v3/endpoints/9828f7c7c7904aa9b04df33404a150d1 => generated 114 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:21:59.856129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.868199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800bd2f-df1f-488c-8f9d-c27969805d52 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.874420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.875394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.875838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.876129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1056103296` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.876999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1056103296)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.878706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.891678 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1056103296. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:21:59.891678 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:21:59.891678 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:21:59.902871 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3677/7373] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:21:59 2021] DELETE /identity/v3/regions/tempest-region-1056103296 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:21:59.909769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.920237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b62de3-36e3-43c1-a04d-a13adb431b3b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.938766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.939650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.939925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.940194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.940964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.942766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.955961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.956369 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3697/7374] 10.222.0.13 () {58 vars in 1133 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints => generated 4040 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:21:59.968485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98facaa-3519-435c-ba5c-bfefb575107f tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:21:59.974115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:21:59.974802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:21:59.975081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:21:59.975351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:21:59.976088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Adding query filter params (service_id=1c7ff3fc7b6e41d8bd242cedc950712f) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:21:59.976388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:21:59.978164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:21:59.985403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3678/7375] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints?service_id=1c7ff3fc7b6e41d8bd242cedc950712f => generated 503 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:21:59.989390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:21:59.999200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9686-5032-47ae-b466-56d398714b2b tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.004809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.005457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.005734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.006004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.006734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Adding query filter params (service_id=686b730899834e119b6a047c22aa30b7) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:00.007034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.008695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.016435 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3698/7376] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:21:59 2021] GET /identity/v3/endpoints?service_id=686b730899834e119b6a047c22aa30b7 => generated 504 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:00.020406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.031124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4a70-d8f5-4025-9b38-227e7422d28c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.036042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.036835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.037195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.037523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.038356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:00.038748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.040438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.053556 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3679/7377] 10.222.0.13 () {58 vars in 1166 bytes} [Wed Nov 10 04:22:00 2021] GET /identity/v3/endpoints?interface=public => generated 3396 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:00.055180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.066099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3fa94-d235-4eca-8b0a-2cbad825698e tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.072655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.073279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.073561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.073838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.074777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:00.075093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.078459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.088745 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3699/7378] 10.222.0.13 () {58 vars in 1170 bytes} [Wed Nov 10 04:22:00 2021] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:00.097903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.108850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ca17-9e57-42ca-bac6-11acee6dfdbf tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.113696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.114430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.114928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.115290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.116100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.117811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.137192 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3680/7379] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:00 2021] POST /identity/v3/services => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:00.141602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.154074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1eee-4309-47ce-a500-9a1b096ccde7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.172014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.172765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.173050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.173325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.174090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.175680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.194134 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-431428124. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:22:00.194134 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:22:00.194134 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:22:00.223634 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3700/7380] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Nov 10 04:22:00 2021] POST /identity/v3/endpoints => generated 358 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:00.227510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.239336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612765-ae12-4a97-97eb-ebf3286c185d tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.258816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.259666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.259959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.260235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-431428124` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.260948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-431428124)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.262210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.265660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3681/7381] 10.222.0.13 () {58 vars in 1202 bytes} [Wed Nov 10 04:22:00 2021] GET /identity/v3/regions/tempest-region-431428124 => generated 178 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:00.269220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.281699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449c47-2d82-404b-9518-05647294bf82 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.287509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.288380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.288692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.288967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/524a53cd05b84ff8a7c99f9fb581eb5e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.295030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=524a53cd05b84ff8a7c99f9fb581eb5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.296746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.315274 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1793328983. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:22:00.315274 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:22:00.315274 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:22:00.354115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3701/7382] 10.222.0.13 () {60 vars in 1255 bytes} [Wed Nov 10 04:22:00 2021] PATCH /identity/v3/endpoints/524a53cd05b84ff8a7c99f9fb581eb5e => generated 364 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:00.355295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.366048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c49b6-8c18-473e-a684-9200ae76a387 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.383104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.384135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.384422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.384729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1793328983` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.385405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1793328983)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.386558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.389359 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3682/7383] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:22:00 2021] GET /identity/v3/regions/tempest-region-1793328983 => generated 180 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:00.393828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.404838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602f8bc-324f-4962-8329-4751b9a92937 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.410559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.411419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.411699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.411973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/524a53cd05b84ff8a7c99f9fb581eb5e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.417832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=524a53cd05b84ff8a7c99f9fb581eb5e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.419612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.434661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '524a53cd05b84ff8a7c99f9fb581eb5e', 'request_id': 'req-74d15dc0-d604-4d5f-bff0-62c07f0953ab'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.450215 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3702/7384] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/endpoints/524a53cd05b84ff8a7c99f9fb581eb5e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.455213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.466283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4423de-f290-4f1c-adfb-62ff2c0b55f7 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.487496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.488532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.488816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.489461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1793328983` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.490351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1793328983)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.492261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.525496 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1793328983. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:22:00.525496 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:22:00.525496 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:22:00.540452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3683/7385] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/regions/tempest-region-1793328983 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.544925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.560251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15dc0-d604-4d5f-bff0-62c07f0953ab tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.579487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.580376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.580695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.580969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-431428124` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.581935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-431428124)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.583903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.604186 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3703/7386] 10.222.0.13 () {58 vars in 1205 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/regions/tempest-region-431428124 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.608863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.624473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e79624-a53e-42a5-a003-6c4fe9dc513c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.641088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.641958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.642241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.642516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services/a67f4fed212c4f629fa7c3eb2b92983b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.643193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a67f4fed212c4f629fa7c3eb2b92983b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.645060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.671647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3684/7387] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/services/a67f4fed212c4f629fa7c3eb2b92983b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.678815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.682290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.684404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:00.690743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67b15e-6a3c-4e92-9f26-854d0179463c tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.711644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.712976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.713457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.713924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/535c40cff3dc4e70b84eab5b7de196a1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.719970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=535c40cff3dc4e70b84eab5b7de196a1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.721857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.732193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '535c40cff3dc4e70b84eab5b7de196a1', 'request_id': 'req-c4bc2f25-31db-4296-bcee-47fae032e936'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.746657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3704/7388] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/endpoints/535c40cff3dc4e70b84eab5b7de196a1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.751241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.779897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc2f25-31db-4296-bcee-47fae032e936 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.787460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.788757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.789107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.789670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1133077617` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.790462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1133077617)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.794025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.795085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb9e4b-c1d4-463e-984e-31c5d5d4e110 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.820712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.822080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.822294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.822563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] PATH_INFO: `/v3/users/d6964370cbfa41899352ae2097d95922` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.834199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3705/7389] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/regions/tempest-region-1133077617 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.838748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.839449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6964370cbfa41899352ae2097d95922)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.842391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.866679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcf18b-a5bb-402d-9f7f-04013115b4da tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.872812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.873923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.874698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.875212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services/686b730899834e119b6a047c22aa30b7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.876078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_service(service_id=686b730899834e119b6a047c22aa30b7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.877827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.911521 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3706/7390] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/services/686b730899834e119b6a047c22aa30b7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.915551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.918253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6964370cbfa41899352ae2097d95922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.926416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6964370cbfa41899352ae2097d95922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.927245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6964370cbfa41899352ae2097d95922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.927930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6964370cbfa41899352ae2097d95922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.940700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0fa254ec-d3c4-4e4c-8da4-fedf6064e876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6964370cbfa41899352ae2097d95922'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.945892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fb328-406b-4ac7-889f-2642877eda49 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:00.951355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:00.952763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.953150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.953782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/endpoints/52b76f6438b847f48fa077b222ce6dd4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.959037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=52b76f6438b847f48fa077b222ce6dd4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:00.960758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:00.964279 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3685/7391] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/users/d6964370cbfa41899352ae2097d95922 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.967503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:00.968135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:00.968135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:00.972048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '52b76f6438b847f48fa077b222ce6dd4', 'request_id': 'req-a36fc83b-0bff-4ef1-b588-752e64de0594'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:00.983877 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3707/7392] 10.222.0.13 () {58 vars in 1235 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/endpoints/52b76f6438b847f48fa077b222ce6dd4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:00.985992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:00.987352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:00.987841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:00.989793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.014907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc83b-0bff-4ef1-b588-752e64de0594 tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.073243 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3686/7393] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:00 2021] POST /identity/v3/auth/tokens => generated 3363 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:01.081671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.082839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.083295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.083527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.083659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/regions/tempest-region-1817120209` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.084226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1817120209)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.084953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.085850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.099292 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1817120209. To ensure interoperability, identifiers should be a valid uuid. Nov 10 04:22:01.099292 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 10 04:22:01.099292 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:22:01.107446 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3708/7394] 10.222.0.13 () {58 vars in 1208 bytes} [Wed Nov 10 04:22:00 2021] DELETE /identity/v3/regions/tempest-region-1817120209 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:01.112084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.133092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a937c7-df80-43e8-8269-b0ca3ddae5fd tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.138348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c084bc63b094b66b3216867a5f0dfd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2c2e19e092f458d8d0eb562cc7e273c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.139192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.139507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.139786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] PATH_INFO: `/v3/services/1c7ff3fc7b6e41d8bd242cedc950712f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.140570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1c7ff3fc7b6e41d8bd242cedc950712f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.142285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.169828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707aca7-e7be-4c66-8974-63cc0b18c1f7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.176256 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3709/7395] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:01 2021] DELETE /identity/v3/services/1c7ff3fc7b6e41d8bd242cedc950712f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:01.177917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.179628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.188290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.189046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.189663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.189951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.208215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.209619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ddf43-6891-489f-877b-ae1122078bae tempest-EndPointsTestJSON-1123118038 tempest-EndPointsTestJSON-1123118038-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.209760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c86f-cf31-456e-b8c4-dd2130984381 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.214594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.215468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.215752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.216137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] PATH_INFO: `/v3/users/2c14d7265573400bbbf6a60ced36fdfb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.218505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c14d7265573400bbbf6a60ced36fdfb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.219886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.225975 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3687/7396] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:01.290585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c14d7265573400bbbf6a60ced36fdfb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.300165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c14d7265573400bbbf6a60ced36fdfb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.301607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c14d7265573400bbbf6a60ced36fdfb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.319743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c14d7265573400bbbf6a60ced36fdfb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.331054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c14d7265573400bbbf6a60ced36fdfb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.338774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3710/7397] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:01 2021] DELETE /identity/v3/users/2c14d7265573400bbbf6a60ced36fdfb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:01.344032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.344439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.344895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.372833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:01.374186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.442497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.444015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.476782 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3688/7398] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:01.487606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.491990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.562759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c0e5-0a28-4bda-a740-00bcae27c38f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.572085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.574787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.575296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.575783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] PATH_INFO: `/v3/projects/5f0086badb384462a555d4217768d9c9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.576479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce02636-906f-4e60-b641-e734aea6e52a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.577941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0086badb384462a555d4217768d9c9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.580308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.582803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.583863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.584389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.584894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.598109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.599760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d48ce4-1632-4d23-a0e0-2b0b83d5c331 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.613113 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3689/7399] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:01.665701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0086badb384462a555d4217768d9c9', 'request_id': 'req-32f948cf-f11f-4250-91aa-8032ef88a585'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.674444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0086badb384462a555d4217768d9c9', 'request_id': 'req-32f948cf-f11f-4250-91aa-8032ef88a585'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.682906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0086badb384462a555d4217768d9c9', 'request_id': 'req-32f948cf-f11f-4250-91aa-8032ef88a585'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.697921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] The token cache is being invalidate because project 5f0086badb384462a555d4217768d9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:01.698255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.699293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-32f948cf-f11f-4250-91aa-8032ef88a585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:01.703990 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3711/7400] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:01 2021] DELETE /identity/v3/projects/5f0086badb384462a555d4217768d9c9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:01.710010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.710298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.710580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.739850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:01.742048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.871468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3690/7401] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:01.873319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.873608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.874421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.893806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:01.895189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.904033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3712/7402] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:01.908304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.919551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef4c8-d35e-4023-9704-69b917826661 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.925568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.926366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.926653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.927081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.927970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:01.928320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.930254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.948837 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3691/7403] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:01.950359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.955033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:01.958810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:01.963917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dcffb-a51e-43bd-9279-3a950325d1e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.975674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.979188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e621859-fac6-4b42-ae1e-793e694325b7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:01.979486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.979865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.980235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.981398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.984573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:01.986510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:01.987612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:01.988030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:01.988341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] PATH_INFO: `/v3/projects/0a21737bf8b04c24b5a6bd80650ef570` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:01.989750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a21737bf8b04c24b5a6bd80650ef570)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:01.992975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.029644 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3713/7404] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:01 2021] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:02.030918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.065909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a21737bf8b04c24b5a6bd80650ef570', 'request_id': 'req-720d6514-5492-46d1-8611-c0050cf7f591'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.073488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a21737bf8b04c24b5a6bd80650ef570', 'request_id': 'req-720d6514-5492-46d1-8611-c0050cf7f591'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.085827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a21737bf8b04c24b5a6bd80650ef570', 'request_id': 'req-720d6514-5492-46d1-8611-c0050cf7f591'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.113021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] The token cache is being invalidate because project 0a21737bf8b04c24b5a6bd80650ef570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:02.113313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.113996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.116580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3692/7405] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:01 2021] DELETE /identity/v3/projects/0a21737bf8b04c24b5a6bd80650ef570 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:02.120503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.122115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:02.136242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc264b8-8970-44a1-b7bc-63fd6aee42b2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.224183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.227398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.227847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.228228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.230947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.233095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.279978 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3714/7406] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:02 2021] POST /identity/v3/users => generated 279 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:02.284979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.287073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:02.295091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6514-5492-46d1-8611-c0050cf7f591 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.300856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931ce2-7f40-4583-b451-8654544e96aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.306666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.307502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.307886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.308292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.308516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.309511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.309653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.309857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.310134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] PATH_INFO: `/v3/users/5c084bc63b094b66b3216867a5f0dfd7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.312143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.312594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c084bc63b094b66b3216867a5f0dfd7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.314902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.333079 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3715/7407] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:02.334093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.349870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056b622-b628-48f0-ac66-1eab4b298f35 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.354993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.355704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.356103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.356385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.357216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.359405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.387039 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3716/7408] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:02.389002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.401371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd957-46bc-480f-b8b1-51d253218489 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.407720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.409026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.409026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.409473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] PATH_INFO: `/v3/projects/9fe56311d43a41599ccab741fce8fd46/users/2223e4497dc54e88b4092dd8f20d52d7/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.414858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c084bc63b094b66b3216867a5f0dfd7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.422715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c084bc63b094b66b3216867a5f0dfd7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.423442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c084bc63b094b66b3216867a5f0dfd7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.424063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c084bc63b094b66b3216867a5f0dfd7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.444562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe56311d43a41599ccab741fce8fd46, user_id=2223e4497dc54e88b4092dd8f20d52d7, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.448589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808df6d-4d43-40a8-883c-d3f29ed80083 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.449097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c084bc63b094b66b3216867a5f0dfd7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:02.470505 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3717/7409] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:02 2021] PUT /identity/v3/projects/9fe56311d43a41599ccab741fce8fd46/users/2223e4497dc54e88b4092dd8f20d52d7/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:02.483792 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3693/7410] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:02 2021] DELETE /identity/v3/users/5c084bc63b094b66b3216867a5f0dfd7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:02.484032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.484032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.484032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.518567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] MFA Rules not processed for user `2223e4497dc54e88b4092dd8f20d52d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:02.520020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:02.610273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3718/7411] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:02 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:02.614694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.616461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:02.779487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f5cb-7f90-4031-828e-55ed936043d4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.786407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.788315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.788978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.800657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.802265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.820648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:02.867127 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3694/7412] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:02 2021] POST /identity/v3/projects => generated 355 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:02.871248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.888567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb470fa2-fc24-4533-abbd-3f0bf0aa6d20 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:02.899711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:02.901699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:02.965338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:02.966260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:02.966717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:02.966991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:02.968269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:02.970254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.005452 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3719/7413] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:02 2021] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:03.009600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.032530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd5d6-ea2f-4c9c-88e0-3e1a7ec287d8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.033942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfd28-a19c-494d-bd1b-879cab72c699 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.039457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.039655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.040398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.040541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.040751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.040874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.041029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] PATH_INFO: `/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.041144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.041939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.042563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c2e19e092f458d8d0eb562cc7e273c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.043528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.045146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.064989 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3720/7414] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:03.064989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.076761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca7062-b7df-48ff-9b49-cc9805e250f2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.084043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.086660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.086949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.087227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] PATH_INFO: `/v3/projects/a8c033aeca2c40d6894b686bd644e680/users/907dda40d0644679892e18cf1da57f25/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.121013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c033aeca2c40d6894b686bd644e680, user_id=907dda40d0644679892e18cf1da57f25, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.128964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.192915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3721/7415] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:03 2021] PUT /identity/v3/projects/a8c033aeca2c40d6894b686bd644e680/users/907dda40d0644679892e18cf1da57f25/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:03.195907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c2e19e092f458d8d0eb562cc7e273c', 'request_id': 'req-499a0953-663b-4496-9060-f8592ee9e50e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:03.205410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c2e19e092f458d8d0eb562cc7e273c', 'request_id': 'req-499a0953-663b-4496-9060-f8592ee9e50e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:03.208036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.233366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c2e19e092f458d8d0eb562cc7e273c', 'request_id': 'req-499a0953-663b-4496-9060-f8592ee9e50e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:03.250584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] The token cache is being invalidate because project c2c2e19e092f458d8d0eb562cc7e273c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:03.250981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:03.252979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-499a0953-663b-4496-9060-f8592ee9e50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:03.259235 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3695/7416] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:02 2021] DELETE /identity/v3/projects/c2c2e19e092f458d8d0eb562cc7e273c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:03.266120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014602e2-e273-450c-a694-cafa7e47e9bd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.266613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014602e2-e273-450c-a694-cafa7e47e9bd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.267044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014602e2-e273-450c-a694-cafa7e47e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.300211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-014602e2-e273-450c-a694-cafa7e47e9bd None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:03.301714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-014602e2-e273-450c-a694-cafa7e47e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:03.367832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806543cd-0c4b-4658-83e2-4e02cc0bb663 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.382247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.383113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.383409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.383688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.384436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.386762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.392467 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3696/7417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:03.402759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.403262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.403862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.406553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3722/7418] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:03.410450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.412679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:03.434635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:03.437184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:03.438393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd744f7-c35c-47f4-b711-cc12742e9396 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.445516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.447115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.447548 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3697/7419] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:03.447669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.448004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] PATH_INFO: `/v3/projects/a8c033aeca2c40d6894b686bd644e680/users/907dda40d0644679892e18cf1da57f25/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.451480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.457934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c033aeca2c40d6894b686bd644e680, user_id=907dda40d0644679892e18cf1da57f25, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.467232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd522f-e351-4393-993b-f2f0f0528601 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.473656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47952-2836-4213-b1c0-33521492f86e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.485922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.486803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.487508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.487884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.491001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:03.491001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.491646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.508334 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3698/7420] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:03.513008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.515562 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3723/7421] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:03 2021] PUT /identity/v3/projects/a8c033aeca2c40d6894b686bd644e680/users/907dda40d0644679892e18cf1da57f25/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:03.527571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.528089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.528529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.530958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166d36-e6db-42c7-8300-1aa1dcd1e9a5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.586580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] MFA Rules not processed for user `907dda40d0644679892e18cf1da57f25`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:03.588827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:03.654902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.655691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.655975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.656506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.660182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.662637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.704278 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3724/7422] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:03 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:03.704278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.710545 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3699/7423] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:03 2021] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:03.717517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fb161-648c-4103-bde0-5616eda44c8d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.718496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.720636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:03.782515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.783194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.783469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.783739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.784439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.786434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.825481 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3725/7424] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:03 2021] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:03.836403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.848780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1610-0bf7-41a0-a198-ade490f3862b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.854157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.854841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.855307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.855584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.857932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.860119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.871943 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3726/7425] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:03.876048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.882678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60c42-4dd8-42bf-8d70-e54eeefeeeaf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.887011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.887488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0432a8-f311-4855-8dda-1d4ab0b3c454 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.888819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.889443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.889879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.893024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.904099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.904501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.904868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.906140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.909686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.927023 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3727/7426] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:03.928647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:03.944061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118351b-1a56-4cab-86b8-067fa095f951 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:03.951673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:03.953606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:03.954057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:03.954491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] PATH_INFO: `/v3/projects/35c01035e43048eabc5233d53b6d8215/users/0148bbaa9a824340858c9682602c2b90/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:03.973685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c01035e43048eabc5233d53b6d8215, user_id=0148bbaa9a824340858c9682602c2b90, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:03.976635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce3d5-d89b-4523-8636-bedfd4df6bf8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:03.996744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3728/7427] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:03 2021] PUT /identity/v3/projects/35c01035e43048eabc5233d53b6d8215/users/0148bbaa9a824340858c9682602c2b90/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:04.000455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.002129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.010516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.010967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.011557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.016025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3700/7428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:03 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:04.059197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] MFA Rules not processed for user `0148bbaa9a824340858c9682602c2b90`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:04.063439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:04.126843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.141378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ff56-9676-4de7-a84a-554eae2eb7f3 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.200242 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3729/7429] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:04.205904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.218564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.219308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.219663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.220005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.223357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:04.289234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c57c0-e198-46bd-8fcf-1298216125b4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.294567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.295312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.295706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.296048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.296867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.299017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.302701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.304137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.335833 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3701/7430] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:04 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:04.345597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.345799 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3730/7431] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:04.369210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb9b5-2f9a-4185-8772-6c23883ad1d5 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.466046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.467509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.467785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.468199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.468953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.471006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.505981 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3702/7432] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/users => generated 305 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:04.510356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.523347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c03b3-c7ba-43f0-a720-d06401c981ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.529785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.530506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.530788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.531064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.531806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.538178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.555493 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3731/7433] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:04.556680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.567784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359436f-6b6f-426a-8187-bce418946461 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.575554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.576448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.576765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.577074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] PATH_INFO: `/v3/projects/dec6a43e09bd4ed9b5925650c203527f/users/ef2ea0ca2ea54938a2bb47627a762f95/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.593207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec6a43e09bd4ed9b5925650c203527f, user_id=ef2ea0ca2ea54938a2bb47627a762f95, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.595838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.615144 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3703/7434] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:04 2021] PUT /identity/v3/projects/dec6a43e09bd4ed9b5925650c203527f/users/ef2ea0ca2ea54938a2bb47627a762f95/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:04.619151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.630461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83f0ae-6666-4a53-9653-9d8db7321231 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.695158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.695835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.696123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.696385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.697166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.698934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ad7f6-a231-4ee3-ac32-9fa9452b9b43 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.710728 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3732/7435] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:04.715163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.725896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318cb6-fed4-42d3-807b-70baa025c5e6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.730562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.731448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.731723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.731998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] PATH_INFO: `/v3/projects/dec6a43e09bd4ed9b5925650c203527f/users/ef2ea0ca2ea54938a2bb47627a762f95/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.735409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec6a43e09bd4ed9b5925650c203527f, user_id=ef2ea0ca2ea54938a2bb47627a762f95, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.738044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:04.752992 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3704/7436] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:04 2021] PUT /identity/v3/projects/dec6a43e09bd4ed9b5925650c203527f/users/ef2ea0ca2ea54938a2bb47627a762f95/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:04.764109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.764543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.764942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.791654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] MFA Rules not processed for user `ef2ea0ca2ea54938a2bb47627a762f95`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:04.792920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:04.872683 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3733/7437] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:04.879890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.944407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e54b6e-c4a8-4e56-81ea-188115daa7e9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:04.949633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0148bbaa9a824340858c9682602c2b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c01035e43048eabc5233d53b6d8215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:04.950294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:04.950572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:04.950859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:04.951535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:04.957894 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Nov 10 04:22:04.963358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3705/7438] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/projects => generated 136 bytes in 80 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:22:04.965222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:04.989222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9b1d-3325-47f9-b25f-5f8be3d5942c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.001208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.002545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.002985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.003265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.004674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.008498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.015710 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invalid input for field 'name': '' is too short Nov 10 04:22:05.015710 ncdv-817176-1 devstack@keystone.service[96285]: Failed validating 'minLength' in schema['properties']['name']: Nov 10 04:22:05.015710 ncdv-817176-1 devstack@keystone.service[96285]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 10 04:22:05.015710 ncdv-817176-1 devstack@keystone.service[96285]: On instance['name']: Nov 10 04:22:05.015710 ncdv-817176-1 devstack@keystone.service[96285]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 10 04:22:05.017421 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3734/7439] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:22:04 2021] POST /identity/v3/projects => generated 283 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 10 04:22:05.022231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.041682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80168-449f-44f2-b141-1ae7c63429d7 tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.052718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.053673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.053958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.054235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.055263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.059622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.078756 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 10 04:22:05.078756 ncdv-817176-1 devstack@keystone.service[96284]: Failed validating 'maxLength' in schema['properties']['name']: Nov 10 04:22:05.078756 ncdv-817176-1 devstack@keystone.service[96284]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 10 04:22:05.078756 ncdv-817176-1 devstack@keystone.service[96284]: On instance['name']: Nov 10 04:22:05.078756 ncdv-817176-1 devstack@keystone.service[96284]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 10 04:22:05.085426 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3706/7440] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:22:05 2021] POST /identity/v3/projects => generated 412 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 10 04:22:05.090238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.103699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827a35-b97b-47e0-9ae2-5176b74514d7 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.111297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.112913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.113615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.114038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects/dbc385f9952e4b1cb1359f87cb08d0c6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.124001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dbc385f9952e4b1cb1359f87cb08d0c6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.126523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.151842 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Could not find project: dbc385f9952e4b1cb1359f87cb08d0c6.: keystone.exception.ProjectNotFound: Could not find project: dbc385f9952e4b1cb1359f87cb08d0c6. Nov 10 04:22:05.161277 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3735/7441] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:05 2021] DELETE /identity/v3/projects/dbc385f9952e4b1cb1359f87cb08d0c6 => generated 113 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:22:05.162546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.184252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5db9-2228-4071-9f88-792ce2d3eb5d tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.198652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0148bbaa9a824340858c9682602c2b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c01035e43048eabc5233d53b6d8215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.199327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.199613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.199889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.200743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] RBAC: Authorizing `identity:list_projects()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.218889 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Nov 10 04:22:05.220213 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3707/7442] 10.222.0.13 () {58 vars in 1130 bytes} [Wed Nov 10 04:22:05 2021] GET /identity/v3/projects => generated 135 bytes in 58 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:22:05.225382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.241556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89141aa7-4f31-429c-a5c9-5046a3757d78 tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.250543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.251329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.251678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.252187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.257008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.262146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.315132 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3736/7443] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:05 2021] POST /identity/v3/projects => generated 359 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:05.319736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.335128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087acc9-dc15-45bf-8d31-3c61933ae7cc tempest-ProjectsNegativeStaticTestJSON-62535214 tempest-ProjectsNegativeStaticTestJSON-62535214-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.392679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.393356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.393643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.394255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.394609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.396443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.416645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.sql.core [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1284586814' for key 'project.ixu_project_name_domain_id'") Nov 10 04:22:05.416645 ncdv-817176-1 devstack@keystone.service[96284]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 10 04:22:05.416645 ncdv-817176-1 devstack@keystone.service[96284]: [parameters: {'id': '5efb5453400045eb9cd33aa767b510ce', 'name': 'tempest-project-dup-1284586814', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 10 04:22:05.416645 ncdv-817176-1 devstack@keystone.service[96284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 04:22:05.422466 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1284586814, project id 5efb5453400045eb9cd33aa767b510ce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1284586814, project id 5efb5453400045eb9cd33aa767b510ce. Nov 10 04:22:05.423829 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3708/7444] 10.222.0.13 () {60 vars in 1151 bytes} [Wed Nov 10 04:22:05 2021] POST /identity/v3/projects => generated 285 bytes in 105 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 10 04:22:05.428868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.446989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916502c5-1ca1-4623-825c-28ba8cedcd3e tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.457024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef2ea0ca2ea54938a2bb47627a762f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dec6a43e09bd4ed9b5925650c203527f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.458307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.458687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.458919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] PATH_INFO: `/v3/projects/40302e97c60644d68debc59c9a11ee09` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.460247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=40302e97c60644d68debc59c9a11ee09)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.462967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.566222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40302e97c60644d68debc59c9a11ee09', 'request_id': 'req-bdfc304f-1e22-4464-8a6d-03ff402b5dba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.589457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40302e97c60644d68debc59c9a11ee09', 'request_id': 'req-bdfc304f-1e22-4464-8a6d-03ff402b5dba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.600278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40302e97c60644d68debc59c9a11ee09', 'request_id': 'req-bdfc304f-1e22-4464-8a6d-03ff402b5dba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.627190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] The token cache is being invalidate because project 40302e97c60644d68debc59c9a11ee09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:05.627483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.629401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bdfc304f-1e22-4464-8a6d-03ff402b5dba tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.634785 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3737/7445] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:05 2021] DELETE /identity/v3/projects/40302e97c60644d68debc59c9a11ee09 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:05.640716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:05.643134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:05.723960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd52e0-fdda-4e69-a363-4c209a4ea59b tempest-ProjectsNegativeStaticTestJSON-1607373436 tempest-ProjectsNegativeStaticTestJSON-1607373436-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:05.799019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:05.800056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:05.800460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:05.800865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] PATH_INFO: `/v3/users/0148bbaa9a824340858c9682602c2b90` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:05.802294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0148bbaa9a824340858c9682602c2b90)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:05.804587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:05.915922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0148bbaa9a824340858c9682602c2b90'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.951103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0148bbaa9a824340858c9682602c2b90'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.953955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0148bbaa9a824340858c9682602c2b90'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.956810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0148bbaa9a824340858c9682602c2b90'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:05.973907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0148bbaa9a824340858c9682602c2b90'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:06.019845 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3709/7446] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:05 2021] DELETE /identity/v3/users/0148bbaa9a824340858c9682602c2b90 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:06.024200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da62-307a-4854-a633-3e982688e984 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:06.024819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da62-307a-4854-a633-3e982688e984 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:06.025237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da62-307a-4854-a633-3e982688e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:06.100447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0664da62-307a-4854-a633-3e982688e984 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:06.102772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0664da62-307a-4854-a633-3e982688e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:06.220863 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3738/7447] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:06.241017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:06.242553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:06.333062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed42e7-b179-4b6c-a42a-26ffe15efb78 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:06.341705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:06.342523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:06.342977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:06.343285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:06.359790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:06.361272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:06.373326 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3710/7448] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:07.096296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664da62-307a-4854-a633-3e982688e984 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:07.098114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0664da62-307a-4854-a633-3e982688e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:07.157832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664da62-307a-4854-a633-3e982688e984 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:07.174533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:07.175508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:07.175838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:07.176327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] PATH_INFO: `/v3/projects/35c01035e43048eabc5233d53b6d8215` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:07.177661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c01035e43048eabc5233d53b6d8215)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:07.179645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:07.252300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c01035e43048eabc5233d53b6d8215', 'request_id': 'req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.263824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c01035e43048eabc5233d53b6d8215', 'request_id': 'req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.271708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c01035e43048eabc5233d53b6d8215', 'request_id': 'req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.294371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] The token cache is being invalidate because project 35c01035e43048eabc5233d53b6d8215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:07.294669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.295470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.298717 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3739/7449] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:07 2021] DELETE /identity/v3/projects/35c01035e43048eabc5233d53b6d8215 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:07.303407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:07.314446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc7fdd-b7a1-45f4-9151-71cc2c251b07 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:07.381317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:07.382443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:07.382729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:07.383641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] PATH_INFO: `/v3/users/ef2ea0ca2ea54938a2bb47627a762f95` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:07.385203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2ea0ca2ea54938a2bb47627a762f95)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:07.388649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:07.469172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2ea0ca2ea54938a2bb47627a762f95'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.482994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2ea0ca2ea54938a2bb47627a762f95'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.484632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2ea0ca2ea54938a2bb47627a762f95'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.485408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2ea0ca2ea54938a2bb47627a762f95'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.500827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ed6b1cbe-0f87-4a9f-9f75-d0074d85bdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2ea0ca2ea54938a2bb47627a762f95'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:07.519791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3711/7450] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:07 2021] DELETE /identity/v3/users/ef2ea0ca2ea54938a2bb47627a762f95 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:07.851328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:07.853116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:07.868727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd589d-3c3d-4c1f-a10f-2dd79e31f511 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:07.987456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:07.989410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:07.991543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:07.991833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] PATH_INFO: `/v3/projects/dec6a43e09bd4ed9b5925650c203527f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:07.996359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec6a43e09bd4ed9b5925650c203527f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:07.996359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.046073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec6a43e09bd4ed9b5925650c203527f', 'request_id': 'req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:08.051302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec6a43e09bd4ed9b5925650c203527f', 'request_id': 'req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:08.058178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec6a43e09bd4ed9b5925650c203527f', 'request_id': 'req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:08.072929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] The token cache is being invalidate because project dec6a43e09bd4ed9b5925650c203527f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:08.073259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:08.073877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3ed2921e-798a-4b11-b2e0-59dd3f00e77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:08.075707 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3740/7451] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:07 2021] DELETE /identity/v3/projects/dec6a43e09bd4ed9b5925650c203527f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:08.082050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.082599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.083159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.104096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:08.105427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:08.179786 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3712/7452] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:08.181455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.181886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.182048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.205249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:08.206525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:08.214907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3741/7453] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:08.222556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.245555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90abc88-f00e-4aa5-b2b4-91164674983b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.251547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.255667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.256178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.256681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.257628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:08.258132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.261948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.284671 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3713/7454] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:08.288639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.298520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a16a-c170-49b0-8818-19254a440ef5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.305090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.305741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.306013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.306520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.308144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.310543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.343823 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3742/7455] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:08.348164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.362595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1652-0735-4afd-b68b-def50e4ebd3a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.430280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.431667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.431667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.431667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.432381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.434498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.463171 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3714/7456] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:08.465317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.477662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e629e4b-6dd8-445c-b095-84d8885e3d56 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.484932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.486032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.486491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.486772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.487518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.489407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.525289 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3743/7457] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:08 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:08.527638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.546066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc1d4-561b-43e0-9360-5d35f8259d11 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.554344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.555027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.555311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.555599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.556336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.558964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85b590-ca63-424e-b7c5-f084ecc4fcc4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.577441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3715/7458] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:08 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:08.580938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.595395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a5b1-b3b3-4082-9512-27d367b0b322 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.611162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.612281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.612791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.613225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] PATH_INFO: `/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/f360420440ed47ffbb93ac5d63691df9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.642115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc8ccdb2a184df2b75ffbddc5418160, user_id=f360420440ed47ffbb93ac5d63691df9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.645535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.683239 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3744/7459] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:08 2021] PUT /identity/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/f360420440ed47ffbb93ac5d63691df9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:08.694701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.695359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.695687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.732861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] MFA Rules not processed for user `f360420440ed47ffbb93ac5d63691df9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:08.734883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:08.823046 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3716/7460] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:08.831164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.831795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:08.833332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:08.945412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277e59-349e-4b2b-a521-10ad99c3ae5c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.954942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51feba-bb6d-41ea-8c66-82a8edded804 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:08.955146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.956056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.956340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.956711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] PATH_INFO: `/v3/users/89d53dad7e2b4d0cbeb6703d41da920b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.958246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d53dad7e2b4d0cbeb6703d41da920b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.960413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:08.970862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:08.971685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:08.974640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:08.979463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:08.980341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:08.982383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.044596 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3717/7461] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:08 2021] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:09.049301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.064261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d53dad7e2b4d0cbeb6703d41da920b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.086244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d53dad7e2b4d0cbeb6703d41da920b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.088029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d53dad7e2b4d0cbeb6703d41da920b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.110271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d53dad7e2b4d0cbeb6703d41da920b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.124223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d53dad7e2b4d0cbeb6703d41da920b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.132547 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3745/7462] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:08 2021] DELETE /identity/v3/users/89d53dad7e2b4d0cbeb6703d41da920b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:09.148771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d2-1536-4c9b-a14e-5c889f552624 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.238300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.239030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.239904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.240747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.241633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.247136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.289672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3718/7463] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:09 2021] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:09.291096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.293164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:09.316918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66c31-1556-4ecb-8b88-4f6cdd75accd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.322357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.323406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.323922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.324415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.325440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.327685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.346077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.346939 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3746/7464] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:09 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:09.356753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713037bc-ef55-4f79-90ad-f7a248eb6204 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.364406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.365366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.365944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.366205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] PATH_INFO: `/v3/projects/8fe5355202ed4345860b3c0f85daf346/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.392797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe5355202ed4345860b3c0f85daf346, user_id=abeeba61f1f944a4b2f6789c5b708b86, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.395440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.419897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3719/7465] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:09 2021] PUT /identity/v3/projects/8fe5355202ed4345860b3c0f85daf346/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:09.424005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.435621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4de86-2968-4c7c-b2cc-c8d790e4d760 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.479862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.482710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:09.558066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.559128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.559629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.560163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.561763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.564058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.584813 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3747/7466] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:09 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:09.584813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.596325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fde53-40ae-4415-a65c-f67c6c200005 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.603540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.604805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.605561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.605763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] PATH_INFO: `/v3/projects/8fe5355202ed4345860b3c0f85daf346/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.610399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe5355202ed4345860b3c0f85daf346, user_id=abeeba61f1f944a4b2f6789c5b708b86, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.614295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208a7da-7306-4497-b9e1-fafcc50a7cb8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.637263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3748/7467] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:09 2021] PUT /identity/v3/projects/8fe5355202ed4345860b3c0f85daf346/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:09.648682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.649675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.650150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.669463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366c6c-7ace-4f4d-b440-c33038525ad5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.698173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] MFA Rules not processed for user `abeeba61f1f944a4b2f6789c5b708b86`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:09.699863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:09.766559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.767761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.768358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.769224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] PATH_INFO: `/v3/projects/abc6c1178ce447b7ac33663ea9dea21f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.772272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc6c1178ce447b7ac33663ea9dea21f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.775065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.841483 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3749/7468] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:09 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:09.849313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.863660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc6c1178ce447b7ac33663ea9dea21f', 'request_id': 'req-8efd29d4-fa3d-4452-806b-de1891d92df1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.864904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b610f5-63f1-43f7-a432-a95324a1d169 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.870799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc6c1178ce447b7ac33663ea9dea21f', 'request_id': 'req-8efd29d4-fa3d-4452-806b-de1891d92df1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.878832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc6c1178ce447b7ac33663ea9dea21f', 'request_id': 'req-8efd29d4-fa3d-4452-806b-de1891d92df1'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.899467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] The token cache is being invalidate because project abc6c1178ce447b7ac33663ea9dea21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:09.899961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.900725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:09.905656 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3720/7469] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:09 2021] DELETE /identity/v3/projects/abc6c1178ce447b7ac33663ea9dea21f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:09.906903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:09.909400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:09.954611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:09.955485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:09.956030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:09.956474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:09.958078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:09.960470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:09.993534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd29d4-fa3d-4452-806b-de1891d92df1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:09.996449 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3750/7470] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:09 2021] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:10.001109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.003847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.077346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.078611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.078888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.079289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] PATH_INFO: `/v3/users/ba402aaba0c740449b0652c7fd5ad29b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.081722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba402aaba0c740449b0652c7fd5ad29b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.083383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.135497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e3ecc-9012-45b5-aafc-03b09fac3cff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.144397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.145256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.145665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.146017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.146739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.148858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.151068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba402aaba0c740449b0652c7fd5ad29b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.160500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba402aaba0c740449b0652c7fd5ad29b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.161630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba402aaba0c740449b0652c7fd5ad29b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.162265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba402aaba0c740449b0652c7fd5ad29b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.178742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba402aaba0c740449b0652c7fd5ad29b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.190649 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3751/7471] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:09 2021] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:10.192107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.194473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.210503 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3721/7472] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:09 2021] DELETE /identity/v3/users/ba402aaba0c740449b0652c7fd5ad29b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:10.211528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d821-53eb-4771-99cf-274ae9c2173d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.277217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.277891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.278175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.278491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.279170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.281567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.292258 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3752/7473] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:10 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:10.296905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.306950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a4c6-875c-4c3e-83e1-3e2dc8a9b9b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.312825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.313897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.313897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.314168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.315822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.317480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0a43-41fd-4e3a-83fc-14baea3154b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.333056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3722/7474] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:10.336981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.350432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb241e9-abef-42b8-9c8c-b97d2d62c89a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.356242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.357185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.357458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.357722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] PATH_INFO: `/v3/projects/8d6f6423378b42cdb50df552057cf391/users/a8518c9ac813438cb773403add82865e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.384118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6f6423378b42cdb50df552057cf391, user_id=a8518c9ac813438cb773403add82865e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.387470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.425167 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3753/7475] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:10 2021] PUT /identity/v3/projects/8d6f6423378b42cdb50df552057cf391/users/a8518c9ac813438cb773403add82865e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:10.427069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.427537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.427625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.443937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.445812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.468105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] MFA Rules not processed for user `a8518c9ac813438cb773403add82865e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:10.469178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.546859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca037-06b0-420c-953a-d020a79e3805 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.553255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.554753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.554753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.554753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] PATH_INFO: `/v3/projects/9d062c5f873348faa8ea2297f02c221c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.555974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d062c5f873348faa8ea2297f02c221c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.558078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.565895 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3723/7476] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:10 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:10.573759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.576088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.633789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d062c5f873348faa8ea2297f02c221c', 'request_id': 'req-020b721b-d805-41b7-96d1-6e871c49c336'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.644190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d062c5f873348faa8ea2297f02c221c', 'request_id': 'req-020b721b-d805-41b7-96d1-6e871c49c336'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.654501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d062c5f873348faa8ea2297f02c221c', 'request_id': 'req-020b721b-d805-41b7-96d1-6e871c49c336'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.680381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] The token cache is being invalidate because project 9d062c5f873348faa8ea2297f02c221c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:10.681567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.681567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:10.683532 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3754/7477] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:10 2021] DELETE /identity/v3/projects/9d062c5f873348faa8ea2297f02c221c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:10.686572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9682c-269a-403e-ae2a-0a8a9a530e5b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.800896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.807673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:10.807673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:10.807673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:10.807673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:10.807673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:10.845540 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3724/7478] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:22:10 2021] POST /identity/v3/domains => generated 274 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:10.848845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:10.852228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:10.870921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b721b-d805-41b7-96d1-6e871c49c336 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:10.999079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:10.999769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.000045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.000330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.002567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.005395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.030932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3755/7479] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:10 2021] POST /identity/v3/roles => generated 239 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:11.032817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.047315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3d507-c091-4cd9-aa81-811ef4713c77 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.054634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.055668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.056035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.056313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/34911c539ddc4723a2b9cfd68003d228/users/a8518c9ac813438cb773403add82865e/roles/b9c88c8903f44482b8747e64d0d48c13` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.078025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=34911c539ddc4723a2b9cfd68003d228, user_id=a8518c9ac813438cb773403add82865e, role_id=b9c88c8903f44482b8747e64d0d48c13)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.083572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.085433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:11.088913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.117923 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3725/7480] 10.222.0.13 () {60 vars in 1479 bytes} [Wed Nov 10 04:22:11 2021] PUT /identity/v3/domains/34911c539ddc4723a2b9cfd68003d228/users/a8518c9ac813438cb773403add82865e/roles/b9c88c8903f44482b8747e64d0d48c13 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:11.118989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.191535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa7f1-0a21-401f-a7ab-dc88d49636a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.212292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b7450-f061-47f3-8ba5-dfd1371505cb tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.217014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.218348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.218818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.219038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.219781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.221389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.236546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3726/7481] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/domains => generated 274 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:11.240515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.250763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.251615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.251891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.252170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] PATH_INFO: `/v3/users/0560155ce3fa4092900d08c639ec9733` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.253409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0560155ce3fa4092900d08c639ec9733)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.255288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.301996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0560155ce3fa4092900d08c639ec9733'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:11.302647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a4ad-a7fc-4391-9ffb-9526cb093c67 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.306986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.307651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.307935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.308213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.308518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0560155ce3fa4092900d08c639ec9733'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:11.309141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.309324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0560155ce3fa4092900d08c639ec9733'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:11.310719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.321729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0560155ce3fa4092900d08c639ec9733'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:11.324123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3727/7482] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/roles => generated 240 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:11.329204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.330631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-48f4bed4-36d5-4c34-a2bd-15fec450f466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0560155ce3fa4092900d08c639ec9733'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:11.336925 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3756/7483] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:11 2021] DELETE /identity/v3/users/0560155ce3fa4092900d08c639ec9733 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:11.338810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56851d-2b1a-48e9-bbb5-cbcb47e2b044 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.341050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.341335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.341611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.359022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:11.360411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:11.393529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.394238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.394522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.394802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.395507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.397456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.417842 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3757/7484] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:11.427382 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3728/7485] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/groups => generated 324 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:11.427844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.428348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.429012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:11.429980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:11.441766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5b31-64bb-4469-9f5d-a777819f4c83 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.446479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.447357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.447641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.447919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/74f036f17f5a4024a8871809639be630/users/a8518c9ac813438cb773403add82865e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.454011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=74f036f17f5a4024a8871809639be630, user_id=a8518c9ac813438cb773403add82865e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.455888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.480006 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3729/7486] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:22:11 2021] PUT /identity/v3/groups/74f036f17f5a4024a8871809639be630/users/a8518c9ac813438cb773403add82865e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:11.484107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.486945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fab2-70e3-4ab6-a52e-868433553a8a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.536136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.536803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.537080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.537362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.541924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ea1d-0468-41f9-b429-2a15784a7a0b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.546755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.547600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.547874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.548147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/0e630e59848b49538f934a0f42311ff6/groups/74f036f17f5a4024a8871809639be630/roles/e10b95e91f504253854d818b5a0cf022` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.550449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0e630e59848b49538f934a0f42311ff6, group_id=74f036f17f5a4024a8871809639be630, role_id=e10b95e91f504253854d818b5a0cf022)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.553063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.569011 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3730/7487] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:11 2021] PUT /identity/v3/domains/0e630e59848b49538f934a0f42311ff6/groups/74f036f17f5a4024a8871809639be630/roles/e10b95e91f504253854d818b5a0cf022 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:11.572735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.611595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.613106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.623338 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3758/7488] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:11.649828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730f2da-a8fa-4bf7-8e55-7c563bb9e7e9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.649828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.649828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.650186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.650186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.650186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.651141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.672592 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3731/7489] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/domains => generated 276 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:11.677672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.689296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff04a-fb6e-4b1b-9117-038aace0d3bd service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.752103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.752947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.753279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.753645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.757250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.758907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.775002 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3759/7490] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/roles => generated 240 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:11.779154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.790917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c259-c2ba-4c66-a7e2-ac92e4991cbc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.807017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.808272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.808637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.809697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/ace0f17de7da4ec2a384862b967cd3f5/users/a8518c9ac813438cb773403add82865e/roles/99cd8092005d49bba5783d83e99fb06c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.831686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.833851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:11.844373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ace0f17de7da4ec2a384862b967cd3f5, user_id=a8518c9ac813438cb773403add82865e, role_id=99cd8092005d49bba5783d83e99fb06c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.847022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.863511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3732/7491] 10.222.0.13 () {60 vars in 1479 bytes} [Wed Nov 10 04:22:11 2021] PUT /identity/v3/domains/ace0f17de7da4ec2a384862b967cd3f5/users/a8518c9ac813438cb773403add82865e/roles/99cd8092005d49bba5783d83e99fb06c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:11.868103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.919410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d2f4-04bc-4065-82ca-7d27f95250a8 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.944174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769c13-c806-4eb5-bb1c-61a19c498aff tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:11.950651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.952296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.952806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.953534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.954358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:11.956126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:11.973131 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3733/7492] 10.222.0.13 () {60 vars in 1148 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/domains => generated 275 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:11.988672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:11.989474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:11.990423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:11.990708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] PATH_INFO: `/v3/projects/f813ea80b57c4adeb2a4c5c0c7866ff2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:11.991486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:11.992136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f813ea80b57c4adeb2a4c5c0c7866ff2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.002103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.080923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f813ea80b57c4adeb2a4c5c0c7866ff2', 'request_id': 'req-932ae4de-1db2-423b-a5ef-55e95005121b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.089549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f813ea80b57c4adeb2a4c5c0c7866ff2', 'request_id': 'req-932ae4de-1db2-423b-a5ef-55e95005121b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.096045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f813ea80b57c4adeb2a4c5c0c7866ff2', 'request_id': 'req-932ae4de-1db2-423b-a5ef-55e95005121b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.100382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9abba-119d-493d-bf8c-8b29b0334ef3 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.110334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] The token cache is being invalidate because project f813ea80b57c4adeb2a4c5c0c7866ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:12.110623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.111518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-932ae4de-1db2-423b-a5ef-55e95005121b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.113159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3760/7493] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:11 2021] DELETE /identity/v3/projects/f813ea80b57c4adeb2a4c5c0c7866ff2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:12.118678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93895-4fce-48e4-8433-73fb6386ae0c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.118975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93895-4fce-48e4-8433-73fb6386ae0c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.119448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93895-4fce-48e4-8433-73fb6386ae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.138587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8ea93895-4fce-48e4-8433-73fb6386ae0c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:12.139846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ea93895-4fce-48e4-8433-73fb6386ae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.158774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.159443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.159725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.160003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.161018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.162624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.179603 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3734/7494] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:11 2021] POST /identity/v3/roles => generated 239 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:12.180977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.182688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.195497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54868d-607a-4d76-9662-f14f26aaeb0f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.200467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.201157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.201441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.201752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.202453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.203992 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3761/7495] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:12.204765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.211605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.212031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.212318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.230153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3735/7496] 10.222.0.13 () {60 vars in 1146 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/groups => generated 326 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:12.234600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.235407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:12.236635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.245420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db53a4-424e-40c6-94b7-b1143c107d71 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.245584 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3762/7497] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:12.249983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.250895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.251789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.252190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.252478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/cc54a45577b14151b4a2b2aada7b3e82/users/a8518c9ac813438cb773403add82865e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.258336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cc54a45577b14151b4a2b2aada7b3e82, user_id=a8518c9ac813438cb773403add82865e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.259499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2917-ab5f-41b4-8840-573c4d3fd132 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.260446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.264973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.265145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.265395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.265667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.266428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:12.266735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.268353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.281034 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3763/7498] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:12.285492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.289359 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3736/7499] 10.222.0.13 () {60 vars in 1359 bytes} [Wed Nov 10 04:22:12 2021] PUT /identity/v3/groups/cc54a45577b14151b4a2b2aada7b3e82/users/a8518c9ac813438cb773403add82865e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:12.290613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.296830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32046-33ab-4012-852b-05f043269908 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.358518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecc6-19e1-4fc5-a4bd-90e0f55a0062 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.361735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.362391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.362659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.362937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.363702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.364495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.365530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.365660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.366111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.366505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/e506079d0c66498193312f5e5a1b3ad5/groups/cc54a45577b14151b4a2b2aada7b3e82/roles/e8bc2434503a4ec0bf2366cb63d96b91` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.369141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e506079d0c66498193312f5e5a1b3ad5, group_id=cc54a45577b14151b4a2b2aada7b3e82, role_id=e8bc2434503a4ec0bf2366cb63d96b91)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.371849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.388518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3737/7500] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:12 2021] PUT /identity/v3/domains/e506079d0c66498193312f5e5a1b3ad5/groups/cc54a45577b14151b4a2b2aada7b3e82/roles/e8bc2434503a4ec0bf2366cb63d96b91 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:12.391845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.393651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.400600 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3764/7501] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:12.401442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.470886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e174-6212-4170-b8d5-3e3990a06a45 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.475862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.476602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.476951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.477183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.477841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.479870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.500295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a6b0-af5e-4981-8ef8-34c59aaca1e7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.506130 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3765/7502] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:12.507002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.522480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7525-f960-4609-a8c0-dc1ee5997937 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.530652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.531374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.531710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.531998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.532946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.534954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.549524 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3766/7503] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:12 2021] GET /identity/v3/roles => generated 2342 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:12.553545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.570877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4733e3-3a19-49bf-b03c-f6aee654ff96 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.577420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.578591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.578962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.579327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.580165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.582303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.597459 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3767/7504] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:12 2021] GET /identity/v3/roles => generated 2342 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:12.602926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.614013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85369a67-d7a2-48f4-a110-e023b78f837f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.618812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.619683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.619826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8518c9ac813438cb773403add82865e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d6f6423378b42cdb50df552057cf391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.619960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.620221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] PATH_INFO: `/v3/projects/176bc68cd6964608810431825053e026/users/bdc19dafb51b4f27b15011e991ed229b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.620877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.621162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.621640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] PATH_INFO: `/v3/auth/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.622378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.623571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.637599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=176bc68cd6964608810431825053e026, user_id=bdc19dafb51b4f27b15011e991ed229b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.640533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99796a-5bbb-435d-86d8-3c845ac87cec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.656207 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3768/7505] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:12 2021] PUT /identity/v3/projects/176bc68cd6964608810431825053e026/users/bdc19dafb51b4f27b15011e991ed229b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:12.667338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.667623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.667901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.697404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] MFA Rules not processed for user `bdc19dafb51b4f27b15011e991ed229b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:12.699861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.701282 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3738/7506] 10.222.0.13 () {58 vars in 1142 bytes} [Wed Nov 10 04:22:12 2021] GET /identity/v3/auth/domains => generated 1167 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:12.702185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.776192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1124e-576c-48cb-9d33-51bab7f97d47 tempest-TokensV3TestJSON-1339157343 tempest-TokensV3TestJSON-1339157343-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.776988 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3769/7507] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:12 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:12.787697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.789220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.840701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.841664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.842015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.842922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/e506079d0c66498193312f5e5a1b3ad5/groups/cc54a45577b14151b4a2b2aada7b3e82/roles/e8bc2434503a4ec0bf2366cb63d96b91` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.845277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e506079d0c66498193312f5e5a1b3ad5, group_id=cc54a45577b14151b4a2b2aada7b3e82, role_id=e8bc2434503a4ec0bf2366cb63d96b91)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.847966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.849482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcf76d-a1b8-4333-b4d7-d62d61dc4608 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.853332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.853479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role e8bc2434503a4ec0bf2366cb63d96b91 was removed from group cc54a45577b14151b4a2b2aada7b3e82 on domain e506079d0c66498193312f5e5a1b3ad5. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:12.853642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.854170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.854303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.854574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.854844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.856686 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.867606 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3739/7508] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 04:22:12 2021] DELETE /identity/v3/domains/e506079d0c66498193312f5e5a1b3ad5/groups/cc54a45577b14151b4a2b2aada7b3e82/roles/e8bc2434503a4ec0bf2366cb63d96b91 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:12.868083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.869547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.871583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.872996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:12.878518 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3770/7509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:12 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:12.935117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6f4f-ec17-46ef-90a4-16002d546c8b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:12.940975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:12.941863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:12.942144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:12.942418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/cc54a45577b14151b4a2b2aada7b3e82/users/a8518c9ac813438cb773403add82865e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:12.944508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cc54a45577b14151b4a2b2aada7b3e82, user_id=a8518c9ac813438cb773403add82865e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:12.945409 ncdv-817176-1 devstack@keystone.service[96284]: WARNING py.warnings [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:remove_user_from_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:22:12.945409 ncdv-817176-1 devstack@keystone.service[96284]: warnings.warn(msg) Nov 10 04:22:12.945409 ncdv-817176-1 devstack@keystone.service[96284]: Nov 10 04:22:12.946652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:12.956264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:12.971307 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3740/7510] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 04:22:12 2021] DELETE /identity/v3/groups/cc54a45577b14151b4a2b2aada7b3e82/users/a8518c9ac813438cb773403add82865e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:12.975406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:12.986418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448faa2-3819-48f6-98a6-cd8224873cc2 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.045104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.046089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.046466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.046833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/cc54a45577b14151b4a2b2aada7b3e82` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.048163 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cc54a45577b14151b4a2b2aada7b3e82)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.050177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:13.131751 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3771/7511] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:22:12 2021] DELETE /identity/v3/groups/cc54a45577b14151b4a2b2aada7b3e82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:13.135623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:13.152058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bbdbe-cfd1-4683-a09a-2fc0f9bada41 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.220854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.223597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.223939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.224407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles/e8bc2434503a4ec0bf2366cb63d96b91` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.226559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e8bc2434503a4ec0bf2366cb63d96b91)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.229271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:13.281160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role e8bc2434503a4ec0bf2366cb63d96b91 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:13.281506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.282812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.286979 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3741/7512] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:13 2021] DELETE /identity/v3/roles/e8bc2434503a4ec0bf2366cb63d96b91 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:13.292355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:13.295772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:13.312779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462976b2-bef6-4164-832f-bc777d9cde63 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.387694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.388584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.388874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.389895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/e506079d0c66498193312f5e5a1b3ad5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.391241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e506079d0c66498193312f5e5a1b3ad5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.392871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:13.415710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.416500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.457386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.458092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.465657 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3772/7513] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:13 2021] PATCH /identity/v3/domains/e506079d0c66498193312f5e5a1b3ad5 => generated 276 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:13.469629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:13.480332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af6b7-68aa-44f4-85d9-44f521874edc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.567661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.568670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.569156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.569426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/e506079d0c66498193312f5e5a1b3ad5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.582011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e506079d0c66498193312f5e5a1b3ad5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.585494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:13.611296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.624258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.679809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.689423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.704473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.720072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project e506079d0c66498193312f5e5a1b3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:13.720407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.721167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.730833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.736966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.739384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e506079d0c66498193312f5e5a1b3ad5', 'request_id': 'req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.750179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3742/7514] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:13 2021] DELETE /identity/v3/domains/e506079d0c66498193312f5e5a1b3ad5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:13.751313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:13.753328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:13.769622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35a1c-7ee4-4008-8cf7-2a84d5f11f2c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.843975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.845215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.845930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.846176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/ace0f17de7da4ec2a384862b967cd3f5/users/a8518c9ac813438cb773403add82865e/roles/99cd8092005d49bba5783d83e99fb06c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.848510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ace0f17de7da4ec2a384862b967cd3f5, user_id=a8518c9ac813438cb773403add82865e, role_id=99cd8092005d49bba5783d83e99fb06c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.851245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:13.861811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role 99cd8092005d49bba5783d83e99fb06c was removed from user a8518c9ac813438cb773403add82865e on domain ace0f17de7da4ec2a384862b967cd3f5. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:13.862373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.863107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:13.886928 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3773/7515] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 04:22:13 2021] DELETE /identity/v3/domains/ace0f17de7da4ec2a384862b967cd3f5/users/a8518c9ac813438cb773403add82865e/roles/99cd8092005d49bba5783d83e99fb06c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:13.891557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:13.894754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:13.909461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a283-fa79-4b4c-9974-6cfa6b2b18d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:13.986949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:13.988262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:13.988589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:13.989141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles/99cd8092005d49bba5783d83e99fb06c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:13.990962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_role(role_id=99cd8092005d49bba5783d83e99fb06c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:13.993326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.038650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role 99cd8092005d49bba5783d83e99fb06c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:14.039039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.046087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.052043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3743/7516] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:13 2021] DELETE /identity/v3/roles/99cd8092005d49bba5783d83e99fb06c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:14.053444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:14.058901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:14.074936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2d4c-64fa-4fda-853d-6b76570a7491 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:14.152395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:14.153536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:14.153856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:14.154087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/ace0f17de7da4ec2a384862b967cd3f5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:14.155996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ace0f17de7da4ec2a384862b967cd3f5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:14.157641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.180821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.181643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.215868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.221004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.224477 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3774/7517] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:14 2021] PATCH /identity/v3/domains/ace0f17de7da4ec2a384862b967cd3f5 => generated 277 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:14.229256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:14.230689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:14.246656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa23ed-dfcf-425f-b3e3-4b72ca5534d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:14.304974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:14.305824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:14.306102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:14.306375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/ace0f17de7da4ec2a384862b967cd3f5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:14.318553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ace0f17de7da4ec2a384862b967cd3f5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:14.320178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.347419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.358704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.410888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.416932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.424798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.441275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project ace0f17de7da4ec2a384862b967cd3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:14.441597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.442291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.452351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.455948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.456860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ace0f17de7da4ec2a384862b967cd3f5', 'request_id': 'req-994539d4-3993-401f-a17c-f9e2871b56d6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.463986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3744/7518] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:14 2021] DELETE /identity/v3/domains/ace0f17de7da4ec2a384862b967cd3f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:14.469179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:14.470657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:14.485815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52bcca-617e-4841-8ddc-d0b81f128e47 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:14.556394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:14.557334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:14.557761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:14.558100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/0e630e59848b49538f934a0f42311ff6/groups/74f036f17f5a4024a8871809639be630/roles/e10b95e91f504253854d818b5a0cf022` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:14.560969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0e630e59848b49538f934a0f42311ff6, group_id=74f036f17f5a4024a8871809639be630, role_id=e10b95e91f504253854d818b5a0cf022)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:14.564936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.571374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role e10b95e91f504253854d818b5a0cf022 was removed from group 74f036f17f5a4024a8871809639be630 on domain 0e630e59848b49538f934a0f42311ff6. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:14.571670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.572517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.591053 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3775/7519] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 04:22:14 2021] DELETE /identity/v3/domains/0e630e59848b49538f934a0f42311ff6/groups/74f036f17f5a4024a8871809639be630/roles/e10b95e91f504253854d818b5a0cf022 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:14.595101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:14.596532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:14.628231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994539d4-3993-401f-a17c-f9e2871b56d6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:14.707643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:14.709420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:14.711014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:14.713412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/74f036f17f5a4024a8871809639be630/users/a8518c9ac813438cb773403add82865e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:14.718915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=74f036f17f5a4024a8871809639be630, user_id=a8518c9ac813438cb773403add82865e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:14.721599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.734945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:14.760278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:14.762576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:14.772925 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3745/7520] 10.222.0.13 () {58 vars in 1343 bytes} [Wed Nov 10 04:22:14 2021] DELETE /identity/v3/groups/74f036f17f5a4024a8871809639be630/users/a8518c9ac813438cb773403add82865e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:14.781651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725fba-7c19-495e-8aaa-ca65b2df63ac tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:14.875275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:14.876539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:14.876929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:14.877281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/groups/74f036f17f5a4024a8871809639be630` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:14.879087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_group(group_id=74f036f17f5a4024a8871809639be630)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:14.881880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:14.966163 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3776/7521] 10.222.0.13 () {58 vars in 1226 bytes} [Wed Nov 10 04:22:14 2021] DELETE /identity/v3/groups/74f036f17f5a4024a8871809639be630 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:14.975116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:15.005986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d54d-20c3-42b9-8e83-3e0baf1ab9a4 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:15.118093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:15.120918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:15.121435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:15.121924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles/e10b95e91f504253854d818b5a0cf022` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:15.124430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e10b95e91f504253854d818b5a0cf022)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:15.126401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:15.212002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role e10b95e91f504253854d818b5a0cf022 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:15.214410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.215852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.218461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3746/7522] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:14 2021] DELETE /identity/v3/roles/e10b95e91f504253854d818b5a0cf022 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:15.222433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:15.224550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:15.258584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a8b8-5b80-44df-b049-f962b4a88749 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:15.472385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:15.473619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:15.474058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:15.474479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/0e630e59848b49538f934a0f42311ff6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:15.476986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e630e59848b49538f934a0f42311ff6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:15.480022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:15.516810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.517568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.554725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.555354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.560236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3777/7523] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:15 2021] PATCH /identity/v3/domains/0e630e59848b49538f934a0f42311ff6 => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:15.563971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:15.578798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a892c-d9e2-4453-892c-df52b2d71c32 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:15.681022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:15.681962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:15.682247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:15.682520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/0e630e59848b49538f934a0f42311ff6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:15.699046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e630e59848b49538f934a0f42311ff6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:15.700597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:15.724432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.738751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e630e59848b49538f934a0f42311ff6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.786664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.792703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.800705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.819711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project 0e630e59848b49538f934a0f42311ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:15.820360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.821516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.838608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.843683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.844500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e630e59848b49538f934a0f42311ff6', 'request_id': 'req-1a05bf76-461a-43e0-b8fd-42365706d6d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.851215 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3747/7524] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:15 2021] DELETE /identity/v3/domains/0e630e59848b49538f934a0f42311ff6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:15.854852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:15.856475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:15.870295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c931a-bf21-4aec-b9f2-b951bcb9fc3a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:15.957532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:15.959293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:15.959674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:15.960079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/34911c539ddc4723a2b9cfd68003d228/users/a8518c9ac813438cb773403add82865e/roles/b9c88c8903f44482b8747e64d0d48c13` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:15.963065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=34911c539ddc4723a2b9cfd68003d228, user_id=a8518c9ac813438cb773403add82865e, role_id=b9c88c8903f44482b8747e64d0d48c13)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:15.972165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:15.977600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role b9c88c8903f44482b8747e64d0d48c13 was removed from user a8518c9ac813438cb773403add82865e on domain 34911c539ddc4723a2b9cfd68003d228. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:15.978025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:15.978882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.002581 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3778/7525] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 10 04:22:15 2021] DELETE /identity/v3/domains/34911c539ddc4723a2b9cfd68003d228/users/a8518c9ac813438cb773403add82865e/roles/b9c88c8903f44482b8747e64d0d48c13 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:16.006795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.008454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:16.024949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05bf76-461a-43e0-b8fd-42365706d6d0 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.106313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.108947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.109613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.110128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles/b9c88c8903f44482b8747e64d0d48c13` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.112152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9c88c8903f44482b8747e64d0d48c13)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.114172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:16.161377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role b9c88c8903f44482b8747e64d0d48c13 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:16.161739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.162392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.164928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3748/7526] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:16 2021] DELETE /identity/v3/roles/b9c88c8903f44482b8747e64d0d48c13 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:16.168727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.170812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:16.185321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052f5f-d5dc-4a2f-a1b0-05b089e630c6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.267764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.268912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.269698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.269698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/34911c539ddc4723a2b9cfd68003d228` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.271456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34911c539ddc4723a2b9cfd68003d228)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.273104 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:16.297803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.298845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.338869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.339782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.348648 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3779/7527] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:16 2021] PATCH /identity/v3/domains/34911c539ddc4723a2b9cfd68003d228 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:16.351074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.353571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:16.367579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e376cb-a1b1-406c-9129-7ccbcb0b870d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.449463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.450973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.451349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.452380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/34911c539ddc4723a2b9cfd68003d228` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.466324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34911c539ddc4723a2b9cfd68003d228)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.468104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:16.494889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.512216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34911c539ddc4723a2b9cfd68003d228'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.580989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.589455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.596168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.615843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project 34911c539ddc4723a2b9cfd68003d228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:16.616385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.617238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.629035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.634211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.635321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34911c539ddc4723a2b9cfd68003d228', 'request_id': 'req-b1f3217f-d55a-4b20-af90-3f06e084191d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:16.642283 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3749/7528] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:16 2021] DELETE /identity/v3/domains/34911c539ddc4723a2b9cfd68003d228 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:16.648362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.649892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:16.667192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ffda-cdea-4fcf-a30f-577d097c1762 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.759524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.760204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.760483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.760800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.761602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.768927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:16.783340 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3780/7529] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:16.787371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.796601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:16.837227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3217f-d55a-4b20-af90-3f06e084191d tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.844140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.845277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.845608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.845885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.851852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(project_id=edc8ccdb2a184df2b75ffbddc5418160, user_id=abeeba61f1f944a4b2f6789c5b708b86, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.854777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:16.876738 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3750/7530] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:16 2021] PUT /identity/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:16.880769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:16.891917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fad936-fbc1-4b08-af8d-4eeeb1dc2025 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:16.990808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:16.991916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:16.992959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:16.993467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:16.994164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:16.995424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.102021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3781/7531] 10.222.0.13 () {58 vars in 1145 bytes} [Wed Nov 10 04:22:16 2021] GET /identity/v3/auth/projects => generated 828 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:17.106098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.117407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b4a2c-36fc-463d-99cb-371d482981f7 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.122618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.124065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.124368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.124693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.126861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=edc8ccdb2a184df2b75ffbddc5418160, user_id=abeeba61f1f944a4b2f6789c5b708b86, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.129521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.135744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role a31f542edf7f4f97b0d346bcaa39858b was removed from user abeeba61f1f944a4b2f6789c5b708b86 on project edc8ccdb2a184df2b75ffbddc5418160. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:17.136188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:17.138951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:17.158745 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3751/7532] 10.222.0.13 () {58 vars in 1466 bytes} [Wed Nov 10 04:22:17 2021] DELETE /identity/v3/projects/edc8ccdb2a184df2b75ffbddc5418160/users/abeeba61f1f944a4b2f6789c5b708b86/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:17.163891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.168694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:17.196753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cd8-9207-42a9-8868-f7107eca9e4b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.293402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.294462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.294743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.295016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.296403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.298585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.335081 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3782/7533] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:17 2021] POST /identity/v3/users => generated 323 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:17.338439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.350342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0590e-2fa1-4943-82b6-8aa9e534401a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.362876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.364195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.365411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.366287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.367487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.370117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.419860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3752/7534] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:17 2021] POST /identity/v3/projects => generated 361 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:17.424627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.439551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb30-66f1-4129-8681-0137d5f986b9 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.546911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.549642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.550367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.554136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.555100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.562358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.635527 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3783/7535] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:17 2021] POST /identity/v3/projects => generated 364 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:17.639666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.652120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bc6-af26-4a92-bd36-e592fb61b96e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.734079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.734877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.735261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.735639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.736513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.738571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.763648 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3753/7536] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:17 2021] POST /identity/v3/roles => generated 240 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:17.767208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.783606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956a298-dc73-4e47-a456-2854bea8216b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.791049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.792391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.793000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.793440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/be0451fb2e2f48ea855ac6d24f69d5aa/users/0f9006bcf6af48bdadc5d256aa281e56/roles/71da0f8347fd4f1fbb3df98012ef19d1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.820803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(project_id=be0451fb2e2f48ea855ac6d24f69d5aa, user_id=0f9006bcf6af48bdadc5d256aa281e56, role_id=71da0f8347fd4f1fbb3df98012ef19d1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.823987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ef077-0984-4ed0-a7ff-9e42f663647f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.865238 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3784/7537] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:17 2021] PUT /identity/v3/projects/be0451fb2e2f48ea855ac6d24f69d5aa/users/0f9006bcf6af48bdadc5d256aa281e56/roles/71da0f8347fd4f1fbb3df98012ef19d1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:17.869706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:17.884428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f451-3af1-4074-aa4f-34266402c40b tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:17.954122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:17.955380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.955769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.956147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/f58104154ed74275b43dd252f9150bfc/users/0f9006bcf6af48bdadc5d256aa281e56/roles/71da0f8347fd4f1fbb3df98012ef19d1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:17.959182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f58104154ed74275b43dd252f9150bfc, user_id=0f9006bcf6af48bdadc5d256aa281e56, role_id=71da0f8347fd4f1fbb3df98012ef19d1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:17.962711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a75fe6-31b5-4c4f-82d5-3119eb8cd38a tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:17.993843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3754/7538] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:17 2021] PUT /identity/v3/projects/f58104154ed74275b43dd252f9150bfc/users/0f9006bcf6af48bdadc5d256aa281e56/roles/71da0f8347fd4f1fbb3df98012ef19d1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:17.998484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:17.998768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:17.999237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.042654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] MFA Rules not processed for user `0f9006bcf6af48bdadc5d256aa281e56`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:18.044983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.052908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3785/7539] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:17 2021] POST /identity/v3/auth/tokens => generated 335 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:22:18.054321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae4d5-8b9b-40c7-b7ff-8b274ddd7137 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.054614 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae4d5-8b9b-40c7-b7ff-8b274ddd7137 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.054893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae4d5-8b9b-40c7-b7ff-8b274ddd7137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.065137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-133ae4d5-8b9b-40c7-b7ff-8b274ddd7137 None None] MFA Rules not processed for user `0f9006bcf6af48bdadc5d256aa281e56`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:18.066704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-133ae4d5-8b9b-40c7-b7ff-8b274ddd7137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.175791 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3755/7540] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:18 2021] POST /identity/v3/auth/tokens => generated 3214 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 10 04:22:18.178911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.272944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae4670-fc87-48ca-83b5-dc6e8b1f9c82 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.280145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.281033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.281672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.284801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.293696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.297495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.318735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3786/7541] 10.222.0.13 () {56 vars in 1307 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:18.322991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.323282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.323602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.336440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] MFA Rules not processed for user `0f9006bcf6af48bdadc5d256aa281e56`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:18.337855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.407357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.409076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.415403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3756/7542] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:18 2021] POST /identity/v3/auth/tokens => generated 3216 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Nov 10 04:22:18.420260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.432738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27018cd-7b0a-4c35-a690-3238240e0e79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.442200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.442741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.443299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.445566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/roles/71da0f8347fd4f1fbb3df98012ef19d1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.448044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_role(role_id=71da0f8347fd4f1fbb3df98012ef19d1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.452084 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.502768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invalidating the token cache because role 71da0f8347fd4f1fbb3df98012ef19d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:18.503458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.504366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.510734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3757/7543] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/roles/71da0f8347fd4f1fbb3df98012ef19d1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:18.512654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.514878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.516634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216209-6367-49c2-9c68-3fa5b56125a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.593892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.594699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.594978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.595246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] PATH_INFO: `/v3/users/ae9d7f5f1d3b4665b8865e4d9aa6020b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.596474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9d7f5f1d3b4665b8865e4d9aa6020b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.599313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.611364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15ddc-5319-4518-ad26-86de2d1f9518 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.616601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.617553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.618052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.619616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/f58104154ed74275b43dd252f9150bfc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.620580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f58104154ed74275b43dd252f9150bfc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.622651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.660669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9d7f5f1d3b4665b8865e4d9aa6020b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.669666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9d7f5f1d3b4665b8865e4d9aa6020b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.670639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9d7f5f1d3b4665b8865e4d9aa6020b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.685123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9d7f5f1d3b4665b8865e4d9aa6020b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.697186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-43c4a829-2fd6-4521-8de8-c03e7fb3bbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9d7f5f1d3b4665b8865e4d9aa6020b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.713597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58104154ed74275b43dd252f9150bfc', 'request_id': 'req-01e7a1db-ed19-4695-9d71-f0791fc132b5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.724827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3787/7544] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/users/ae9d7f5f1d3b4665b8865e4d9aa6020b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:18.728090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.728457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.729825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.736702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58104154ed74275b43dd252f9150bfc', 'request_id': 'req-01e7a1db-ed19-4695-9d71-f0791fc132b5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.744346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58104154ed74275b43dd252f9150bfc', 'request_id': 'req-01e7a1db-ed19-4695-9d71-f0791fc132b5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.750952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:18.752390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.759142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project f58104154ed74275b43dd252f9150bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:18.759628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.760443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:18.762176 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3758/7545] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/projects/f58104154ed74275b43dd252f9150bfc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:18.766690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.768509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.820712 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3788/7546] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:18.837040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.838491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:18.853796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a1db-ed19-4695-9d71-f0791fc132b5 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.912914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995018e-068b-441c-acfb-c6cdd8c5ffca None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:18.918948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.919602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.919872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.921071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.928773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:18.929608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:18.929883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:18.930585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/f58104154ed74275b43dd252f9150bfc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:18.940447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f58104154ed74275b43dd252f9150bfc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.944203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.946961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:18.948702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:18.963577 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Could not find project: f58104154ed74275b43dd252f9150bfc.: keystone.exception.ProjectNotFound: Could not find project: f58104154ed74275b43dd252f9150bfc. Nov 10 04:22:18.965359 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3759/7547] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/projects/f58104154ed74275b43dd252f9150bfc => generated 113 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:22:18.972904 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3789/7548] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:18.981872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:18.994863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013b6fe-1070-4b92-9229-a13b21c9091f tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.001707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.002564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.002898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.003181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/projects/be0451fb2e2f48ea855ac6d24f69d5aa` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.005704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_project(project_id=be0451fb2e2f48ea855ac6d24f69d5aa)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:19.008075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:19.083987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0451fb2e2f48ea855ac6d24f69d5aa', 'request_id': 'req-689b796e-abce-4ecc-ad9e-3c55271eabca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.102442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0451fb2e2f48ea855ac6d24f69d5aa', 'request_id': 'req-689b796e-abce-4ecc-ad9e-3c55271eabca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.113921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0451fb2e2f48ea855ac6d24f69d5aa', 'request_id': 'req-689b796e-abce-4ecc-ad9e-3c55271eabca'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.140809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] The token cache is being invalidate because project be0451fb2e2f48ea855ac6d24f69d5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:19.141106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.141787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.143890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3760/7549] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:18 2021] DELETE /identity/v3/projects/be0451fb2e2f48ea855ac6d24f69d5aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:19.148402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.161850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ac13-0f54-40d0-a385-6dd41012b531 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.237044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.238108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.238600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.238789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/users/0f9006bcf6af48bdadc5d256aa281e56` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.240797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f9006bcf6af48bdadc5d256aa281e56)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:19.242959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:19.291559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9006bcf6af48bdadc5d256aa281e56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.300428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9006bcf6af48bdadc5d256aa281e56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.301305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9006bcf6af48bdadc5d256aa281e56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.315089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9006bcf6af48bdadc5d256aa281e56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.324176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9006bcf6af48bdadc5d256aa281e56'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.333735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3790/7550] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:19 2021] DELETE /identity/v3/users/0f9006bcf6af48bdadc5d256aa281e56 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:19.340387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.343271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:19.362087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b796e-abce-4ecc-ad9e-3c55271eabca tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.460312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.461303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.461660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.462091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/e506079d0c66498193312f5e5a1b3ad5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.470267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:22:19.480203 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Could not find domain: e506079d0c66498193312f5e5a1b3ad5.: keystone.exception.DomainNotFound: Could not find domain: e506079d0c66498193312f5e5a1b3ad5. Nov 10 04:22:19.485029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3761/7551] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:19 2021] PATCH /identity/v3/domains/e506079d0c66498193312f5e5a1b3ad5 => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:22:19.485750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.487322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:19.501339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cb22-db02-4cbe-850b-2ff354f833dc tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.506743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.507636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.508135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.508343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/ace0f17de7da4ec2a384862b967cd3f5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.518419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:22:19.528052 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Could not find domain: ace0f17de7da4ec2a384862b967cd3f5.: keystone.exception.DomainNotFound: Could not find domain: ace0f17de7da4ec2a384862b967cd3f5. Nov 10 04:22:19.530501 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3791/7552] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:19 2021] PATCH /identity/v3/domains/ace0f17de7da4ec2a384862b967cd3f5 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:22:19.534768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.545574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5b29-6db3-45c5-94fb-1b89874fe8a6 tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.550383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.551257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.551550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.551993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/0e630e59848b49538f934a0f42311ff6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.560393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:22:19.569665 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Could not find domain: 0e630e59848b49538f934a0f42311ff6.: keystone.exception.DomainNotFound: Could not find domain: 0e630e59848b49538f934a0f42311ff6. Nov 10 04:22:19.570702 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3762/7553] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:19 2021] PATCH /identity/v3/domains/0e630e59848b49538f934a0f42311ff6 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:22:19.575366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.588778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2114-0612-4f73-81ce-00a58be4204e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.594789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abeeba61f1f944a4b2f6789c5b708b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe5355202ed4345860b3c0f85daf346', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.595645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.595930 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.596307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] PATH_INFO: `/v3/domains/34911c539ddc4723a2b9cfd68003d228` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.604628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 04:22:19.614023 ncdv-817176-1 devstack@keystone.service[96285]: WARNING keystone.server.flask.application [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Could not find domain: 34911c539ddc4723a2b9cfd68003d228.: keystone.exception.DomainNotFound: Could not find domain: 34911c539ddc4723a2b9cfd68003d228. Nov 10 04:22:19.618178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3792/7554] 10.222.0.13 () {60 vars in 1248 bytes} [Wed Nov 10 04:22:19 2021] PATCH /identity/v3/domains/34911c539ddc4723a2b9cfd68003d228 => generated 112 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 10 04:22:19.619267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.621418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:19.715900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951a209-3160-4e1a-ace4-a4e72e7b3c5c tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.722062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.723546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.723835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.724571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] PATH_INFO: `/v3/users/f360420440ed47ffbb93ac5d63691df9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.727033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f360420440ed47ffbb93ac5d63691df9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:19.729505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:19.803915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f360420440ed47ffbb93ac5d63691df9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.816800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f360420440ed47ffbb93ac5d63691df9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.817869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f360420440ed47ffbb93ac5d63691df9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.818548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f360420440ed47ffbb93ac5d63691df9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.829697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-08e3c9a2-f2aa-4c90-8166-2869421904b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f360420440ed47ffbb93ac5d63691df9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.841707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:19.845455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:19.866204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79782d-a345-49f3-be65-5f81f9aa520e tempest-TokensV3TestJSON-1423627560 tempest-TokensV3TestJSON-1423627560-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:19.883828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:19.885376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.885690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.886223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] PATH_INFO: `/v3/projects/78ed2d7c01b6441f9e0b1cca0d272c2b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.886474 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3763/7555] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:19 2021] DELETE /identity/v3/users/f360420440ed47ffbb93ac5d63691df9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:19.887844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ed2d7c01b6441f9e0b1cca0d272c2b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:19.888342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:19.889589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:19.890216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:19.891020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:19.914037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:19.914836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:19.961224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ed2d7c01b6441f9e0b1cca0d272c2b', 'request_id': 'req-700ce9d6-6be4-4993-a663-9dce0e452b14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.967884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ed2d7c01b6441f9e0b1cca0d272c2b', 'request_id': 'req-700ce9d6-6be4-4993-a663-9dce0e452b14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.977622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ed2d7c01b6441f9e0b1cca0d272c2b', 'request_id': 'req-700ce9d6-6be4-4993-a663-9dce0e452b14'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.996564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] The token cache is being invalidate because project 78ed2d7c01b6441f9e0b1cca0d272c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:19.996865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:19.997975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.004373 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3793/7556] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:19 2021] DELETE /identity/v3/projects/78ed2d7c01b6441f9e0b1cca0d272c2b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:20.008537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:20.011925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:20.015820 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3764/7557] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:20.027114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:20.030492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:20.099005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9d6-6be4-4993-a663-9dce0e452b14 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:20.107552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:20.108542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:20.109273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:20.109552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] PATH_INFO: `/v3/users/0ecf5f06384647f2afb638017faf1978` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:20.110766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295bd6-b47f-4f5f-8b20-0406fee6268f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:20.111933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecf5f06384647f2afb638017faf1978)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:20.116501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:20.191146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:20.192312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:20.192870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:20.193465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:20.197259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecf5f06384647f2afb638017faf1978'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.206367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:20.206718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecf5f06384647f2afb638017faf1978'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.207394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecf5f06384647f2afb638017faf1978'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.207801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:20.219024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3765/7558] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:20.223763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecf5f06384647f2afb638017faf1978'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.235654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecf5f06384647f2afb638017faf1978'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:20.247356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3794/7559] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:20 2021] DELETE /identity/v3/users/0ecf5f06384647f2afb638017faf1978 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:20.790252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:20.792907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:20.824360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5094-5fff-4dc9-97d9-6ec6d448cd7c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:20.833499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:20.835773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:20.917121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:20.917992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:20.918274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:20.918552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] PATH_INFO: `/v3/projects/edc8ccdb2a184df2b75ffbddc5418160` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:20.919751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc8ccdb2a184df2b75ffbddc5418160)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:20.922360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:20.924274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df32a2-9c38-4974-b900-83dcbb7e8536 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:20.929386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:20.930250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:20.930745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:20.931018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] PATH_INFO: `/v3/users/2223e4497dc54e88b4092dd8f20d52d7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:20.932292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2223e4497dc54e88b4092dd8f20d52d7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:20.934407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:20.991036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc8ccdb2a184df2b75ffbddc5418160', 'request_id': 'req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.006959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2223e4497dc54e88b4092dd8f20d52d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.019042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2223e4497dc54e88b4092dd8f20d52d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.020119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2223e4497dc54e88b4092dd8f20d52d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.020773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc8ccdb2a184df2b75ffbddc5418160', 'request_id': 'req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.031519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc8ccdb2a184df2b75ffbddc5418160', 'request_id': 'req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.040904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2223e4497dc54e88b4092dd8f20d52d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.054171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2223e4497dc54e88b4092dd8f20d52d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.055805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] The token cache is being invalidate because project edc8ccdb2a184df2b75ffbddc5418160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:21.056109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.057755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.063387 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3766/7560] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:20 2021] DELETE /identity/v3/projects/edc8ccdb2a184df2b75ffbddc5418160 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:21.064954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.067333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.077453 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3795/7561] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:20 2021] DELETE /identity/v3/users/2223e4497dc54e88b4092dd8f20d52d7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:21.078943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.081069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.150435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a061b4-772f-4f34-8ccb-984e94c2cd5c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.154239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c6de-771e-4372-ab6a-421f0c7aef6d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.157358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.158492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.158735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.159013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] PATH_INFO: `/v3/projects/476a603d283d48f99a74c898a1fc9fba` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.160227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476a603d283d48f99a74c898a1fc9fba)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.160812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.161681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.162000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.162275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] PATH_INFO: `/v3/users/abeeba61f1f944a4b2f6789c5b708b86` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.162387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.163833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=abeeba61f1f944a4b2f6789c5b708b86)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.166331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.216142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476a603d283d48f99a74c898a1fc9fba', 'request_id': 'req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.221087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abeeba61f1f944a4b2f6789c5b708b86'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.223821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476a603d283d48f99a74c898a1fc9fba', 'request_id': 'req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.228256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abeeba61f1f944a4b2f6789c5b708b86'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.228986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abeeba61f1f944a4b2f6789c5b708b86'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.230268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476a603d283d48f99a74c898a1fc9fba', 'request_id': 'req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.243045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abeeba61f1f944a4b2f6789c5b708b86'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.244162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] The token cache is being invalidate because project 476a603d283d48f99a74c898a1fc9fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:21.244457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.245280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6f18bc3-10b4-4e7a-91ff-8dfe2866c5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.246859 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3767/7562] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:21 2021] DELETE /identity/v3/projects/476a603d283d48f99a74c898a1fc9fba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:21.248436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.248872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.249200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.252232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e8ae207f-3cc2-463f-bf28-442b3321f7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abeeba61f1f944a4b2f6789c5b708b86'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.259642 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3796/7563] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:21 2021] DELETE /identity/v3/users/abeeba61f1f944a4b2f6789c5b708b86 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:21.261378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78805c3d-c2ed-46df-86bd-0c58e7fa0fa1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.261895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78805c3d-c2ed-46df-86bd-0c58e7fa0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.262290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78805c3d-c2ed-46df-86bd-0c58e7fa0fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.270894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:21.272910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.288900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-78805c3d-c2ed-46df-86bd-0c58e7fa0fa1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:21.290490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78805c3d-c2ed-46df-86bd-0c58e7fa0fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.358939 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3768/7564] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:21.375039 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3797/7565] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:21.377499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.379060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.385380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.386186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.386823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.419271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:21.420647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.437223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3798/7566] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:21.442726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.456979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60d8f-690d-45c1-a898-cb5a0f7b55a6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.462648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.463318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.463698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.463894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.468472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:21.468472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.468472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.475252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54584e5-cdae-40f2-9ecb-66782e64286c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.480482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.481934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.482726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.483331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.486412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3799/7567] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:21.490945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.496630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.499741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.514593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3769/7568] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:21.535037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6c96-d449-46b5-bb6d-09b5bba304ee admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.543008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.544938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.545293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.545549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.546319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.550368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.619685 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3800/7569] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:21 2021] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:21.627460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.645822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6cfc-725b-4121-ac09-b134763ac698 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.727963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.730395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.771867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.772555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.772863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.773140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.773891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.775832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.804541 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3770/7570] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:21 2021] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:21.809393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.831992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7674-ba18-436f-8fa3-6dc8e53c8068 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.844493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.845417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.845796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.846209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.847736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.849689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.862162 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3771/7571] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:21 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:21.869572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.876847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ce30-1d3d-437a-9159-b9a63c8c6f58 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.883152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.884249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.884862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.885308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] PATH_INFO: `/v3/projects/8fe5355202ed4345860b3c0f85daf346` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.886636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e8ce-aa5d-4a6f-b70e-0964e093b32c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.887496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe5355202ed4345860b3c0f85daf346)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.889633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.893218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:21.895051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:21.895499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:21.896455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:21.901015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:21.902732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:21.926843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3772/7572] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:21 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:21.927975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.930406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:21.945878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be1f0-7fc5-4648-82a0-f7b22b12931b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:21.954211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe5355202ed4345860b3c0f85daf346', 'request_id': 'req-94fc19e2-dca1-4d71-a78b-307c86555025'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.959690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe5355202ed4345860b3c0f85daf346', 'request_id': 'req-94fc19e2-dca1-4d71-a78b-307c86555025'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.965870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe5355202ed4345860b3c0f85daf346', 'request_id': 'req-94fc19e2-dca1-4d71-a78b-307c86555025'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.981842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] The token cache is being invalidate because project 8fe5355202ed4345860b3c0f85daf346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:21.982343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.985469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:21.988659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3801/7573] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:21 2021] DELETE /identity/v3/projects/8fe5355202ed4345860b3c0f85daf346 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:21.988809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:21.991029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.034394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.037471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.037941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.038506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] PATH_INFO: `/v3/projects/9fe56311d43a41599ccab741fce8fd46` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.040275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe56311d43a41599ccab741fce8fd46)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.047563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.101024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc19e2-dca1-4d71-a78b-307c86555025 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.109187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.110150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.110439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.110718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] PATH_INFO: `/v3/projects/c79a95231cb2468c85c53cb08ad40156/users/dff78dc8519c4bc59e6e53ac452b0206/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.162692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79a95231cb2468c85c53cb08ad40156, user_id=dff78dc8519c4bc59e6e53ac452b0206, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.166736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe56311d43a41599ccab741fce8fd46', 'request_id': 'req-27594350-b0b8-4c04-bd78-2190c7f5e38e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.168702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.179879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe56311d43a41599ccab741fce8fd46', 'request_id': 'req-27594350-b0b8-4c04-bd78-2190c7f5e38e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.198517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe56311d43a41599ccab741fce8fd46', 'request_id': 'req-27594350-b0b8-4c04-bd78-2190c7f5e38e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.201257 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3802/7574] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:21 2021] PUT /identity/v3/projects/c79a95231cb2468c85c53cb08ad40156/users/dff78dc8519c4bc59e6e53ac452b0206/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:22.201781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.212127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.229893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] The token cache is being invalidate because project 9fe56311d43a41599ccab741fce8fd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:22.230236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.232350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27594350-b0b8-4c04-bd78-2190c7f5e38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.241928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3773/7575] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:21 2021] DELETE /identity/v3/projects/9fe56311d43a41599ccab741fce8fd46 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:22.250831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.251199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.251404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.294947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] MFA Rules not processed for user `dff78dc8519c4bc59e6e53ac452b0206`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:22.296166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.320855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea77c2a-f890-4a35-9f7d-79cd5a0f5c38 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.325664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.327230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.327871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.327995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] PATH_INFO: `/v3/users/a8518c9ac813438cb773403add82865e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.329416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8518c9ac813438cb773403add82865e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.331324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.387897 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3774/7576] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:22 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:22.390198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.391522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.398824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.406024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d63a4-1bde-45aa-910f-d02e2fd50862 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.410018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.410714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.411339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.411562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.411841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.412439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] PATH_INFO: `/v3/users/907dda40d0644679892e18cf1da57f25` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.413334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=907dda40d0644679892e18cf1da57f25)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.415213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.441948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.450462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8518c9ac813438cb773403add82865e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.457634 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3803/7577] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:22 2021] DELETE /identity/v3/users/a8518c9ac813438cb773403add82865e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:22.458404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.460432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.481542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907dda40d0644679892e18cf1da57f25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.494083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907dda40d0644679892e18cf1da57f25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.495532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907dda40d0644679892e18cf1da57f25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.496171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907dda40d0644679892e18cf1da57f25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.510993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907dda40d0644679892e18cf1da57f25'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.538289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3775/7578] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:22 2021] DELETE /identity/v3/users/907dda40d0644679892e18cf1da57f25 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:22.546734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5ce4-f587-45e4-b2f0-f7a9a35a6719 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.637929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.638614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.638970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.639250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.640015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.642027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.682915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3804/7579] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:22 2021] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:22.684140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.686728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.713071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab625-9ee7-44b0-824c-81047470a0dc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.823061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.824355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.832972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.833488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.834477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.839258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.840862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.843771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.860113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e50-2c46-45f6-9d2e-22c2f0216c7f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.867826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.868951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.870287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.871402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] PATH_INFO: `/v3/projects/8d6f6423378b42cdb50df552057cf391` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.874902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6f6423378b42cdb50df552057cf391)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.877750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.881362 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3776/7580] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:22 2021] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:22.885394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.907195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36010-df3d-4a91-b090-7024279749ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.914715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:22.915602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:22.915892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:22.916173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:22.917406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:22.921397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:22.941875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3777/7581] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:22.942669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:22.951501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:22.965277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcc30-c8e4-467a-9c6c-fe7927d01f38 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:22.985856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6f6423378b42cdb50df552057cf391', 'request_id': 'req-46b092d2-26a2-4b4e-a0b8-b85b6b931569'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:22.994112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6f6423378b42cdb50df552057cf391', 'request_id': 'req-46b092d2-26a2-4b4e-a0b8-b85b6b931569'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.003040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6f6423378b42cdb50df552057cf391', 'request_id': 'req-46b092d2-26a2-4b4e-a0b8-b85b6b931569'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.024791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] The token cache is being invalidate because project 8d6f6423378b42cdb50df552057cf391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:23.025974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.026950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.030563 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3805/7582] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:22 2021] DELETE /identity/v3/projects/8d6f6423378b42cdb50df552057cf391 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:23.037659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.040884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.066696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.079247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.079703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.080089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] PATH_INFO: `/v3/projects/a8c033aeca2c40d6894b686bd644e680` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.082966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c033aeca2c40d6894b686bd644e680)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.085088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.128944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b092d2-26a2-4b4e-a0b8-b85b6b931569 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.149852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c033aeca2c40d6894b686bd644e680', 'request_id': 'req-31cef620-001b-4ffe-8ce7-a338e7d82377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.156691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c033aeca2c40d6894b686bd644e680', 'request_id': 'req-31cef620-001b-4ffe-8ce7-a338e7d82377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.163595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c033aeca2c40d6894b686bd644e680', 'request_id': 'req-31cef620-001b-4ffe-8ce7-a338e7d82377'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.177782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] The token cache is being invalidate because project a8c033aeca2c40d6894b686bd644e680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:23.178261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.179006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31cef620-001b-4ffe-8ce7-a338e7d82377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:23.180779 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3778/7583] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:22 2021] DELETE /identity/v3/projects/a8c033aeca2c40d6894b686bd644e680 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:23.182256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d90ec-c261-4850-92b9-1964b6944008 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.182611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d90ec-c261-4850-92b9-1964b6944008 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.182963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d90ec-c261-4850-92b9-1964b6944008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.194199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.195113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.195394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.195666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] PATH_INFO: `/v3/projects/2e86bc80251240fc9f7c55dfb65af36a/users/f087f0efc3364635b2e1bea06c6430cb/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.203663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-094d90ec-c261-4850-92b9-1964b6944008 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:23.205152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-094d90ec-c261-4850-92b9-1964b6944008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.210855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e86bc80251240fc9f7c55dfb65af36a, user_id=f087f0efc3364635b2e1bea06c6430cb, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.213487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a763c5-ad27-4c6a-9ba9-a135faa4e56a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.215253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3779/7584] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:23.222781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.222781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.222781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.235711 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3806/7585] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:23 2021] PUT /identity/v3/projects/2e86bc80251240fc9f7c55dfb65af36a/users/f087f0efc3364635b2e1bea06c6430cb/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:23.237541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a52cb-e2a1-4b27-b620-932ad9b4825a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.238052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a52cb-e2a1-4b27-b620-932ad9b4825a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.238813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a52cb-e2a1-4b27-b620-932ad9b4825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.239949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:23.241299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.259480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1a5a52cb-e2a1-4b27-b620-932ad9b4825a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:23.260730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1a5a52cb-e2a1-4b27-b620-932ad9b4825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.307715 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3780/7586] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:23.307715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.315754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.333012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7ad41-b152-42dc-8f4c-5c9a74690aca None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.334983 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3807/7587] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:23.336674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.337312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.337805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.338131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.338858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.339155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.339428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.340171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.342406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.355797 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3781/7588] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:23.360222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:23.360478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.362121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.371864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb0a01-55c6-4019-8117-8397dde55e5f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.373561 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3808/7589] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:23.374898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.378223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.386882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16e5b5-c453-47b8-ae3a-78d250ac886a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.389746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.391275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.392425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.392893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.393396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.393678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.393955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] PATH_INFO: `/v3/projects/2e86bc80251240fc9f7c55dfb65af36a/users/f087f0efc3364635b2e1bea06c6430cb/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.395117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:23.395611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.396249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e86bc80251240fc9f7c55dfb65af36a, user_id=f087f0efc3364635b2e1bea06c6430cb, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.399041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.402963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7da5-5d5e-452d-8f42-2001b10f12d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.411331 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3809/7590] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:23 2021] PUT /identity/v3/projects/2e86bc80251240fc9f7c55dfb65af36a/users/f087f0efc3364635b2e1bea06c6430cb/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:23.412074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.427619 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3782/7591] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:23.434202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.434690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.434983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.470649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] MFA Rules not processed for user `f087f0efc3364635b2e1bea06c6430cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:23.472771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.491268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec790c-e4cc-481b-ba8a-25deb200d599 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.498387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.499727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.500010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.500282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.501525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:23.501831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.503506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.516918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3810/7592] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:23.517563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.528091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a891-223d-4353-abad-2ae1a9abbe2a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.534318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.535199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.535343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.535606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.536741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.539256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.553716 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3783/7593] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:23.554711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.567208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a4a3-9271-4075-bf95-91ebbb0ae749 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.573220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.574115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.574406 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.574720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.575422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.578549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.587133 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3811/7594] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:23.587133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.587133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:23.607360 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3784/7595] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:23.611201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.659700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bd47-f346-48e5-a236-91f32d378867 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.679531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8bd8-f451-4d5e-8bd2-e2f947790a4d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.687281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.687281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.687627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.687993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.688924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.691194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.731890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3785/7596] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:23.731890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.733529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.734166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.734514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.734788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.743702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34ed9-bf8c-4f16-8980-5ba920786cd4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.749243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.749606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.749883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.750149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.750846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.752765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.778765 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3786/7597] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:23.778765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.787641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9995cb-4b67-42c6-b2d1-7ee281643f54 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.793914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.794655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.794947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.795223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.796080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.797757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.809502 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3787/7598] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:23.811064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.812743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.814649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.822170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a37879-7c4c-4302-ba64-ee40d1242dd9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.828763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.829537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.829795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.830053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.830844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.830956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3812/7599] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:23.831819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.832732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.843215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a606f-a89c-438e-8c39-f1d309f2a9fc service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.850292 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3788/7600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:23.850582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.850582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.850582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.850582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.850985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.852111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.852393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.866131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19c72-aefa-4f08-8741-522fed04b6ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.866397 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3813/7601] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:23.871208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.881014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.881931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.882171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.882450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.883337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.885085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.889404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a92e6-0465-4775-845b-abaa6a87e3a2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.895863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.898212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.898498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.898775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] PATH_INFO: `/v3/projects/14ec11452e1040a2b19eaeb287649bc1/users/0538b9e47028460f816fd3093a3ad31a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.910826 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3789/7602] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:23.915101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:23.924130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ec11452e1040a2b19eaeb287649bc1, user_id=0538b9e47028460f816fd3093a3ad31a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.926030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ef6e-26ec-4779-9e99-4257c833f6e7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:23.928919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc65ae1-e45d-40a6-a635-c25e290ce7b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:23.935036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:23.935036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.935036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.935036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] PATH_INFO: `/v3/projects/8308fac50e8442bda594fbf4e1a2f3ad/users/cd4a654b819a493f967db187f140cf5a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.953778 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3814/7603] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:23 2021] PUT /identity/v3/projects/14ec11452e1040a2b19eaeb287649bc1/users/0538b9e47028460f816fd3093a3ad31a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:23.964896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9df5-7db4-4eed-8930-1106be1909fb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:23.965420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9df5-7db4-4eed-8930-1106be1909fb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:23.965706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9df5-7db4-4eed-8930-1106be1909fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:23.991375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8308fac50e8442bda594fbf4e1a2f3ad, user_id=cd4a654b819a493f967db187f140cf5a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:23.994887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.014708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-15ef9df5-7db4-4eed-8930-1106be1909fb None None] MFA Rules not processed for user `0538b9e47028460f816fd3093a3ad31a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:24.016125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-15ef9df5-7db4-4eed-8930-1106be1909fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.032335 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3790/7604] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:23 2021] PUT /identity/v3/projects/8308fac50e8442bda594fbf4e1a2f3ad/users/cd4a654b819a493f967db187f140cf5a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:24.033775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.090067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3815/7605] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:23 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:24.091449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.091705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.092008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.121520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] MFA Rules not processed for user `cd4a654b819a493f967db187f140cf5a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:24.122790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.125926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a599-e9cc-46c0-819d-664df0595af1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.131958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.133123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.133400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.133685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] PATH_INFO: `/v3/users/dff78dc8519c4bc59e6e53ac452b0206` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.134926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff78dc8519c4bc59e6e53ac452b0206)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.136907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.189034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff78dc8519c4bc59e6e53ac452b0206'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:24.192851 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3816/7606] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:24.193678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.200531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff78dc8519c4bc59e6e53ac452b0206'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:24.201287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff78dc8519c4bc59e6e53ac452b0206'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:24.201979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff78dc8519c4bc59e6e53ac452b0206'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:24.207459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98b98-0636-499a-8f0b-a2f16e1f5874 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.211526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff78dc8519c4bc59e6e53ac452b0206'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:24.213147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.213801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.214081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.214351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.215054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.216990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1531611-c793-4351-975f-143305ce5a3e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.237086 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3791/7607] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:24 2021] DELETE /identity/v3/users/dff78dc8519c4bc59e6e53ac452b0206 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:24.237086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.237086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.249915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3817/7608] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:24.251571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.252030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.252306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.269562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:24.270767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.304847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5873-cdbe-45e1-8d91-cadbc5864065 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.339157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3818/7609] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:24.340182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.341535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.357050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492410a7-e7e6-4f7f-93d0-19a7c5b91a60 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.362601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.363271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.363550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.363819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.364514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.366548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.374200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.375148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.375632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.376095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.377135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.379774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.387726 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3819/7610] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:24.388928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.390890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.414835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3792/7611] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:24.418898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.496032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef275-fabe-447e-8bef-6fa8af920aa1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.502951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab1126-3f01-48ff-ad9b-bb20cd8fb987 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.508480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.508738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.508951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.509222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.509958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.511561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.521777 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3793/7612] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:24 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:24.524753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.547054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299ca7-0808-489f-90ef-fb8ae38fdb62 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.558761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.560656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.560656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.560656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.561261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.561959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.564953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.565246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.566067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.568423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.572265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.574000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.586119 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3820/7613] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:24.586993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.599802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3794/7614] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/users => generated 290 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:24.603646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.614855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4ad9-9e57-438c-92c5-34bd27bd1440 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.615247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7da9-cbaa-435c-b440-d4145db37e9e service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.622838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.624890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.626449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.627933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.628440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] PATH_INFO: `/v3/projects/b3c191fcca2443d19f5df67a2d6de34b/users/20ee69fddb1d467aa5470318fda8831e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.628581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.628998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.629503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.631195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.633589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.646233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3795/7615] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:24.651507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.653942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c191fcca2443d19f5df67a2d6de34b, user_id=20ee69fddb1d467aa5470318fda8831e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.657536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.667935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec679b4-777a-40f9-9c3b-9a5d83ad6c62 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.677106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3821/7616] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:24 2021] PUT /identity/v3/projects/b3c191fcca2443d19f5df67a2d6de34b/users/20ee69fddb1d467aa5470318fda8831e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:24.680785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.779050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.780815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.781098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.781371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.782169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.784068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.791906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108af0-80b5-41d8-a957-715cf6b8c92c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.799130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.800021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.810266 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3796/7617] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:24 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:24.810641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.810641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.810641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.810641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.813834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.830916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eb2a-7b6e-458a-9c0d-2508331dac97 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.834489 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3822/7618] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:24 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:24.838979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:24.848268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.849350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.849717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.850059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] PATH_INFO: `/v3/projects/5db17917ec3c405ebc51fe9bb87ab950/users/87ac49fb9f89431db372c71d5a772ac6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.858581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a044d-26fe-4f7c-a118-d439f2d06bfe admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:24.866232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:24.867079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db17917ec3c405ebc51fe9bb87ab950, user_id=87ac49fb9f89431db372c71d5a772ac6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.869075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.870205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a927e-e1a9-4a9f-9796-a737a945dd0a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.870405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.870839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] PATH_INFO: `/v3/projects/b3c191fcca2443d19f5df67a2d6de34b/users/20ee69fddb1d467aa5470318fda8831e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.873360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c191fcca2443d19f5df67a2d6de34b, user_id=20ee69fddb1d467aa5470318fda8831e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:24.877975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a46e-b32d-4ced-8113-c481876d7749 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:24.889220 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3797/7619] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:24 2021] PUT /identity/v3/projects/5db17917ec3c405ebc51fe9bb87ab950/users/87ac49fb9f89431db372c71d5a772ac6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:24.894102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3823/7620] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:24 2021] PUT /identity/v3/projects/b3c191fcca2443d19f5df67a2d6de34b/users/20ee69fddb1d467aa5470318fda8831e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:24.901059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.901343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.901618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.909291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:24.909591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:24.909901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:24.944012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] MFA Rules not processed for user `20ee69fddb1d467aa5470318fda8831e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:24.945496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:24.961133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] MFA Rules not processed for user `87ac49fb9f89431db372c71d5a772ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:24.962363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.048984 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3798/7621] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:25.049835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.054975 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3824/7622] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:24 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:25.060513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.079383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76f68-3ba7-404e-b1fe-2bf4f6a92825 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.095231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.095964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.096250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.096511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.097345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.099421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.156172 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3825/7623] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:25 2021] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:25.158000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.184517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ff944-1aa7-4d15-9123-b98dcf629d8c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.245341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0e19-78e8-4d54-951f-a5f290212972 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.252051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.252777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.253060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.253335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.254053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.256472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.289534 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3826/7624] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:25 2021] POST /identity/v3/users => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:25.293300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.294009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.294751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.295369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.295841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.296125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.297165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.300005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.310307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f2d3-23af-45d9-9e4c-709c1117ec66 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.315737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.316823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.317214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.317732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] PATH_INFO: `/v3/projects/c79a95231cb2468c85c53cb08ad40156` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.319064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79a95231cb2468c85c53cb08ad40156)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.321531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.333841 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3799/7625] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:25 2021] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:25.333841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.381725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79a95231cb2468c85c53cb08ad40156', 'request_id': 'req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.387784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79a95231cb2468c85c53cb08ad40156', 'request_id': 'req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.395751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79a95231cb2468c85c53cb08ad40156', 'request_id': 'req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.410909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] The token cache is being invalidate because project c79a95231cb2468c85c53cb08ad40156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:25.411196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.411616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47050ae7-32ff-45a6-b5eb-de02bd885410 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.412139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.413987 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3827/7626] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:25 2021] DELETE /identity/v3/projects/c79a95231cb2468c85c53cb08ad40156 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:25.414505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.415819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.479640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.480663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.481012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.481359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/7bde64bcee2a4ea28434a074c27916f8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.496997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_user(user_id=7bde64bcee2a4ea28434a074c27916f8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.498505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92106c-cf0d-48e9-b9e0-af8c4bb11e31 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.500365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.502438 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3800/7627] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:22:25 2021] GET /identity/v3/users/7bde64bcee2a4ea28434a074c27916f8 => generated 373 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:25.505235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.506035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.506395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.506525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.506796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.508352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.508507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.510821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.526671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ae35-c90d-4940-aa86-72f89bffbae0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.531899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.532870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.533256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.533625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] PATH_INFO: `/v3/users/f087f0efc3364635b2e1bea06c6430cb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.534664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3828/7628] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:25 2021] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:25.534973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f087f0efc3364635b2e1bea06c6430cb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.537046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.538332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.540184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.553893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858bfd-4246-43c6-9438-581af9756df4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.558832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.559981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.559981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.560393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/7bde64bcee2a4ea28434a074c27916f8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.562294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7bde64bcee2a4ea28434a074c27916f8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.564267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.594786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f087f0efc3364635b2e1bea06c6430cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.602686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f087f0efc3364635b2e1bea06c6430cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.603524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f087f0efc3364635b2e1bea06c6430cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.604339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f087f0efc3364635b2e1bea06c6430cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.612760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f087f0efc3364635b2e1bea06c6430cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.613961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bde64bcee2a4ea28434a074c27916f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.624141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bde64bcee2a4ea28434a074c27916f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.629021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bde64bcee2a4ea28434a074c27916f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.638126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3801/7629] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:25 2021] DELETE /identity/v3/users/f087f0efc3364635b2e1bea06c6430cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:25.643321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.644696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bde64bcee2a4ea28434a074c27916f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.645327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.655844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bde64bcee2a4ea28434a074c27916f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.665290 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3829/7630] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:25 2021] DELETE /identity/v3/users/7bde64bcee2a4ea28434a074c27916f8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:25.669194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.672012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.736158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d663f0-f4a0-44ba-9c1c-a0bb49f061ef admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.759638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1f2e8-1d57-487d-9189-04e766fb472e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.765004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.766030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.766484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.766767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/f8a72fd722b34f4a93154d904bee9312` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.768137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8a72fd722b34f4a93154d904bee9312)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.770386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.806371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.807246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.807467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.808328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.808797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.814140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:25.826544 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3802/7631] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:25 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:25.831925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.836908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.842164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a72fd722b34f4a93154d904bee9312', 'request_id': 'req-94651d3e-3f81-4a0e-acbb-6c1246071246'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.849582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a72fd722b34f4a93154d904bee9312', 'request_id': 'req-94651d3e-3f81-4a0e-acbb-6c1246071246'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.852701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d5b2-9d99-486c-90c3-28454999a153 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:25.859141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a72fd722b34f4a93154d904bee9312', 'request_id': 'req-94651d3e-3f81-4a0e-acbb-6c1246071246'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.897062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] The token cache is being invalidate because project f8a72fd722b34f4a93154d904bee9312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:25.897762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.898595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:25.907084 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3830/7632] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:25 2021] DELETE /identity/v3/projects/f8a72fd722b34f4a93154d904bee9312 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:25.908544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:25.911004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:25.929407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:25.930562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:25.931008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:25.931462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] PATH_INFO: `/v3/projects/771845b5ccb14866bf9884cc515c240b/users/13da4025d1ee471fb54c9caa84d00e79/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:25.959696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=771845b5ccb14866bf9884cc515c240b, user_id=13da4025d1ee471fb54c9caa84d00e79, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:25.967674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.000041 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3803/7633] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:25 2021] PUT /identity/v3/projects/771845b5ccb14866bf9884cc515c240b/users/13da4025d1ee471fb54c9caa84d00e79/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:26.008092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651d3e-3f81-4a0e-acbb-6c1246071246 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.008417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.017828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.085712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.086389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.086656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.087028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.087922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.089860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.119664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703cdfd-d855-4666-bef3-42a6f98a69fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.126598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.127268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.127608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.127895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.128876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.129347 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3831/7634] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:25 2021] POST /identity/v3/projects => generated 359 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.130498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.133722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.135714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.144083 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3804/7635] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:26.145003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.158412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685141e-5901-45b1-8607-2ef0aa5b1ab6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.213273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f0e7f-3272-457c-819d-5e0c269dec27 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.218376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.219236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.219512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.219790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] PATH_INFO: `/v3/projects/2e86bc80251240fc9f7c55dfb65af36a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.221038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e86bc80251240fc9f7c55dfb65af36a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.223126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.233506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.234009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.234243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.234579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.235255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.237327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.268031 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3805/7636] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/users => generated 417 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.269144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.282228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8e55-6870-4d48-a237-02290d8c2cc7 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.289039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e86bc80251240fc9f7c55dfb65af36a', 'request_id': 'req-142035bc-7772-47d2-a4d5-c4211466eeb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:26.295526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e86bc80251240fc9f7c55dfb65af36a', 'request_id': 'req-142035bc-7772-47d2-a4d5-c4211466eeb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:26.301583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e86bc80251240fc9f7c55dfb65af36a', 'request_id': 'req-142035bc-7772-47d2-a4d5-c4211466eeb4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:26.316945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] The token cache is being invalidate because project 2e86bc80251240fc9f7c55dfb65af36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:26.317259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:26.321016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:26.330393 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3832/7637] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:26 2021] DELETE /identity/v3/projects/2e86bc80251240fc9f7c55dfb65af36a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:26.330393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.330393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.351771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.352831 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.353111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.353382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] PATH_INFO: `/v3/projects/771845b5ccb14866bf9884cc515c240b/users/13da4025d1ee471fb54c9caa84d00e79/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.355409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771845b5ccb14866bf9884cc515c240b, user_id=13da4025d1ee471fb54c9caa84d00e79, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.359741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a3855-4f5f-46ee-9336-27ef2b2e3db6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.370338 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3806/7638] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:26 2021] PUT /identity/v3/projects/771845b5ccb14866bf9884cc515c240b/users/13da4025d1ee471fb54c9caa84d00e79/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:26.371745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e312-3fb6-49aa-8b6b-6733b245d667 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.372030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e312-3fb6-49aa-8b6b-6733b245d667 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.372447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e312-3fb6-49aa-8b6b-6733b245d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.394220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-59e8e312-3fb6-49aa-8b6b-6733b245d667 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:26.395791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-59e8e312-3fb6-49aa-8b6b-6733b245d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.398813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142035bc-7772-47d2-a4d5-c4211466eeb4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.467582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.468532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.468854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.469136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.469898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.471551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0e9d6-2798-4ee4-99c4-a74802f08430 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.476863 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3807/7639] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:26.479089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.479420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.479697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.499699 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3833/7640] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/roles => generated 238 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.501769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.502169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.502419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.523672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] MFA Rules not processed for user `13da4025d1ee471fb54c9caa84d00e79`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:26.524938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.537405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:26.538711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.549168 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3834/7641] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:26.552717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.563827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0874-838d-4168-8749-2e3b0da6a631 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.570891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.572038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.572474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.572884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/98be7fcbcae34f96a3a301243558f916` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.594495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_user(user_id=98be7fcbcae34f96a3a301243558f916)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.597317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.599691 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3835/7642] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/users/98be7fcbcae34f96a3a301243558f916 => generated 417 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:26.600827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.616374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d80a-237f-4849-845b-126662a328b1 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.622146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.622981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.624097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.624370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.625449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:26.625733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.627326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.628413 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3808/7643] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:26.629986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.652551 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3836/7644] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:26.652551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.652909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccc114-da33-49ea-96aa-c2362c618068 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.655975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.661305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.662503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.663048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.663525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/roles/3ff4428a724f48ccacce1dda6de12055` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.665376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_role(role_id=3ff4428a724f48ccacce1dda6de12055)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.667237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.669218 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3809/7645] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/roles/3ff4428a724f48ccacce1dda6de12055 => generated 238 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:26.670479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.682881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b3f5-6107-4482-80d9-07f7fb35e044 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.688881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.689680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.690011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.690290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.691005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.692916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.732976 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3810/7646] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.732976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.738785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b58f-d33d-4c97-ab9a-5f1cd836c936 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.811351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bed2-4f25-4dd6-8947-3e563d3f0cd4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.813071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.813944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.814463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.814933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.817364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.818258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.818697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.819130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.820185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.822297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.863089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3811/7647] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/projects => generated 358 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.864265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.882276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.883818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.893737 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3837/7648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:26.894654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.906832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78360c5-2c3c-4faf-a556-20e441323d86 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.951728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d57a4c-083e-4817-b89e-2ed66476dc22 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:26.959206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.960016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.960294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.960560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.961629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.963349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.968794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:26.969653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:26.969954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:26.970211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:26.971428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_project(project_id=eee7b0f3dc974a3fba081e748b3dbdfb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:26.973492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:26.975269 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3838/7649] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb => generated 358 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:26.976273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:26.977818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:26.992895 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3812/7650] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:26 2021] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:26.993748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.004737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c630-62fe-467f-b068-a0d43111ad58 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.010743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.010743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.010743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.011142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb/users/98be7fcbcae34f96a3a301243558f916/roles/3ff4428a724f48ccacce1dda6de12055` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.014773 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eee7b0f3dc974a3fba081e748b3dbdfb, user_id=98be7fcbcae34f96a3a301243558f916, role_id=3ff4428a724f48ccacce1dda6de12055)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.020241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.035287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3813/7651] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:26 2021] PUT /identity/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb/users/98be7fcbcae34f96a3a301243558f916/roles/3ff4428a724f48ccacce1dda6de12055 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:27.036317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.048179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960eb3f-d94d-406c-a35b-4666eb8625d0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.102499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.103917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.104255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.104590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.106923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:27.111059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2fa32-3e4e-41f1-af16-14ed049d8d83 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.116240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.117172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.117530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.117877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.118655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.120243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.131957 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3814/7652] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:27 2021] GET /identity/v3/roles => generated 1649 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:27.132810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.178565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.180143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.189557 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3839/7653] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:26 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:27.198020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.198845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3bf5d-18d2-4786-b249-3fd323115039 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.204599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.205791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.205791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.206023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.206590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.208418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.221545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9b4a5-f720-43eb-a87c-b90f0c427753 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.227061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.227724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.227998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.228264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.229024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.230586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.241931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3815/7654] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:27 2021] POST /identity/v3/projects => generated 360 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:27.242401 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3840/7655] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:27 2021] GET /identity/v3/roles => generated 1649 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:27.245593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.248365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.259538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdfcee-419e-4c17-850e-6f1615bbd482 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.322054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.323025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.323370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.323854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] PATH_INFO: `/v3/projects/3451e5f5107f48e79d66d4f059f87cec/users/3a3ff79fd50544bdbec99de25d7b661b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.337415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555579-4354-4cab-95be-a265dbda401f tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.342833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.343074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3451e5f5107f48e79d66d4f059f87cec, user_id=3a3ff79fd50544bdbec99de25d7b661b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.343798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.344040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.344318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/97cacd15828449c48a7291478c8f5f53` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.345662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_project(project_id=97cacd15828449c48a7291478c8f5f53)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.346744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561848c-5dec-4ed3-aebb-d0696378c915 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.348516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.353390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3816/7656] 10.222.0.13 () {58 vars in 1229 bytes} [Wed Nov 10 04:22:27 2021] GET /identity/v3/projects/97cacd15828449c48a7291478c8f5f53 => generated 360 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:27.354568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.365964 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0efcb-3dff-496f-8c92-30960d801134 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.370194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3841/7657] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:27 2021] PUT /identity/v3/projects/3451e5f5107f48e79d66d4f059f87cec/users/3a3ff79fd50544bdbec99de25d7b661b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:27.382277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.382772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.383141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.415160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] MFA Rules not processed for user `3a3ff79fd50544bdbec99de25d7b661b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:27.417345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:27.446322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.447766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.448302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.448839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/97cacd15828449c48a7291478c8f5f53/users/98be7fcbcae34f96a3a301243558f916/roles/3ff4428a724f48ccacce1dda6de12055` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.452188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_grant(project_id=97cacd15828449c48a7291478c8f5f53, user_id=98be7fcbcae34f96a3a301243558f916, role_id=3ff4428a724f48ccacce1dda6de12055)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.455279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.472093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3817/7658] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:27 2021] PUT /identity/v3/projects/97cacd15828449c48a7291478c8f5f53/users/98be7fcbcae34f96a3a301243558f916/roles/3ff4428a724f48ccacce1dda6de12055 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:27.475859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.508685 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3842/7659] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:27 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:27.512925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.575881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e859-cc11-4778-8ffb-3a93d47e3053 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.585219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.586540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.586829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.587111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/98be7fcbcae34f96a3a301243558f916/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.588714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=98be7fcbcae34f96a3a301243558f916)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.592297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.601129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bae9cc-5dc2-439f-bee4-abff752d3b97 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.640156 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3818/7660] 10.222.0.13 () {58 vars in 1247 bytes} [Wed Nov 10 04:22:27 2021] GET /identity/v3/users/98be7fcbcae34f96a3a301243558f916/projects => generated 842 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:27.644867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.657506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15775a0-3dab-4d40-a8e7-281feb9c587e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.662751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.663948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.663948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.673122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.674076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.674321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/97cacd15828449c48a7291478c8f5f53` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.675039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.675553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.676272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.676590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97cacd15828449c48a7291478c8f5f53)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.678251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.680897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.712745 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3843/7661] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:27 2021] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:27.716562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.763442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cacd15828449c48a7291478c8f5f53', 'request_id': 'req-5e90deca-e45d-4536-9da5-061812220fb6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.771208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cacd15828449c48a7291478c8f5f53', 'request_id': 'req-5e90deca-e45d-4536-9da5-061812220fb6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.779287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cacd15828449c48a7291478c8f5f53', 'request_id': 'req-5e90deca-e45d-4536-9da5-061812220fb6'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.791560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0c41-f9f7-4d4e-b2cf-690c8d4860a6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.797585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] The token cache is being invalidate because project 97cacd15828449c48a7291478c8f5f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:27.797977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.798903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.805168 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3819/7662] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:27 2021] DELETE /identity/v3/projects/97cacd15828449c48a7291478c8f5f53 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:27.806219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.808507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:27.885028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.885872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.886278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.886664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.887612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.889798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.891434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90deca-e45d-4536-9da5-061812220fb6 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.897800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.898924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.899192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.899472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.901212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eee7b0f3dc974a3fba081e748b3dbdfb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.903105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.919630 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3844/7663] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:27 2021] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:27.923616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.925499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:27.939151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257494fa-aa48-4ee0-be3e-ed58c06bae05 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.947164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:27.948062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:27.948424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:27.948746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:27.949608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:27.951690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:27.967120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3845/7664] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:27 2021] GET /identity/v3/roles => generated 1649 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:27.968682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:27.968814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee7b0f3dc974a3fba081e748b3dbdfb', 'request_id': 'req-6a65de1c-225e-40ce-bb84-d51ba3832400'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.977524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee7b0f3dc974a3fba081e748b3dbdfb', 'request_id': 'req-6a65de1c-225e-40ce-bb84-d51ba3832400'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:27.980237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c87610-6e3a-43de-be9f-20795c0e4720 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:27.985615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee7b0f3dc974a3fba081e748b3dbdfb', 'request_id': 'req-6a65de1c-225e-40ce-bb84-d51ba3832400'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.002002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] The token cache is being invalidate because project eee7b0f3dc974a3fba081e748b3dbdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:28.002393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.003404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.005196 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3820/7665] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:27 2021] DELETE /identity/v3/projects/eee7b0f3dc974a3fba081e748b3dbdfb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:28.009243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.010711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.044630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.046187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.046564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.046814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] PATH_INFO: `/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9/users/d4960fe2c0184a2d9ff4375d65d43d9c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.062734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1f70b6b7bb490dbcae150b8e6e6ae9, user_id=d4960fe2c0184a2d9ff4375d65d43d9c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.065812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.080528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65de1c-225e-40ce-bb84-d51ba3832400 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.080979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3846/7666] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:27 2021] PUT /identity/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9/users/d4960fe2c0184a2d9ff4375d65d43d9c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:28.085235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.086887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.139569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.140488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.140817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.141096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/roles/3ff4428a724f48ccacce1dda6de12055` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.142722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ff4428a724f48ccacce1dda6de12055)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.149905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.154618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835149b1-d54b-4a17-bb76-620ff212b5a1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.159798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.160651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.160999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.161377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.162387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.164090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.181957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3847/7667] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:28 2021] GET /identity/v3/roles => generated 1649 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:28.182972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.192940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832a2b8-777b-4ef3-b0d5-4dab657d2603 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.193942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invalidating the token cache because role 3ff4428a724f48ccacce1dda6de12055 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:28.194332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.195164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.197861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.198808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.199156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.199496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] PATH_INFO: `/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9/users/d4960fe2c0184a2d9ff4375d65d43d9c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.201770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1f70b6b7bb490dbcae150b8e6e6ae9, user_id=d4960fe2c0184a2d9ff4375d65d43d9c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.204770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c06aa-587e-40a9-b910-32340a872ab6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.205906 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3821/7668] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:28 2021] DELETE /identity/v3/roles/3ff4428a724f48ccacce1dda6de12055 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:28.209845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.212177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.225738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3848/7669] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:28 2021] PUT /identity/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9/users/d4960fe2c0184a2d9ff4375d65d43d9c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:28.229321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.229614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.229950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.269500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] MFA Rules not processed for user `d4960fe2c0184a2d9ff4375d65d43d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:28.270826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.292867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a802ac2-19b8-433c-9fce-6ad3733805f8 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.352127 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3849/7670] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:28 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:28.354719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.356070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.356753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.357217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/98be7fcbcae34f96a3a301243558f916` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.359122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98be7fcbcae34f96a3a301243558f916)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.361172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.363259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.364942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.415254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98be7fcbcae34f96a3a301243558f916'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.425308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98be7fcbcae34f96a3a301243558f916'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.426371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98be7fcbcae34f96a3a301243558f916'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.426996 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98be7fcbcae34f96a3a301243558f916'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.429822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11838980-0c0e-491f-9611-2a749c31b456 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.434517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.435481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.435905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.436263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.439086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.440329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98be7fcbcae34f96a3a301243558f916'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.452694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.454514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.465908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3850/7671] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:28 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:28.474523 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3822/7672] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:28 2021] DELETE /identity/v3/users/98be7fcbcae34f96a3a301243558f916 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:28.478775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.480253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.505569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d4e9-3105-4809-a0f9-8027efe77583 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.520150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.521651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.586078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.587317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.587817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.588460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/dd873b36f4f74104813e6f3ca054e906` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.590460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd873b36f4f74104813e6f3ca054e906)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.593049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.610688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d772726-163e-4972-ad7f-dec2a704c8db tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.616347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.617505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.617865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.618526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.621472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.650511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd873b36f4f74104813e6f3ca054e906', 'request_id': 'req-065ab85f-bebb-483a-8a51-ada6f2313a77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.666019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd873b36f4f74104813e6f3ca054e906', 'request_id': 'req-065ab85f-bebb-483a-8a51-ada6f2313a77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.676077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd873b36f4f74104813e6f3ca054e906', 'request_id': 'req-065ab85f-bebb-483a-8a51-ada6f2313a77'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.712530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] The token cache is being invalidate because project dd873b36f4f74104813e6f3ca054e906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:28.712967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.714779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.718744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.725875 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3851/7673] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:28 2021] DELETE /identity/v3/projects/dd873b36f4f74104813e6f3ca054e906 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:28.726061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c30a08-b321-4685-b21a-01b6227766d9 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.726170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.727734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.734099 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3823/7674] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:28 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:28.829077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab85f-bebb-483a-8a51-ada6f2313a77 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:28.836804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:28.838056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.838505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.838968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/0538b9e47028460f816fd3093a3ad31a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.840466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:update_user(user_id=0538b9e47028460f816fd3093a3ad31a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:28.842283 ncdv-817176-1 devstack@keystone.service[96285]: WARNING py.warnings [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 04:22:28.842283 ncdv-817176-1 devstack@keystone.service[96285]: warnings.warn(msg) Nov 10 04:22:28.842283 ncdv-817176-1 devstack@keystone.service[96285]: Nov 10 04:22:28.844053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:28.899387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.913651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invalidating the token cache because user 0538b9e47028460f816fd3093a3ad31a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:28.913968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.915018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:28.920972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3852/7675] 10.222.0.13 () {60 vars in 1242 bytes} [Wed Nov 10 04:22:28 2021] PATCH /identity/v3/users/0538b9e47028460f816fd3093a3ad31a => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:28.926736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:28.926736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:28.926736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:28.966992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] MFA Rules not processed for user `0538b9e47028460f816fd3093a3ad31a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:28.968334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.973149 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3824/7676] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:28 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 10 04:22:28.977309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:28.979278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:28.994285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059d43-587d-4b91-97aa-d6ebdbf6678c tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:29.009924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:29.011085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.011445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.011988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/0538b9e47028460f816fd3093a3ad31a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.017326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:update_user(user_id=0538b9e47028460f816fd3093a3ad31a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:29.019249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:29.062441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.074356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invalidating the token cache because user 0538b9e47028460f816fd3093a3ad31a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:29.074788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.075650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a099834d-ac91-45b8-8f24-b6655b6f8c8a tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.082142 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3853/7677] 10.222.0.13 () {60 vars in 1242 bytes} [Wed Nov 10 04:22:28 2021] PATCH /identity/v3/users/0538b9e47028460f816fd3093a3ad31a => generated 297 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:29.083365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:29.107044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163b86-7b91-4059-9c3f-285cf507c2ef None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:29.117724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:29.118965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.119696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.120044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/0538b9e47028460f816fd3093a3ad31a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.173411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:update_user(user_id=0538b9e47028460f816fd3093a3ad31a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:29.181649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:29.246944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.267967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invalidating the token cache because user 0538b9e47028460f816fd3093a3ad31a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:29.267967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.268786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.286020 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3825/7678] 10.222.0.13 () {60 vars in 1242 bytes} [Wed Nov 10 04:22:29 2021] PATCH /identity/v3/users/0538b9e47028460f816fd3093a3ad31a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:29.287782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.288995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.289282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.329058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] MFA Rules not processed for user `0538b9e47028460f816fd3093a3ad31a`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:29.330270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:29.334263 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3854/7679] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:29 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 10 04:22:29.338938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:29.341074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:29.362339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f0c8e-f10b-4ab2-acb9-a38e8a7c0d21 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:29.369726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:29.370683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.371135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.371506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/0538b9e47028460f816fd3093a3ad31a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.374243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:update_user(user_id=0538b9e47028460f816fd3093a3ad31a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:29.376463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:29.449796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.468809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invalidating the token cache because user 0538b9e47028460f816fd3093a3ad31a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:29.469090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.469969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.472752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3826/7680] 10.222.0.13 () {60 vars in 1242 bytes} [Wed Nov 10 04:22:29 2021] PATCH /identity/v3/users/0538b9e47028460f816fd3093a3ad31a => generated 297 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:29.478143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:29.502170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec209-f0f7-4f5b-abe0-7f04a3590f16 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:29.508351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:29.509277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.509439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.509648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.510975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:29.526362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:29.578987 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3855/7681] 10.222.0.13 () {60 vars in 1142 bytes} [Wed Nov 10 04:22:29 2021] POST /identity/v3/users => generated 264 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:29.583521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:29.588368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:29.603662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf74c-8686-4ec5-9a67-2b097bd6ce81 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:29.610225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc5b5-76a6-4145-af5c-4e90c3cfb496 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:29.610723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc5b5-76a6-4145-af5c-4e90c3cfb496 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:29.611243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc5b5-76a6-4145-af5c-4e90c3cfb496 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:29.611619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc5b5-76a6-4145-af5c-4e90c3cfb496 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/6641ee4a7f4e4d249b4d67f6410db45d/password` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:29.686039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-320dc5b5-76a6-4145-af5c-4e90c3cfb496 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:29.697645 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3827/7682] 10.222.0.13 () {60 vars in 1268 bytes} [Wed Nov 10 04:22:29 2021] POST /identity/v3/users/6641ee4a7f4e4d249b4d67f6410db45d/password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:30.307220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:30.309599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:30.375950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bedec9-4c16-48d7-b6e0-35f3835ecfec tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:30.381331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:30.382317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.382597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.383091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] PATH_INFO: `/v3/users/cd4a654b819a493f967db187f140cf5a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.384061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4a654b819a493f967db187f140cf5a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:30.386597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:30.440684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4a654b819a493f967db187f140cf5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.448124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4a654b819a493f967db187f140cf5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.449038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4a654b819a493f967db187f140cf5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.461857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4a654b819a493f967db187f140cf5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.469126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4a654b819a493f967db187f140cf5a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.475356 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3856/7683] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:30 2021] DELETE /identity/v3/users/cd4a654b819a493f967db187f140cf5a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:30.479730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d856-34b8-4733-ab27-06490513c823 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.480239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d856-34b8-4733-ab27-06490513c823 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.480348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d856-34b8-4733-ab27-06490513c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.497576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-87b8d856-34b8-4733-ab27-06490513c823 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:30.499390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87b8d856-34b8-4733-ab27-06490513c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:30.564299 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3828/7684] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:30.571723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:30.573449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:30.641454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978336-0a6d-4a55-b981-f4ba25e70e66 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:30.645188 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:30.645827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.646108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.646379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.655773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:30.657237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:30.667541 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3857/7685] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:30.704096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.704391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.704703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.728234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] MFA Rules not processed for user `6641ee4a7f4e4d249b4d67f6410db45d`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:30.730560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:30.738432 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3829/7686] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:30 2021] POST /identity/v3/auth/tokens => generated 329 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 10 04:22:30.738994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:30.740850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:30.861928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56d10-7bcc-4927-913a-c2b0ea0c1af3 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:30.868043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:30.868928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.869392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.869840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.878668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:30.881741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:30.891522 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3858/7687] 10.222.0.13 () {56 vars in 1262 bytes} [Wed Nov 10 04:22:30 2021] GET /identity/v3/auth/tokens => generated 329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 10 04:22:30.895714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:30.910665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb54456-4a3a-4cfe-90ec-ac21e6f5aade None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:30.915506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:30.916369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:30.916682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:30.916955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/6641ee4a7f4e4d249b4d67f6410db45d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:30.918203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6641ee4a7f4e4d249b4d67f6410db45d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:30.920183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:30.978232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.986940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.987775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:30.988934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.000419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6641ee4a7f4e4d249b4d67f6410db45d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.017311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.018844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.038482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bdf32-08d8-4a58-b001-25c15e3d7dc9 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.043192 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3830/7688] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:30 2021] DELETE /identity/v3/users/6641ee4a7f4e4d249b4d67f6410db45d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:31.043887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.047368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.047368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.047368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] PATH_INFO: `/v3/projects/8308fac50e8442bda594fbf4e1a2f3ad` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.048768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8308fac50e8442bda594fbf4e1a2f3ad)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.051053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.058339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.061062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.135051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8308fac50e8442bda594fbf4e1a2f3ad', 'request_id': 'req-a606ec72-975a-4181-8a4e-586167fe7062'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.154764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8308fac50e8442bda594fbf4e1a2f3ad', 'request_id': 'req-a606ec72-975a-4181-8a4e-586167fe7062'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.160811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615179-211c-40dd-80bb-d9e89580a31e tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.172442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8308fac50e8442bda594fbf4e1a2f3ad', 'request_id': 'req-a606ec72-975a-4181-8a4e-586167fe7062'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.195562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] The token cache is being invalidate because project 8308fac50e8442bda594fbf4e1a2f3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:31.195969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.197820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.200451 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3859/7689] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:31 2021] DELETE /identity/v3/projects/8308fac50e8442bda594fbf4e1a2f3ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:31.204448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.205901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.253832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.254764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.255484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.255763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.256518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.258552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.291985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606ec72-975a-4181-8a4e-586167fe7062 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.296291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3831/7690] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:31 2021] POST /identity/v3/users => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:31.299844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.300887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.301033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.301129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.301542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] PATH_INFO: `/v3/users/87ac49fb9f89431db372c71d5a772ac6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.302845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ac49fb9f89431db372c71d5a772ac6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.302984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.305697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.319136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afa4a-9b63-4849-a1dd-71466ae42bd0 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.330154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.331805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.332279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.333091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.333926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.337900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.375629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ac49fb9f89431db372c71d5a772ac6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.378749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3832/7691] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:31 2021] POST /identity/v3/projects => generated 358 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:31.383488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.386853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ac49fb9f89431db372c71d5a772ac6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.387585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ac49fb9f89431db372c71d5a772ac6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.406088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ac49fb9f89431db372c71d5a772ac6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.416812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ac49fb9f89431db372c71d5a772ac6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.426767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3860/7692] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:31 2021] DELETE /identity/v3/users/87ac49fb9f89431db372c71d5a772ac6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:31.495927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557f88-560b-4aa1-8714-9bfdb6473b07 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.579668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.582118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.582408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.582717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/b95add5667fb4673854e9556f4ee55ba` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.599154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:update_user(user_id=b95add5667fb4673854e9556f4ee55ba)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.601464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.642535 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3833/7693] 10.222.0.13 () {60 vars in 1243 bytes} [Wed Nov 10 04:22:31 2021] PATCH /identity/v3/users/b95add5667fb4673854e9556f4ee55ba => generated 524 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:31.644320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.646232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.663702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bbde-60ac-4eeb-af42-58fc10384e09 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.668677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.669680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.670298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.670448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/b95add5667fb4673854e9556f4ee55ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.685499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:get_user(user_id=b95add5667fb4673854e9556f4ee55ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.687707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.692965 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3861/7694] 10.222.0.13 () {58 vars in 1220 bytes} [Wed Nov 10 04:22:31 2021] GET /identity/v3/users/b95add5667fb4673854e9556f4ee55ba => generated 390 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:31.693824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.705770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e63d-6a55-4981-8410-7d01dde48921 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.711047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.711908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.712177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.712450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/projects/4430e17e70fc4d28b94142261956b7e2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.715695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4430e17e70fc4d28b94142261956b7e2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.718402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.796071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4430e17e70fc4d28b94142261956b7e2', 'request_id': 'req-6e3d505d-af13-424e-ae63-e07b3a663620'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.811815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4430e17e70fc4d28b94142261956b7e2', 'request_id': 'req-6e3d505d-af13-424e-ae63-e07b3a663620'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.821813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4430e17e70fc4d28b94142261956b7e2', 'request_id': 'req-6e3d505d-af13-424e-ae63-e07b3a663620'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.852835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] The token cache is being invalidate because project 4430e17e70fc4d28b94142261956b7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:31.853139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.853896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:31.855843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3834/7695] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:31 2021] DELETE /identity/v3/projects/4430e17e70fc4d28b94142261956b7e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:31.859622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.861339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:31.876128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d9b2-e416-4c7c-95f7-50ab9aa2b1ba tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:31.937400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ee69fddb1d467aa5470318fda8831e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c191fcca2443d19f5df67a2d6de34b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:31.938200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:31.941051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:31.941885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] PATH_INFO: `/v3/users/b95add5667fb4673854e9556f4ee55ba` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:31.947124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b95add5667fb4673854e9556f4ee55ba)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:31.949187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:31.977267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:31.979263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.004186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95add5667fb4673854e9556f4ee55ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.011745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95add5667fb4673854e9556f4ee55ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.012670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95add5667fb4673854e9556f4ee55ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.029906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95add5667fb4673854e9556f4ee55ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.040572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95add5667fb4673854e9556f4ee55ba'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.055214 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3862/7696] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:31 2021] DELETE /identity/v3/users/b95add5667fb4673854e9556f4ee55ba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:32.056933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.059213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.079116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d505d-af13-424e-ae63-e07b3a663620 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.140511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc32ac7-e30e-4182-9034-61230609a906 tempest-UsersV3TestJSON-1349135968 tempest-UsersV3TestJSON-1349135968-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.147508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.148389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.148699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.148974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] PATH_INFO: `/v3/users/0538b9e47028460f816fd3093a3ad31a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.162841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.163827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.164136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.165280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] PATH_INFO: `/v3/projects/5db17917ec3c405ebc51fe9bb87ab950` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.165441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0538b9e47028460f816fd3093a3ad31a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.165894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db17917ec3c405ebc51fe9bb87ab950)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.167805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.168054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.233059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.240207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db17917ec3c405ebc51fe9bb87ab950', 'request_id': 'req-a9f14f90-72e7-436f-abdb-f7f1d02f412a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.240482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.241283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.246263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db17917ec3c405ebc51fe9bb87ab950', 'request_id': 'req-a9f14f90-72e7-436f-abdb-f7f1d02f412a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.255037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db17917ec3c405ebc51fe9bb87ab950', 'request_id': 'req-a9f14f90-72e7-436f-abdb-f7f1d02f412a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.255226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.265730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3263db5f-38db-426e-9198-292fe255ddeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0538b9e47028460f816fd3093a3ad31a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.275218 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3863/7697] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:32 2021] DELETE /identity/v3/users/0538b9e47028460f816fd3093a3ad31a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:32.280798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.281221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.281535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.282795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] The token cache is being invalidate because project 5db17917ec3c405ebc51fe9bb87ab950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:32.283075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.283730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.287993 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3835/7698] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:31 2021] DELETE /identity/v3/projects/5db17917ec3c405ebc51fe9bb87ab950 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:32.289370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.290713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.304911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:32.306434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.387421 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3864/7699] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:32.393207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14f90-72e7-436f-abdb-f7f1d02f412a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.398085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.399063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.399347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.399627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] PATH_INFO: `/v3/users/13da4025d1ee471fb54c9caa84d00e79` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.401055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13da4025d1ee471fb54c9caa84d00e79)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.402974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.422828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.424517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.455350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13da4025d1ee471fb54c9caa84d00e79'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.463560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13da4025d1ee471fb54c9caa84d00e79'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.464295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13da4025d1ee471fb54c9caa84d00e79'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.465200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13da4025d1ee471fb54c9caa84d00e79'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.473129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13da4025d1ee471fb54c9caa84d00e79'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.488643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704cde9-7df0-43ed-ab33-1d9228093611 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.492370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.493059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.493344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.493616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.495890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3836/7700] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:32 2021] DELETE /identity/v3/users/13da4025d1ee471fb54c9caa84d00e79 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:32.500083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.500809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.500903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.511936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.513346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e948-88a9-4674-b991-afdfe85e2070 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.524018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3865/7701] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:32.578064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5dc1-423f-4226-b9f7-8123e3fe2f8b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.583988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.585146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.585430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.585847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] PATH_INFO: `/v3/users/3a3ff79fd50544bdbec99de25d7b661b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.587310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3ff79fd50544bdbec99de25d7b661b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.589188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.644491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3ff79fd50544bdbec99de25d7b661b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.652065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3ff79fd50544bdbec99de25d7b661b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.652830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3ff79fd50544bdbec99de25d7b661b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.653456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3ff79fd50544bdbec99de25d7b661b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.664439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3ff79fd50544bdbec99de25d7b661b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:32.696242 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3837/7702] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:32 2021] DELETE /identity/v3/users/3a3ff79fd50544bdbec99de25d7b661b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:32.701605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.701890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.702261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.728837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:32.730089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.834300 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3866/7703] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:32.861746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.863492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.885350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:32.887158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:32.911405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7430-2cb3-4d3c-8474-b638047d2a4a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:32.923771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:32.924653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:32.924933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:32.925201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] PATH_INFO: `/v3/projects/771845b5ccb14866bf9884cc515c240b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:32.928801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=771845b5ccb14866bf9884cc515c240b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:32.930720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:32.997389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4c0a-3908-4353-ba8a-779a67cbe3cd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.002401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.003181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.003496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.003848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.017508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.019624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.028569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771845b5ccb14866bf9884cc515c240b', 'request_id': 'req-2cc03675-704d-4c45-90fc-b9d60b00ca4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.036773 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3838/7704] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:33.039202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.041152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.044951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771845b5ccb14866bf9884cc515c240b', 'request_id': 'req-2cc03675-704d-4c45-90fc-b9d60b00ca4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.053140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771845b5ccb14866bf9884cc515c240b', 'request_id': 'req-2cc03675-704d-4c45-90fc-b9d60b00ca4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.066619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6343a09-7362-4baa-8d45-f3a7e24b4349 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.070609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] The token cache is being invalidate because project 771845b5ccb14866bf9884cc515c240b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:33.071270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.072587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2cc03675-704d-4c45-90fc-b9d60b00ca4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.076718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3867/7705] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:32 2021] DELETE /identity/v3/projects/771845b5ccb14866bf9884cc515c240b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:33.084179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6288-c11c-466f-9e0f-39dc6c265249 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.086366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6288-c11c-466f-9e0f-39dc6c265249 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.086366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6288-c11c-466f-9e0f-39dc6c265249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.116647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9cbe6288-c11c-466f-9e0f-39dc6c265249 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:33.118898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9cbe6288-c11c-466f-9e0f-39dc6c265249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.164517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.165788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.166255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.166726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] PATH_INFO: `/v3/projects/14ec11452e1040a2b19eaeb287649bc1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.168370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ec11452e1040a2b19eaeb287649bc1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.171023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.208313 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3868/7706] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:33.211398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.211799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.212925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.242987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:33.244548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.259122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ec11452e1040a2b19eaeb287649bc1', 'request_id': 'req-bb085a8d-230e-46e7-8559-b4a41fc8901f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.269895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ec11452e1040a2b19eaeb287649bc1', 'request_id': 'req-bb085a8d-230e-46e7-8559-b4a41fc8901f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.279794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ec11452e1040a2b19eaeb287649bc1', 'request_id': 'req-bb085a8d-230e-46e7-8559-b4a41fc8901f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.302174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] The token cache is being invalidate because project 14ec11452e1040a2b19eaeb287649bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:33.302714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.305202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.307047 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3839/7707] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:33 2021] DELETE /identity/v3/projects/14ec11452e1040a2b19eaeb287649bc1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:33.311326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.313656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.325120 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3869/7708] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:33.331243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.339214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085a8d-230e-46e7-8559-b4a41fc8901f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.346873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91703-a409-4f0b-aa31-c1cfd9e4a096 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.349640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.350808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.351679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.352232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] PATH_INFO: `/v3/users/20ee69fddb1d467aa5470318fda8831e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.352922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.353585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.353860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.354129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.354812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ee69fddb1d467aa5470318fda8831e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.354949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:33.355138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.357045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.358770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.376018 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3870/7709] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:33.377639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.394026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a2d4-3b34-4615-b857-5ac0635d7ae7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.400994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.402393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.402721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.403490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.404521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.410084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.458940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ee69fddb1d467aa5470318fda8831e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.462744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3871/7710] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:33 2021] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:33.467615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.478437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ee69fddb1d467aa5470318fda8831e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.480552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ee69fddb1d467aa5470318fda8831e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.480552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ee69fddb1d467aa5470318fda8831e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.494542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ee69fddb1d467aa5470318fda8831e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.524507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3840/7711] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:33 2021] DELETE /identity/v3/users/20ee69fddb1d467aa5470318fda8831e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:33.587748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.589737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.591440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c1a4-0531-47b5-be73-4bbba569a385 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.692043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0887-8a6b-42dd-a579-5a442ed028f1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.692503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.693212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.693492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.693764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.694515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.696789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.701547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.702677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.703182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.703927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] PATH_INFO: `/v3/projects/3451e5f5107f48e79d66d4f059f87cec` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.706304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3451e5f5107f48e79d66d4f059f87cec)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.709514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.726088 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3872/7712] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:33 2021] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:33.726869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.729192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.747102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66ed1-9a1c-471d-afc2-c283d14e13df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.755397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.756217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.756521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.757000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.757744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.760341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.772676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3873/7713] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:33 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:33.776664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.782945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3451e5f5107f48e79d66d4f059f87cec', 'request_id': 'req-06fb0231-f7fb-4161-9309-7214e2a30f30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.788449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3451e5f5107f48e79d66d4f059f87cec', 'request_id': 'req-06fb0231-f7fb-4161-9309-7214e2a30f30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.791300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df270c-5302-4b9e-91c0-567fa208f404 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.795943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3451e5f5107f48e79d66d4f059f87cec', 'request_id': 'req-06fb0231-f7fb-4161-9309-7214e2a30f30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.817688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] The token cache is being invalidate because project 3451e5f5107f48e79d66d4f059f87cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:33.818246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.819063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:33.821505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3841/7714] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:33 2021] DELETE /identity/v3/projects/3451e5f5107f48e79d66d4f059f87cec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:33.825214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.826995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.882797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.884083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.884083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.884432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.887666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.887666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.902630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0231-f7fb-4161-9309-7214e2a30f30 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.904504 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3874/7715] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:33 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:33.905706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:33.908237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:33.909389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.910691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.911362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.911888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] PATH_INFO: `/v3/users/d4960fe2c0184a2d9ff4375d65d43d9c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.913618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4960fe2c0184a2d9ff4375d65d43d9c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.915957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.925300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9e09-8828-4ea1-9dcb-133e7eed813a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:33.932537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:33.933719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.934131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.934511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] PATH_INFO: `/v3/projects/0973fa38e2d14485a737470f39f7d2b2/users/732a8f0e95164b048d4479bdb0e9c1d3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:33.952946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0973fa38e2d14485a737470f39f7d2b2, user_id=732a8f0e95164b048d4479bdb0e9c1d3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:33.955501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7e7d1-5b8b-4b23-83ed-33e50fa4c736 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:33.974448 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3875/7716] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:33 2021] PUT /identity/v3/projects/0973fa38e2d14485a737470f39f7d2b2/users/732a8f0e95164b048d4479bdb0e9c1d3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:33.994353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:33.995361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:33.996715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.006143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4960fe2c0184a2d9ff4375d65d43d9c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.025660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4960fe2c0184a2d9ff4375d65d43d9c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.026575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4960fe2c0184a2d9ff4375d65d43d9c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.028814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4960fe2c0184a2d9ff4375d65d43d9c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.035230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] MFA Rules not processed for user `732a8f0e95164b048d4479bdb0e9c1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:34.036354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.045457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4960fe2c0184a2d9ff4375d65d43d9c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.071081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3842/7717] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:33 2021] DELETE /identity/v3/users/d4960fe2c0184a2d9ff4375d65d43d9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:34.109297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3876/7718] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:34.113541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.115052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.198697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d94bdc-1b6b-4910-b14b-ca087e81f0a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.199726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.201423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.215780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.217661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.217661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.217661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.218240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.220130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.293815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3843/7719] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:34.295362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.308170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323655c5-af25-4ed3-aa0b-814ce474a506 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.375913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.376894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.377284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.377666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] PATH_INFO: `/v3/projects/b3c191fcca2443d19f5df67a2d6de34b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.379594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c191fcca2443d19f5df67a2d6de34b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.383784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.400810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209633a-6769-4d5d-bb88-95c875a02922 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.409615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.411179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.411791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.412259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.414333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.417178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.448562 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3844/7720] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:34.454270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.455572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c191fcca2443d19f5df67a2d6de34b', 'request_id': 'req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.458662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.473553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c191fcca2443d19f5df67a2d6de34b', 'request_id': 'req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.477876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a1be0-555d-42ef-9a3b-ae96fe09c622 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.478034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c191fcca2443d19f5df67a2d6de34b', 'request_id': 'req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.493955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] The token cache is being invalidate because project b3c191fcca2443d19f5df67a2d6de34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:34.494299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.494933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.498021 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3877/7721] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:34 2021] DELETE /identity/v3/projects/b3c191fcca2443d19f5df67a2d6de34b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:34.498683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.500041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.538904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.539955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.540240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.540538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] PATH_INFO: `/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.542572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1f70b6b7bb490dbcae150b8e6e6ae9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.544259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.581571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6ae7-8750-4917-b7ef-3b40b2e55e8d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.588956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.590257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.590541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.590814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.592782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.594450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93686c-62c8-49ac-b34a-a98c1cbe5db3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.609161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1f70b6b7bb490dbcae150b8e6e6ae9', 'request_id': 'req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.609389 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3878/7722] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:34 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:34.611062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92c3f-1353-4776-bd8b-52a93683077a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.611355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92c3f-1353-4776-bd8b-52a93683077a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.611633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92c3f-1353-4776-bd8b-52a93683077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.617137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1f70b6b7bb490dbcae150b8e6e6ae9', 'request_id': 'req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.624510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1f70b6b7bb490dbcae150b8e6e6ae9', 'request_id': 'req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.632950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-36c92c3f-1353-4776-bd8b-52a93683077a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:34.634156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36c92c3f-1353-4776-bd8b-52a93683077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.637873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] The token cache is being invalidate because project ff1f70b6b7bb490dbcae150b8e6e6ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:34.638927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.645524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:34.648409 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3845/7723] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:34 2021] DELETE /identity/v3/projects/ff1f70b6b7bb490dbcae150b8e6e6ae9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:34.649515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.652048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.702240 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3879/7724] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:34.703921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f10efc-8c28-49ff-98a2-57342a2fad40 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.704279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f10efc-8c28-49ff-98a2-57342a2fad40 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.704645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f10efc-8c28-49ff-98a2-57342a2fad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.719392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a20d-beb5-4614-ae4d-0630bb6c8e7b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.725591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.726495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.726780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.727057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] PATH_INFO: `/v3/projects/10c4724cd1704d90845fbb88d66a5897/users/8379bb676e574cbdbfa4e78267dfb0d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.729968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-67f10efc-8c28-49ff-98a2-57342a2fad40 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:34.731406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67f10efc-8c28-49ff-98a2-57342a2fad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.741633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3880/7725] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:34.744816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.744816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.744816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.748328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c4724cd1704d90845fbb88d66a5897, user_id=8379bb676e574cbdbfa4e78267dfb0d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.751203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce49275-fb86-472b-9055-520cda05ee96 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.766454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:34.767339 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3846/7726] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:34 2021] PUT /identity/v3/projects/10c4724cd1704d90845fbb88d66a5897/users/8379bb676e574cbdbfa4e78267dfb0d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:34.767905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.768574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.769034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.769311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.789566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:34.790746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:34.848062 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3881/7727] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:34.848944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.862885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170fdb-4fae-4880-ac36-dbfa2b287258 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.867846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.868515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.868827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.869121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.869869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.871458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.878518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3847/7728] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:34.879181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.885905 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3882/7729] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:34 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:34.886211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.892887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459ced-b708-4f35-9d95-80c5f42b46ac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.897672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.898336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.898622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.898900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.899641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:34.899945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.900152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac52e7-0a32-48bc-a545-2e322b7224d2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.901706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.905676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.906320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.906598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.906875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.907602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:34.907907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.909507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.913533 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3848/7730] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:34.914332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.923664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3883/7731] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:34.924737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.932492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df34e7-b1ea-4247-b12a-6f4ef33d6acc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.937477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3414-4c04-433d-b091-eac4adbef376 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:34.938450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.939335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.939620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.939898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] PATH_INFO: `/v3/projects/10c4724cd1704d90845fbb88d66a5897/users/8379bb676e574cbdbfa4e78267dfb0d7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.941965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c4724cd1704d90845fbb88d66a5897, user_id=8379bb676e574cbdbfa4e78267dfb0d7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.942653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:34.943362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.944042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.944177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:34.944556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.945550 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:34.947520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105efc-b702-406c-bbe7-4d20863b8838 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:34.960752 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3849/7732] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:34 2021] PUT /identity/v3/projects/10c4724cd1704d90845fbb88d66a5897/users/8379bb676e574cbdbfa4e78267dfb0d7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:34.961765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:34.984418 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3884/7733] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:34.984418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:34.984418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:34.984418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.013129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] MFA Rules not processed for user `8379bb676e574cbdbfa4e78267dfb0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:35.014984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.035150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182aa6-04b4-42b8-a48e-6fd8d8d62fda admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.088094 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3885/7734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:35.093367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.095330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.096069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.097412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.097687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.098792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.100282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.103889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7eb92-aca5-4498-b970-6e30cfa9f026 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.109625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.110294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.110982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.111262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.112138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.115006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.132264 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3850/7735] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:34 2021] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:35.133472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.135911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.147957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3886/7736] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/users => generated 286 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:35.149156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.167328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06003c-d94f-4c0b-a9c1-f9402977521a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.223560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1fb4-7c60-43a4-b687-d227d435cd22 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.227906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.228555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.228866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.229278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.239197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.239969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.240369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.240925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.242051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.244924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.271470 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3887/7737] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:35.271470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.279972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652bcc1-ac67-417c-9de3-e6b8c5189e23 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.285023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.285681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.285961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.286229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.286957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.288652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.300329 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3888/7738] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:35.301402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.307484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.308969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.314278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd642-9358-4cc5-8400-b5960353a035 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.319311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.319942 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3851/7739] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:35.320849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.321857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.322262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.322544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.323282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.324891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.331318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654f7f-0def-41dc-87ac-f25929861f23 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.336429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.340273 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3889/7740] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:35.340426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.340426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.340426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.340426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.340993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.341977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.353161 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3852/7741] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:35.355944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1242f-a5e9-42e8-8c91-77167a1458ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.359052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.361634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.362302 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.362731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.362921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.363656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.365290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.375856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d508-69db-471a-ac38-6078917dc414 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.380178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3890/7742] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:35.383994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.387891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.389031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.389339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.389571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] PATH_INFO: `/v3/projects/ccca3aa9b51e4c0d96fc8fc532b9bdb6/users/48e4a81d5b474b5c8f8e4d541a3179e8/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.395743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41d36-af93-4e44-8c33-baaeb7353f23 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.400844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.401833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.402081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.402353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] PATH_INFO: `/v3/projects/5ade3889a1574c768907ec0bfe498090/users/ee660a0dc76b4aed93ec701bb1d790cb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.415119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccca3aa9b51e4c0d96fc8fc532b9bdb6, user_id=48e4a81d5b474b5c8f8e4d541a3179e8, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.418539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.423754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ade3889a1574c768907ec0bfe498090, user_id=ee660a0dc76b4aed93ec701bb1d790cb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.427171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc491564-38e2-4c82-a4ea-181cd3be91bc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.433937 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3853/7743] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:35 2021] PUT /identity/v3/projects/ccca3aa9b51e4c0d96fc8fc532b9bdb6/users/48e4a81d5b474b5c8f8e4d541a3179e8/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:35.434965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.453702 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3891/7744] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:35 2021] PUT /identity/v3/projects/5ade3889a1574c768907ec0bfe498090/users/ee660a0dc76b4aed93ec701bb1d790cb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:35.454990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7d81-73ac-4d70-baaf-92bb831accc7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.455255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7d81-73ac-4d70-baaf-92bb831accc7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.455520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7d81-73ac-4d70-baaf-92bb831accc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.485393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92fc7d81-73ac-4d70-baaf-92bb831accc7 None None] MFA Rules not processed for user `48e4a81d5b474b5c8f8e4d541a3179e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:35.486604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92fc7d81-73ac-4d70-baaf-92bb831accc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.512788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3b75-1e87-481a-b5dd-a7c7058dcd99 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.559267 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3892/7745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:35.562617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.562910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.563195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.575844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.576858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.577201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.577542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.579717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.598794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] MFA Rules not processed for user `ee660a0dc76b4aed93ec701bb1d790cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:35.600085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.655007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.656795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.667938 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3854/7746] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:35.681400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3893/7747] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:35.683953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.692300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.693796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:35.712475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750fc4-ab93-42e8-8a7a-0ea94a50f9e8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.713807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f7c4-2747-499c-becf-e7cc7f03bf11 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.716949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.718233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.718534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.718806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.729990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.731162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.731451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.732637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.736684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.736684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.736684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.737119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.754016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3894/7748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:35.769154 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3855/7749] 10.222.0.13 () {60 vars in 1298 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:35.773296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.789656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73470-19a5-4c48-a64e-b4efe64bae9a service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.799627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.807586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.807586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.807586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/a035de0566e64350a47e9e572d8028ca` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.813018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=a035de0566e64350a47e9e572d8028ca)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.817173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.850525 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3895/7750] 10.222.0.13 () {58 vars in 1379 bytes} [Wed Nov 10 04:22:35 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/a035de0566e64350a47e9e572d8028ca => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:35.855378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.871150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7561e4-3d0d-4290-a36d-749042d26c77 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.885363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.886273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.886630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.886971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.887744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.889284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.915552 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3856/7751] 10.222.0.13 () {60 vars in 1298 bytes} [Wed Nov 10 04:22:35 2021] POST /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:35.920118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.932446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378a53c-65a3-4597-8786-ba1fa700acc7 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.938027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.939869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.940008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.940232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/611803dc17224246961e3460b8de6fe7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:35.942323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=611803dc17224246961e3460b8de6fe7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:35.943741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:35.969993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3896/7752] 10.222.0.13 () {58 vars in 1379 bytes} [Wed Nov 10 04:22:35 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/611803dc17224246961e3460b8de6fe7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:35.974356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:35.985903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d9c1-918e-482f-8120-eea8aaaf37dc tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:35.991816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:35.992400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:35.992759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:35.993022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/611803dc17224246961e3460b8de6fe7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.012761 ncdv-817176-1 devstack@keystone.service[96284]: WARNING keystone.server.flask.application [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Could not find credential: 612536898f9af107628d51a9b212f4cfc177a74589f4636e659442b416344762.: keystone.exception.CredentialNotFound: Could not find credential: 612536898f9af107628d51a9b212f4cfc177a74589f4636e659442b416344762. Nov 10 04:22:36.015099 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3857/7753] 10.222.0.13 () {58 vars in 1376 bytes} [Wed Nov 10 04:22:35 2021] GET /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/611803dc17224246961e3460b8de6fe7 => generated 148 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 04:22:36.020519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.042450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e540178-cdfd-4adb-a636-281155e0b25c tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.053805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.055587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.056237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.056792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.057955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.069801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.097620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.107530 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3897/7754] 10.222.0.13 () {60 vars in 1298 bytes} [Wed Nov 10 04:22:36 2021] POST /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:36.111063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.125055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748feee-617d-4cb2-ab1c-a6fd80360cb4 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.130286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.132267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.132752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.133134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.133952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.135861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.165221 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3898/7755] 10.222.0.13 () {60 vars in 1298 bytes} [Wed Nov 10 04:22:36 2021] POST /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:36.169090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.189297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85f67-cda5-4f7e-a0a9-b79d6a580275 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.200320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.202786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef83af-c9e3-4745-b3ba-e1a7e596fba3 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.203904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.204727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.204727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.205438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.209992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.210340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.211542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.212023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.212453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] PATH_INFO: `/v3/users/732a8f0e95164b048d4479bdb0e9c1d3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.214875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=732a8f0e95164b048d4479bdb0e9c1d3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.218252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.237773 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3899/7756] 10.222.0.13 () {58 vars in 1277 bytes} [Wed Nov 10 04:22:36 2021] GET /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 865 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:36.240747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.255202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f8c1-8813-4d35-bfa3-00f259472a90 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.261454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.262662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.263733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.264399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/44988ea2fd9c4f46956d4cc5e6fe7b5f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.266943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=44988ea2fd9c4f46956d4cc5e6fe7b5f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.269365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.285741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732a8f0e95164b048d4479bdb0e9c1d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.292185 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3900/7757] 10.222.0.13 () {58 vars in 1379 bytes} [Wed Nov 10 04:22:36 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/44988ea2fd9c4f46956d4cc5e6fe7b5f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:36.296339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.312792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d80c9-6cc5-49a6-aa23-ba9046327d00 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.315256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732a8f0e95164b048d4479bdb0e9c1d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.316037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732a8f0e95164b048d4479bdb0e9c1d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.316958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732a8f0e95164b048d4479bdb0e9c1d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.322368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.324173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.324667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.325100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/ac231d2209544c97b5d0693f54d91f70` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.329343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=ac231d2209544c97b5d0693f54d91f70)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.332246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.343296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-15c46537-1c40-427c-9c0b-03ba82439dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732a8f0e95164b048d4479bdb0e9c1d3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.362002 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3901/7758] 10.222.0.13 () {58 vars in 1379 bytes} [Wed Nov 10 04:22:36 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/ac231d2209544c97b5d0693f54d91f70 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:36.367601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.370990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:36.384704 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3858/7759] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:36 2021] DELETE /identity/v3/users/732a8f0e95164b048d4479bdb0e9c1d3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:36.391824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.392111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.392523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.402735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11590ef-6886-4827-86c2-518d16dab1be tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.434225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:36.435994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:36.478527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.480009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.480359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.480881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.481982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.483705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.506384 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3902/7760] 10.222.0.13 () {60 vars in 1298 bytes} [Wed Nov 10 04:22:36 2021] POST /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2 => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:36.514172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.536269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de54f6-735e-4617-859b-55ca2e160a18 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.542621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.545878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.545878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.545878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/e037cf7bb6db4be1b1c298177475f5a2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.547635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=e037cf7bb6db4be1b1c298177475f5a2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.549254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.553355 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3903/7761] 10.222.0.13 () {58 vars in 1376 bytes} [Wed Nov 10 04:22:36 2021] GET /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/e037cf7bb6db4be1b1c298177475f5a2 => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:36.557365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.571858 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3859/7762] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:36.574164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.576539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:36.581766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72835d-06fb-45d2-afd9-81aaef076218 tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.587866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e4a81d5b474b5c8f8e4d541a3179e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.589179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.589732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.591680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/e037cf7bb6db4be1b1c298177475f5a2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.592438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=48e4a81d5b474b5c8f8e4d541a3179e8, credential_id=e037cf7bb6db4be1b1c298177475f5a2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.594926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.616924 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3904/7763] 10.222.0.13 () {58 vars in 1379 bytes} [Wed Nov 10 04:22:36 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8/credentials/OS-EC2/e037cf7bb6db4be1b1c298177475f5a2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:36.621624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.624815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:36.654398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c015745-00fb-4439-8e02-e9eda132064e tempest-EC2CredentialsTest-840784906 tempest-EC2CredentialsTest-840784906-project] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.659384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc356e-8be1-406d-b054-d3739b2aa8d7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:36.662330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.663384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.663665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.664024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] PATH_INFO: `/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.664146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:36.665127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.665485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.665866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e4a81d5b474b5c8f8e4d541a3179e8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.665993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.668922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.678930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:36.681260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27442bf0-9dd9-4f0a-867c-3a11a56944dc service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:36.693274 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3860/7764] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:36.745563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e4a81d5b474b5c8f8e4d541a3179e8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.769783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e4a81d5b474b5c8f8e4d541a3179e8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.770639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e4a81d5b474b5c8f8e4d541a3179e8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.787413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e4a81d5b474b5c8f8e4d541a3179e8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.799807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e4a81d5b474b5c8f8e4d541a3179e8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:36.820640 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3905/7765] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:36 2021] DELETE /identity/v3/users/48e4a81d5b474b5c8f8e4d541a3179e8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:36.822450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:36.822735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:36.823009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:36.849063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:36.850334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:36.960072 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3861/7766] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:36.970330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:36.985647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:37.095466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:37.096971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:37.101846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a44e-797d-48ca-ab3a-4aaeae4e7390 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:37.110433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18804-43d8-4718-a07c-cdc04e159cac None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:37.114365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:37.115028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.115313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.115556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:37.115699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:37.116430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.116730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.117091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] PATH_INFO: `/v3/projects/0973fa38e2d14485a737470f39f7d2b2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:37.118337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0973fa38e2d14485a737470f39f7d2b2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:37.120241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:37.140501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:37.141995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:37.164739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3906/7767] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:37.181067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0973fa38e2d14485a737470f39f7d2b2', 'request_id': 'req-a1b78326-d3ab-48ee-af90-f85e1fd70449'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.187330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0973fa38e2d14485a737470f39f7d2b2', 'request_id': 'req-a1b78326-d3ab-48ee-af90-f85e1fd70449'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.193891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0973fa38e2d14485a737470f39f7d2b2', 'request_id': 'req-a1b78326-d3ab-48ee-af90-f85e1fd70449'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.210782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] The token cache is being invalidate because project 0973fa38e2d14485a737470f39f7d2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:37.211218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.211925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.214319 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3862/7768] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:37 2021] DELETE /identity/v3/projects/0973fa38e2d14485a737470f39f7d2b2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:37.219808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:37.240305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f0e3-c7bc-4f3f-a9bc-ae0a8d27cf47 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:37.317921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:37.319280 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.319569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.320046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] PATH_INFO: `/v3/users/8379bb676e574cbdbfa4e78267dfb0d7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:37.321809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8379bb676e574cbdbfa4e78267dfb0d7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:37.324042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:37.428399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8379bb676e574cbdbfa4e78267dfb0d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.437526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8379bb676e574cbdbfa4e78267dfb0d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.438241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8379bb676e574cbdbfa4e78267dfb0d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.450448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8379bb676e574cbdbfa4e78267dfb0d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.462616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2f7547a0-0165-4cb9-9fe4-4b2ca9f12ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8379bb676e574cbdbfa4e78267dfb0d7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.470904 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3907/7769] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:37 2021] DELETE /identity/v3/users/8379bb676e574cbdbfa4e78267dfb0d7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:37.537917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:37.539716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:37.554789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78326-d3ab-48ee-af90-f85e1fd70449 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:37.662690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:37.664270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.664787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.665297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] PATH_INFO: `/v3/projects/ccca3aa9b51e4c0d96fc8fc532b9bdb6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:37.667012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccca3aa9b51e4c0d96fc8fc532b9bdb6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:37.673673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:37.751378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'request_id': 'req-c4a16e90-7165-4106-9fe6-1dca0019752e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.758672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'request_id': 'req-c4a16e90-7165-4106-9fe6-1dca0019752e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.773795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccca3aa9b51e4c0d96fc8fc532b9bdb6', 'request_id': 'req-c4a16e90-7165-4106-9fe6-1dca0019752e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.791135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] The token cache is being invalidate because project ccca3aa9b51e4c0d96fc8fc532b9bdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:37.791576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.793132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-c4a16e90-7165-4106-9fe6-1dca0019752e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:37.796642 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3863/7770] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:37 2021] DELETE /identity/v3/projects/ccca3aa9b51e4c0d96fc8fc532b9bdb6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:37.804901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.805400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.805606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:37.837192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:37.839102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:37.986759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3908/7771] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:37.996078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:37.996383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:37.996677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.005727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.007614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.028306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280956ce-a19f-4fda-a1e1-8b7c8474171f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.039409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:38.040725 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.053547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3864/7772] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:38.055766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.057598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.058558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.058963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.059336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] PATH_INFO: `/v3/projects/10c4724cd1704d90845fbb88d66a5897` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.060732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c4724cd1704d90845fbb88d66a5897)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.062877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.086129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff6a98-0357-48b0-87c7-d5d45513e789 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.092572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.093263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.093541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.093813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.094552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:38.094851 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.097246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.115419 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3865/7773] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:38.119594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.131729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46a97d-c0c7-4934-ae5f-6dc939f9e932 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.134323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c4724cd1704d90845fbb88d66a5897', 'request_id': 'req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:38.163719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c4724cd1704d90845fbb88d66a5897', 'request_id': 'req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:38.177766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c4724cd1704d90845fbb88d66a5897', 'request_id': 'req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:38.200094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] The token cache is being invalidate because project 10c4724cd1704d90845fbb88d66a5897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:38.200386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:38.201438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9eeeeefc-a3e0-43f3-bcd0-059b6e781d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:38.211358 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3909/7774] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:38 2021] DELETE /identity/v3/projects/10c4724cd1704d90845fbb88d66a5897 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:38.212969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73f7e-d9bd-4a44-a7a5-4c765cea747d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.213256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73f7e-d9bd-4a44-a7a5-4c765cea747d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.213598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73f7e-d9bd-4a44-a7a5-4c765cea747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.250782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.251518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.251937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.252227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.253352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.256190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.261513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f5d73f7e-d9bd-4a44-a7a5-4c765cea747d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:38.263667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f5d73f7e-d9bd-4a44-a7a5-4c765cea747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.294622 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3910/7775] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:38.296207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.296463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.296690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.317366 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3866/7776] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:38.318573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.321792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.334369 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:38.335614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.421237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f26e-74e5-49ef-acca-1e8e3faba3f2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.427596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3911/7777] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:38.428176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.431459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.431459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.431459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.431459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.433311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.434382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.448813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6c37-dbd1-4541-b609-8be451994d8a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.455952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.456810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.457202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.457402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.458664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:38.458664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.460060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.465025 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3867/7778] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:38.470305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.475037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3912/7779] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:38.480103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.486218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5af4c-7f53-4c0f-8a2e-5ecc2318586e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.495623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e7ace-f9be-453c-85c1-a74ec6feed04 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.499071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.499745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.500020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.500297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.501061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.502240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.502667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.503094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.503380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.504482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.505492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.507773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.516682 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3868/7780] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:38.519471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.536119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059caed8-6edf-4387-9646-db82995910c5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.542941 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3913/7781] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:38.547610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.621883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.623124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.623416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.623678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.624410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.626097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.641112 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3869/7782] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:38.641215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a1638-7bc0-44af-9934-1422ba70029c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.644509 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.645620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.646874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.647034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.647801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.648119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.651054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.667699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf621a-77f8-4fe8-986b-9bd0622033b0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.673576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.674711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.675003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.675483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] PATH_INFO: `/v3/projects/ba2a28125b064b74bba7dd271ece65a8/users/9c7af06366584fed9baab1e819fb9a7b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.693107 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3914/7783] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:38.693914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2a28125b064b74bba7dd271ece65a8, user_id=9c7af06366584fed9baab1e819fb9a7b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.697519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c20b13-1f4e-45ca-94e5-339b7c5d5f58 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.698848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.723988 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3870/7784] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:38 2021] PUT /identity/v3/projects/ba2a28125b064b74bba7dd271ece65a8/users/9c7af06366584fed9baab1e819fb9a7b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:38.724251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9826-490f-4bd1-82ba-64bac56b512b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.726041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.726326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.726598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.755789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] MFA Rules not processed for user `9c7af06366584fed9baab1e819fb9a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:38.757669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:38.823133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.824052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.824331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.824715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.831745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.836198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.856567 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3915/7785] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:38.861946 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3871/7786] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:38.865394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.866380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.879393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb78dd-ff80-4bfd-b587-170eaafdc373 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.879638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341913b0-2247-419d-b44d-c61efdbdfacb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.884782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.884959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.885622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.885784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.885887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.886176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.886519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.886836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.887379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.887548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:38.889812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.890013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:38.900409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3916/7787] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:38.904628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.919589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75657aaf-ca67-46ba-9918-88c810ece695 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:38.920843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3872/7788] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:38.924264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:38.986376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:38.987262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:38.987537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:38.987807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] PATH_INFO: `/v3/projects/ba96b149c18a4a1c943eacfd39275094/users/4a5fb29ee16a4ae1acdbba159a2a6a2f/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:38.994046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9be03f-383f-4d71-b10e-a58b755229ad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.000070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.001239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.001631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.002016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.003090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.005184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.007979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba96b149c18a4a1c943eacfd39275094, user_id=4a5fb29ee16a4ae1acdbba159a2a6a2f, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.011960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe0310-cd27-47ad-8b46-ef19544fec38 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.026896 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3873/7789] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:38 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:39.030795 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3917/7790] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:38 2021] PUT /identity/v3/projects/ba96b149c18a4a1c943eacfd39275094/users/4a5fb29ee16a4ae1acdbba159a2a6a2f/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:39.039297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.041454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.041794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.042039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c5aa-3719-4cea-935c-991577761ab2 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.042159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.069276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] MFA Rules not processed for user `4a5fb29ee16a4ae1acdbba159a2a6a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:39.070765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.106681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.107337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.107618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.107892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.108652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.110240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.123949 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3874/7791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:39 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:39.125294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.135471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012c3da-b4d7-41d6-b200-f0f9778f9cb8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.143353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.143571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.143680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.143915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.144812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.146633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.148895 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3918/7792] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:39.157959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.160654 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3875/7793] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:39 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:39.160810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.162966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.172375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f256b-bdd4-42a5-ae8b-e690722597ed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.177217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.178133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.178413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.178683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] PATH_INFO: `/v3/projects/781524854da145a5bfe807c4cff10bf6/users/a8f262a227104dc7a08dad38b2c6001e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.193661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=781524854da145a5bfe807c4cff10bf6, user_id=a8f262a227104dc7a08dad38b2c6001e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.196260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df5060-74d7-4df8-80af-fc79bb8c9e3c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.211853 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3876/7794] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:39 2021] PUT /identity/v3/projects/781524854da145a5bfe807c4cff10bf6/users/a8f262a227104dc7a08dad38b2c6001e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:22:39.223730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.224124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.224402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.225294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1cdbc-6e14-4371-95fa-4c55fccd3384 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.262357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] MFA Rules not processed for user `a8f262a227104dc7a08dad38b2c6001e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:39.264184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.282683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.283514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.283808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.284085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.354087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.355577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.361195 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3877/7795] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:39.361794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.366046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.366544 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3919/7796] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:39 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:39.367432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.470859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5f8a-4085-48ab-8b9e-4387f676da47 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.477090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.477995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.478274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.479601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] PATH_INFO: `/v3/users/ee660a0dc76b4aed93ec701bb1d790cb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.480877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bda56-8952-4fea-9cdf-5f3eb4359b99 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.481006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee660a0dc76b4aed93ec701bb1d790cb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.483117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.486464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.489183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.489736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.490234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.491218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.493469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.534654 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3920/7797] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:39.534868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee660a0dc76b4aed93ec701bb1d790cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.535450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.542307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee660a0dc76b4aed93ec701bb1d790cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.542914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee660a0dc76b4aed93ec701bb1d790cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.543538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee660a0dc76b4aed93ec701bb1d790cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.553111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee660a0dc76b4aed93ec701bb1d790cb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.593960 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3878/7798] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:39 2021] DELETE /identity/v3/users/ee660a0dc76b4aed93ec701bb1d790cb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:39.600080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.604048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.623856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa0ee-2604-4c40-923b-f6b287de2501 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.687562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4ea3a-06f2-41ae-8e1e-882e17611d66 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.694021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.695520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.696151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.696688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] PATH_INFO: `/v3/users/4a5fb29ee16a4ae1acdbba159a2a6a2f` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.697655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.698635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.699265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5fb29ee16a4ae1acdbba159a2a6a2f)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.699828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.701511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.702823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.704459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.706327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6ba14-def7-42f2-87d6-f58294944624 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.737473 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3879/7799] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:39.739654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.740653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.740935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.782834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5fb29ee16a4ae1acdbba159a2a6a2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.786848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:39.788172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.791167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5fb29ee16a4ae1acdbba159a2a6a2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.792894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5fb29ee16a4ae1acdbba159a2a6a2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.798946 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3880/7800] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:39.803628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.814880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd384-1e20-4804-9194-4538207a2c10 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.819643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5fb29ee16a4ae1acdbba159a2a6a2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.820882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.821605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.821881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.822155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.823289 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.825066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.833884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5fb29ee16a4ae1acdbba159a2a6a2f'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:39.840148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3881/7801] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:39 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:39.841226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.843047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.849255 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3921/7802] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:39 2021] DELETE /identity/v3/users/4a5fb29ee16a4ae1acdbba159a2a6a2f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:39.850215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:39.851867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:39.916285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33040-ce5d-408d-b3f8-3bd81df2cada admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.939894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7861-922c-4c26-8c78-96019a72287d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:39.945911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.946538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.946684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.946965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] PATH_INFO: `/v3/projects/1c7986727ef346b287e754d0de5d6143/users/a16d038e5d9d4c1ab79f2435750cb4ee/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.966386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7986727ef346b287e754d0de5d6143, user_id=a16d038e5d9d4c1ab79f2435750cb4ee, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:39.969308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdcb9c-42e9-41e3-bc69-6d9f38b22eab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:39.985672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3922/7803] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:39 2021] PUT /identity/v3/projects/1c7986727ef346b287e754d0de5d6143/users/a16d038e5d9d4c1ab79f2435750cb4ee/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:39.985880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:39.986903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.987189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.987460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.989050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:39.989337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:39.989624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:39.991535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.004294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.005756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.006596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.007788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.015876 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3882/7804] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:40.016635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.026389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5563-45a7-4069-8f0d-fd8fcf695fae service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.084019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3923/7805] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:40.086261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.090256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.102564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.103239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.103583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.103902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.104578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.106407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.106640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd6b45-e1e0-40fd-83ad-84528ad32b1c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.112246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.113152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.114116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.114116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] PATH_INFO: `/v3/users/bdc19dafb51b4f27b15011e991ed229b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.115095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc19dafb51b4f27b15011e991ed229b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.117031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.120240 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3883/7806] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:40.121236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.123844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.185759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc19dafb51b4f27b15011e991ed229b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.194890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519cbe3-1bf0-4104-abd0-bc70b21447ee admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.199394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.200447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.201513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.201856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.209921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc19dafb51b4f27b15011e991ed229b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.211985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc19dafb51b4f27b15011e991ed229b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.213328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.214762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.225122 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3884/7807] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:40.230418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc19dafb51b4f27b15011e991ed229b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.233638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.240667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-aaa39642-3ad2-4c3f-8648-220086917ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc19dafb51b4f27b15011e991ed229b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.250693 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3924/7808] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:40 2021] DELETE /identity/v3/users/bdc19dafb51b4f27b15011e991ed229b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:40.251610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4ad8-71d9-4a32-8e43-2e00dfc209cf service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.255119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a78ac-0d2c-4f22-9109-0c7489833dbf None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.255406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a78ac-0d2c-4f22-9109-0c7489833dbf None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.255682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a78ac-0d2c-4f22-9109-0c7489833dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.286487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f17a78ac-0d2c-4f22-9109-0c7489833dbf None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.287901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f17a78ac-0d2c-4f22-9109-0c7489833dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.342256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.343963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.345486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.347027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] PATH_INFO: `/v3/projects/1c7986727ef346b287e754d0de5d6143/users/a16d038e5d9d4c1ab79f2435750cb4ee/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.350820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7986727ef346b287e754d0de5d6143, user_id=a16d038e5d9d4c1ab79f2435750cb4ee, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.354815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.377087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3885/7810] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:40 2021] PUT /identity/v3/projects/1c7986727ef346b287e754d0de5d6143/users/a16d038e5d9d4c1ab79f2435750cb4ee/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:40.377456 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3925/7810] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:40.378143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.379974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.387180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.387588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.387879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.424406 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] MFA Rules not processed for user `a16d038e5d9d4c1ab79f2435750cb4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.425813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.458960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b09e8-99ca-4501-b382-059a8c8f4605 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.463883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.464954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.465305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.465603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] PATH_INFO: `/v3/projects/5ade3889a1574c768907ec0bfe498090` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.467464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ade3889a1574c768907ec0bfe498090)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.469476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.499438 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3926/7811] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:40.500475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.501860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.528792 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ade3889a1574c768907ec0bfe498090', 'request_id': 'req-391e7656-9960-4337-8dde-14abcc41137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.536246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ade3889a1574c768907ec0bfe498090', 'request_id': 'req-391e7656-9960-4337-8dde-14abcc41137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.542527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ade3889a1574c768907ec0bfe498090', 'request_id': 'req-391e7656-9960-4337-8dde-14abcc41137c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.559158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] The token cache is being invalidate because project 5ade3889a1574c768907ec0bfe498090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:40.559639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.560541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.562390 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3886/7812] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:40 2021] DELETE /identity/v3/projects/5ade3889a1574c768907ec0bfe498090 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:40.562974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.564640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.576454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12528e-519c-41cd-a988-0fc7b6ec73bc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.623604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.624242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.624518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.624818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.625357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7656-9960-4337-8dde-14abcc41137c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.626566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.628963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.629617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.629896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.630166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.631944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.687092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.688411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.688926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.689840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f796ac-cc2c-44b8-8573-6593561d8015 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.698160 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3927/7813] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:40.698456 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3887/7814] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:40.699224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.699847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e3e7-ef4c-45dc-88c2-acc5aecd0212 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.700104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e3e7-ef4c-45dc-88c2-acc5aecd0212 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.700367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e3e7-ef4c-45dc-88c2-acc5aecd0212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.701133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.713016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56388-617b-464c-931d-bcd2414e6b45 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.718932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-20d5e3e7-ef4c-45dc-88c2-acc5aecd0212 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.719128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.719997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.720274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.720549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] PATH_INFO: `/v3/projects/ba96b149c18a4a1c943eacfd39275094` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.720994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-20d5e3e7-ef4c-45dc-88c2-acc5aecd0212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.721884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba96b149c18a4a1c943eacfd39275094)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.723809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.730767 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3888/7815] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:40.741123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.741399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.741924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.766765 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.768371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.787255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba96b149c18a4a1c943eacfd39275094', 'request_id': 'req-f946c495-eea5-4d9a-9929-826488834138'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.794616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba96b149c18a4a1c943eacfd39275094', 'request_id': 'req-f946c495-eea5-4d9a-9929-826488834138'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.806628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba96b149c18a4a1c943eacfd39275094', 'request_id': 'req-f946c495-eea5-4d9a-9929-826488834138'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.827434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] The token cache is being invalidate because project ba96b149c18a4a1c943eacfd39275094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:40.827434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.827434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f946c495-eea5-4d9a-9929-826488834138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:40.829595 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3928/7816] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:40 2021] DELETE /identity/v3/projects/ba96b149c18a4a1c943eacfd39275094 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:40.837248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44162f-5454-4ec1-81e6-7af23e783102 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.837789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44162f-5454-4ec1-81e6-7af23e783102 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.837789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44162f-5454-4ec1-81e6-7af23e783102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.860919 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3889/7817] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:40.861095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ae44162f-5454-4ec1-81e6-7af23e783102 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.862307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ae44162f-5454-4ec1-81e6-7af23e783102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.863378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.883444 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3929/7818] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:22:40.885252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496cb88-6448-4af9-b29a-32af1e38574f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.885821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.886385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.886385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.892592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.893421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.893705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.893977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.894826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:40.895152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.896910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.908147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:40.909835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.909991 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3890/7819] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:40.913969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.928012 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3930/7820] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:40.929657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98c52-b152-48f0-9f35-4229910e1d47 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.932213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.936842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.937806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.938092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.938369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.939082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.941295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.951392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4433-2f3e-4b41-a2b7-9dd5d094d671 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:40.960002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:40.961115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:40.961451 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:40.961649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:40.962489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:40.962834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:40.964514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:40.977413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3931/7821] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:40.978237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.979876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:40.986992 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3891/7822] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:40.986992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:40.993298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb415a7-ecab-4b32-ad4a-a8826004c3cf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.053566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.054729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.055166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.055592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] PATH_INFO: `/v3/projects/176bc68cd6964608810431825053e026` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.056577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318c1f1-d197-4d0d-9dc1-17fc3de3006b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.057346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176bc68cd6964608810431825053e026)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.059699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.061962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.062617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.062919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.063170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.063874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.065757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.092192 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3892/7823] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:40 2021] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.093109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.125990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176bc68cd6964608810431825053e026', 'request_id': 'req-1e35be77-9942-49d7-aea4-38bc14f23af6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:41.134205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176bc68cd6964608810431825053e026', 'request_id': 'req-1e35be77-9942-49d7-aea4-38bc14f23af6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:41.142025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176bc68cd6964608810431825053e026', 'request_id': 'req-1e35be77-9942-49d7-aea4-38bc14f23af6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:41.155992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] The token cache is being invalidate because project 176bc68cd6964608810431825053e026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:41.156279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:41.156965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:41.158873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3932/7824] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:40 2021] DELETE /identity/v3/projects/176bc68cd6964608810431825053e026 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:41.159746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.161061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.175672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3c2b-6840-4ce0-87f5-cbb8d26a553e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.238177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.239074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.239194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35be77-9942-49d7-aea4-38bc14f23af6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.239369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.239784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.240815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.242927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726990b-5e15-4d81-9e5b-8096ff951a65 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.244166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.244874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.245158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.245435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.246195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.248651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.270383 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3893/7825] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.271612 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.271895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.272167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.275656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3933/7826] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.276680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.280208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.293828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db741e7-b746-40e3-85d1-bf571b2f8258 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.295662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:41.297220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.301090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.301744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.302019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.302288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.303018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.304585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4c30-ee3b-4afc-a8f2-b5ebfe43c0d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.311156 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3894/7827] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:41.312271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.321207 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3934/7828] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.322168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.322456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.322725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.327839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f066-58fa-4ecf-992d-710e7243397b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.333483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.334162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.334436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.334839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.335579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.337243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.342084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:41.343318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.350458 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3895/7829] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.350458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.358976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39210f3a-7226-4272-b551-4d347927d5bd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.359997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3935/7830] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:41.361124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.365328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.365993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.366261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.366533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.367723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.368918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.371488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897188a-f038-42a0-9d5b-613b78d75e3d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.377372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.378262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.378605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.378936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.379732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.383564 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3896/7831] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.383564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.383822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.393262 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3936/7832] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.393872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3098c-772c-42f8-b74d-865c9e0f17ec admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.395939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.398665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.399321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.399598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.399868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.400599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:41.400927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.402499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.408708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5bd8b-3507-45ca-954f-3de125ac4737 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.413796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.414662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.414934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.415202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] PATH_INFO: `/v3/projects/24808a1e4ad448aa8b47953c2db99d20/users/db173b81e5f747afb7f443d570ae1ae0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.419920 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3897/7833] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:41.419920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.430666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0932b-c5ad-4c4c-83be-c24d1846c4fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.433792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24808a1e4ad448aa8b47953c2db99d20, user_id=db173b81e5f747afb7f443d570ae1ae0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.436620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.437422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.437565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.437802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.438209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] PATH_INFO: `/v3/projects/f06d60a25afd414080d78d8d06650d15/users/2b9da6a177b7488885052100aa54830a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.450402 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3937/7834] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:41 2021] PUT /identity/v3/projects/24808a1e4ad448aa8b47953c2db99d20/users/db173b81e5f747afb7f443d570ae1ae0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:41.451003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.462078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06d60a25afd414080d78d8d06650d15, user_id=2b9da6a177b7488885052100aa54830a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.464943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f0dff-76f2-4151-9dcb-945255002c9a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.488583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3898/7835] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:41 2021] PUT /identity/v3/projects/f06d60a25afd414080d78d8d06650d15/users/2b9da6a177b7488885052100aa54830a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:41.489927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789e180-f918-4884-b3c3-d2c216e76f62 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.490342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789e180-f918-4884-b3c3-d2c216e76f62 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.490618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789e180-f918-4884-b3c3-d2c216e76f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.521397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d789e180-f918-4884-b3c3-d2c216e76f62 None None] MFA Rules not processed for user `db173b81e5f747afb7f443d570ae1ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:41.523180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d789e180-f918-4884-b3c3-d2c216e76f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.524977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6311d-86f0-4d0b-80bd-dc25664f87e6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.586764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.587561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.587965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.588339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.589162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.591448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.602024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3899/7836] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:41.603515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.603868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.604209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.629140 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3938/7837] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.630076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.640671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] MFA Rules not processed for user `2b9da6a177b7488885052100aa54830a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:41.640671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.694483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e28cc-42cd-4bb1-9e6b-a6be16b69fb7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.699426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.700079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.700356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.700685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.701387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.703255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.712124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3900/7838] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:41.713518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.730314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa70f7f-6198-4ef5-b1aa-95e9a23289d9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.736898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.737692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.737973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.738245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.739057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.741091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.744868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3939/7839] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.745890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.747521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:41.768854 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3901/7840] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.769864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.782005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de623-ed0d-4994-8378-c1579ec2f3d4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.865726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.866523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.866874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.867215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.868111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380185-2fad-4bcb-b39e-571c0691e80a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.868694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.871313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.873200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.873839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.874114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.874384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.897534 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3902/7841] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:41 2021] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:41.897534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.907711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfa126-bd96-4b11-85b8-1629075bad8e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.915310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.916985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.917374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.917745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.920314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.922344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.934183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3903/7842] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.935122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.940204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.941707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.944810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef403f-1930-4f32-b609-d9b6149e8bc9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.949635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.950347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.950714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.951049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.951463 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3940/7843] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:41.951907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.952256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.953901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.964143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96021-3ee4-438d-bd5a-76ec98a1f95a service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.965772 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3904/7844] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:41.971018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:41.976370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.977092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.977371 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.977642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.978566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:41.981041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:41.984429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d43837-a0ec-4e6b-a856-220e39a93115 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:41.990923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:41.991639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:41.992015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:41.992401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:41.993905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.000964 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3941/7845] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:42.002219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.016956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.017789 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3905/7846] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:42.022515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.030736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16114e-aac8-48e0-981d-8d78faf63385 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.033866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41497791-81c3-42dd-8162-b03320a4c2e9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.035400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.036379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.036713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.037098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] PATH_INFO: `/v3/projects/bead5623914b475eb34a08218c3363e0/users/d76980aba7d748a78e00108af0803638/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.039380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.040306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.040519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.040864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] PATH_INFO: `/v3/projects/e2d745d5e5ee4f81ba78baf626f5df4b/users/9dbc558752024eac9c9495dffe44dcc3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.062615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead5623914b475eb34a08218c3363e0, user_id=d76980aba7d748a78e00108af0803638, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.067990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d745d5e5ee4f81ba78baf626f5df4b, user_id=9dbc558752024eac9c9495dffe44dcc3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.070237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55605-b8e0-422f-a753-e13986cedc13 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.077341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675ec36-c3e7-4b9a-bb79-7ea809e51093 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.107627 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3942/7848] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:42 2021] PUT /identity/v3/projects/bead5623914b475eb34a08218c3363e0/users/d76980aba7d748a78e00108af0803638/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:42.107790 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3906/7848] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:42 2021] PUT /identity/v3/projects/e2d745d5e5ee4f81ba78baf626f5df4b/users/9dbc558752024eac9c9495dffe44dcc3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:42.118506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.118792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.118915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.119062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.119393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.119770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.155511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] MFA Rules not processed for user `d76980aba7d748a78e00108af0803638`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:42.155643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] MFA Rules not processed for user `9dbc558752024eac9c9495dffe44dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:42.156999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:42.157588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:42.231437 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3907/7849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:42 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:42.233477 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3943/7850] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:42 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:42.238034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.245143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.246737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:42.312858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0a8a0-cb17-49b7-a21c-ef0fb09a0f9f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.317407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f5185-027d-4ce0-a88a-04748ad16388 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.317740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.318552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.318839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.319315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.320148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.322307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.322953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.324073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.324413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.324732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.335402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.336878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.353759 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3944/7851] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:42 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:42.358890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3908/7852] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:42 2021] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:42.363143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.378673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056e1b-d9b3-464d-a67d-6664aff24f72 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.462463 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.462772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.463055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.463332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.464444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.466314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.492767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3945/7853] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:42 2021] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:42.496816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.509697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a4d8b-7695-4c26-8331-56b548fee28d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.517692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.518519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.518915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.519985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.520881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.522950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.546279 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3909/7854] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:42 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:42.547726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.563228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c504a50-7764-4bcb-91ae-f572c439003e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.580078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.581249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.581682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.582378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] PATH_INFO: `/v3/projects/7605cc44c6c64c09bccf0f5558d481a0/users/6d051c9a4f3346508dc510fcef5d4d4a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.627082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7605cc44c6c64c09bccf0f5558d481a0, user_id=6d051c9a4f3346508dc510fcef5d4d4a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.630657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.654553 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3946/7855] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:42 2021] PUT /identity/v3/projects/7605cc44c6c64c09bccf0f5558d481a0/users/6d051c9a4f3346508dc510fcef5d4d4a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:42.658675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.673870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967239-1b7f-4e0a-a99d-0178b5ec35cf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.749644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.750558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.750847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.752087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.752877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.755567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478eb5-d776-4324-ad21-4a0e5d33f099 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.775264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:42.783413 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3910/7856] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:42 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:42.787572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adb0ae-0a73-4377-acf4-79d2245a83df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:42.797663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:42.798672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.799323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.799780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] PATH_INFO: `/v3/projects/7605cc44c6c64c09bccf0f5558d481a0/users/6d051c9a4f3346508dc510fcef5d4d4a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.802898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7605cc44c6c64c09bccf0f5558d481a0, user_id=6d051c9a4f3346508dc510fcef5d4d4a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:42.805676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:42.819834 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3947/7857] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:42 2021] PUT /identity/v3/projects/7605cc44c6c64c09bccf0f5558d481a0/users/6d051c9a4f3346508dc510fcef5d4d4a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:42.833160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:42.833477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:42.833718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:42.894715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] MFA Rules not processed for user `6d051c9a4f3346508dc510fcef5d4d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:42.898478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:43.053468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3911/7858] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:42 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:43.067245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:43.069714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:43.163068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e57f9-6b79-4fce-b02d-d9a5121544f1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:43.167813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:43.168636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:43.169043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:43.169989 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:43.249247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:43.250800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:43.266952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3948/7859] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:44.994275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:45.009446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68563-e32b-4da6-9c93-905ebd9de5cf None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:45.014246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:45.015128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:45.015642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:45.016008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:45.106058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:45.107950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:45.132288 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3912/7860] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:44 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:46.002021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:46.015714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b146-e478-487c-8b9f-6020369fda73 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:46.019978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:46.020848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:46.021199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:46.021547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:46.033044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:46.034616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5e47-9f5a-4be7-bda5-654f6af0f57d service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:46.057492 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3949/7861] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:46 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:47.373555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:47.460003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074866-f8f0-4c8f-8cd3-443c2466f528 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:47.467367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:47.468339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:47.468856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:47.469199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] PATH_INFO: `/v3/users/2b9da6a177b7488885052100aa54830a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:47.470523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9da6a177b7488885052100aa54830a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:47.472825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:47.568407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9da6a177b7488885052100aa54830a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:47.593273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9da6a177b7488885052100aa54830a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:47.595580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9da6a177b7488885052100aa54830a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:47.597140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9da6a177b7488885052100aa54830a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:47.614106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9da6a177b7488885052100aa54830a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:47.646978 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3913/7862] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:47 2021] DELETE /identity/v3/users/2b9da6a177b7488885052100aa54830a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:47.647684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:47.648137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:47.648244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:47.672746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:47.673981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:47.766586 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3950/7863] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:47.784577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:47.787680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:47.915158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f50-0e3a-49f8-9a11-2c7e69b41cf8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:47.925538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:47.926209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:47.926594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:47.926741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:47.945740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:47.954176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd9f7-e50f-46fb-924f-f9d641656b2d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:47.976056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3914/7864] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:48.762735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:48.764815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:48.779423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179d00-897e-440c-a6a4-fd3b45440847 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:48.786977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:48.788159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:48.788719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:48.789380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] PATH_INFO: `/v3/projects/f06d60a25afd414080d78d8d06650d15` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:48.791624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06d60a25afd414080d78d8d06650d15)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:48.793942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:48.870459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06d60a25afd414080d78d8d06650d15', 'request_id': 'req-87f1cd7b-66bc-4527-b261-69173b8f6159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:48.877955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06d60a25afd414080d78d8d06650d15', 'request_id': 'req-87f1cd7b-66bc-4527-b261-69173b8f6159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:48.885655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06d60a25afd414080d78d8d06650d15', 'request_id': 'req-87f1cd7b-66bc-4527-b261-69173b8f6159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:48.928340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] The token cache is being invalidate because project f06d60a25afd414080d78d8d06650d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:48.930307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:48.932363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:48.937521 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3951/7865] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:48 2021] DELETE /identity/v3/projects/f06d60a25afd414080d78d8d06650d15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:48.945676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a8cf-25c3-497a-a8e5-2f8c3a66dee2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:48.946115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a8cf-25c3-497a-a8e5-2f8c3a66dee2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:48.946409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a8cf-25c3-497a-a8e5-2f8c3a66dee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:48.985226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-53b4a8cf-25c3-497a-a8e5-2f8c3a66dee2 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:48.986748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-53b4a8cf-25c3-497a-a8e5-2f8c3a66dee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:49.049885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.051495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:49.189121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1cd7b-66bc-4527-b261-69173b8f6159 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.195362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.196126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.196450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.196979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.199540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:49.217961 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3915/7866] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:49.227198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.227669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.228245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.256508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:49.257360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:49.268467 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3916/7867] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:49.273935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.284693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5852bb0-3c18-43dd-86fd-ad3f563cd672 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.291678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.292840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.293650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.294146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.295588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:49.298045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.300748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.324052 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3917/7868] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:22:49.336908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.349040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbb9c-5835-4441-bc0b-19b8b18a5ba7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.351167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.353232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.354844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.355504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.355784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.356252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.357446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.361129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.379377 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3952/7869] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:49 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:49.454934 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3918/7870] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:49 2021] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:49.463232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.506937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486102-45c1-4ca8-921a-e307c49a760b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.616655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.617344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.617618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.617891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.618611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.620879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.657927 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3953/7871] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:49 2021] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:22:49.661944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.680324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cb32-0813-4bef-b640-0002cbdf14a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.689112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.689935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.690606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.691197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.692308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.695728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.716183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3919/7872] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:49.720790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.736722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5f72-7434-481d-982c-782f460e6c27 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.743909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.744790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.745137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.745617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.746462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.748923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b1812-75d7-4d46-ba75-0279c0008a01 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.768293 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.773886 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3954/7873] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:49.781842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932153-792e-48ab-b298-5e19752b973d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:49.801202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:49.802118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.802515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.802806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] PATH_INFO: `/v3/projects/4be6c4098d8d4e41954d19a88075cd96/users/0ab02363def54c2baaf0c83f5377e46b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.827859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be6c4098d8d4e41954d19a88075cd96, user_id=0ab02363def54c2baaf0c83f5377e46b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:49.831451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:49.863586 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3920/7874] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:49 2021] PUT /identity/v3/projects/4be6c4098d8d4e41954d19a88075cd96/users/0ab02363def54c2baaf0c83f5377e46b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:49.869998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:49.871024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:49.871545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:49.901250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:49.904200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:49.983509 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3955/7875] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:49.990160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:49.993969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:50.089974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a462-b83e-432a-8046-49280bf1a383 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:50.094495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:50.095390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:50.095843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:50.096492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:50.109051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:50.111494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11013-3759-4ef3-8d91-333ce65a822e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:50.122950 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3921/7876] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:50.417262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:50.418882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:50.433223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e6c17-1739-4f81-8fca-7948bf942ebb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:50.448176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:50.449436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:50.449630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:50.449905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] PATH_INFO: `/v3/users/db173b81e5f747afb7f443d570ae1ae0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:50.451448 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db173b81e5f747afb7f443d570ae1ae0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:50.454490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:50.521610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db173b81e5f747afb7f443d570ae1ae0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:50.550817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db173b81e5f747afb7f443d570ae1ae0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:50.551625 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db173b81e5f747afb7f443d570ae1ae0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:50.569245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db173b81e5f747afb7f443d570ae1ae0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:50.579079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db173b81e5f747afb7f443d570ae1ae0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:50.589311 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3956/7877] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:50 2021] DELETE /identity/v3/users/db173b81e5f747afb7f443d570ae1ae0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:50.593822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:50.594121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:50.594408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:50.616632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:50.618166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:50.703697 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3922/7878] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:50.755919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:50.758327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:50.888978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea090c21-d313-4bf2-9d43-e1eb718ae537 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:50.892774 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:50.893432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:50.893711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:50.894945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:50.907714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:50.910098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:50.926891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3957/7879] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:51.489110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:51.490613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:51.520172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5238fb-1e03-4e7d-99cd-5af7c3c08df5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:51.532743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:51.534463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:51.534959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:51.535626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] PATH_INFO: `/v3/projects/24808a1e4ad448aa8b47953c2db99d20` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:51.537594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=24808a1e4ad448aa8b47953c2db99d20)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:51.541363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:51.719502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24808a1e4ad448aa8b47953c2db99d20', 'request_id': 'req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:51.728455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24808a1e4ad448aa8b47953c2db99d20', 'request_id': 'req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:51.737767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24808a1e4ad448aa8b47953c2db99d20', 'request_id': 'req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:51.757274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] The token cache is being invalidate because project 24808a1e4ad448aa8b47953c2db99d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:51.757712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:51.758573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:51.760944 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3923/7880] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:51 2021] DELETE /identity/v3/projects/24808a1e4ad448aa8b47953c2db99d20 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:51.765862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:51.787058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e148-19c5-49d8-b443-92b4eb11a52a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:51.934055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:51.935922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:51.936395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:51.937478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] PATH_INFO: `/v3/users/9dbc558752024eac9c9495dffe44dcc3` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:51.939466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbc558752024eac9c9495dffe44dcc3)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:51.941875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:52.014904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbc558752024eac9c9495dffe44dcc3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:52.024987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbc558752024eac9c9495dffe44dcc3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:52.026122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbc558752024eac9c9495dffe44dcc3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:52.044506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbc558752024eac9c9495dffe44dcc3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:52.055874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbc558752024eac9c9495dffe44dcc3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:52.069821 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3958/7881] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:51 2021] DELETE /identity/v3/users/9dbc558752024eac9c9495dffe44dcc3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:53.105189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:53.107903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:53.122840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932221-8a6a-4d28-ad0b-e38a6fb7c9ed admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:53.245243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:53.246122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:53.246651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:53.247655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] PATH_INFO: `/v3/projects/e2d745d5e5ee4f81ba78baf626f5df4b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:53.249418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d745d5e5ee4f81ba78baf626f5df4b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:53.251700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:53.347380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d745d5e5ee4f81ba78baf626f5df4b', 'request_id': 'req-8f13eedc-5de5-469a-9f2a-2c16c085cb88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.358146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d745d5e5ee4f81ba78baf626f5df4b', 'request_id': 'req-8f13eedc-5de5-469a-9f2a-2c16c085cb88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.370506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d745d5e5ee4f81ba78baf626f5df4b', 'request_id': 'req-8f13eedc-5de5-469a-9f2a-2c16c085cb88'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.396536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] The token cache is being invalidate because project e2d745d5e5ee4f81ba78baf626f5df4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:53.396843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.397730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.401126 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3924/7882] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:53 2021] DELETE /identity/v3/projects/e2d745d5e5ee4f81ba78baf626f5df4b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:53.404891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:53.406963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:53.453769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d34e9-4327-424d-b97a-b56b8bc0950e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:53.563099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:53.564278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:53.564553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:53.566597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] PATH_INFO: `/v3/users/6d051c9a4f3346508dc510fcef5d4d4a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:53.568601 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d051c9a4f3346508dc510fcef5d4d4a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:53.574633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:53.704897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d051c9a4f3346508dc510fcef5d4d4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.724620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d051c9a4f3346508dc510fcef5d4d4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.725683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d051c9a4f3346508dc510fcef5d4d4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.756716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d051c9a4f3346508dc510fcef5d4d4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.768588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9e1ff5d1-9fc4-4196-bc4e-49882689d53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d051c9a4f3346508dc510fcef5d4d4a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:53.781981 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3959/7883] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:22:53 2021] DELETE /identity/v3/users/6d051c9a4f3346508dc510fcef5d4d4a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:54.584846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:54.586380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:54.607286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eedc-5de5-469a-9f2a-2c16c085cb88 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:54.761295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:54.762400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:54.763444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:54.763895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] PATH_INFO: `/v3/projects/7605cc44c6c64c09bccf0f5558d481a0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:54.765575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7605cc44c6c64c09bccf0f5558d481a0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:54.770519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:54.868102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7605cc44c6c64c09bccf0f5558d481a0', 'request_id': 'req-0cb9f019-198e-4a7d-a2aa-f32058dd3009'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:54.885579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7605cc44c6c64c09bccf0f5558d481a0', 'request_id': 'req-0cb9f019-198e-4a7d-a2aa-f32058dd3009'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:54.900994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7605cc44c6c64c09bccf0f5558d481a0', 'request_id': 'req-0cb9f019-198e-4a7d-a2aa-f32058dd3009'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:54.930138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] The token cache is being invalidate because project 7605cc44c6c64c09bccf0f5558d481a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:22:54.930815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:54.931722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0cb9f019-198e-4a7d-a2aa-f32058dd3009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:22:54.935060 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3925/7884] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:22:54 2021] DELETE /identity/v3/projects/7605cc44c6c64c09bccf0f5558d481a0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:54.941331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:54.941846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:54.941969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:54.968415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:54.969838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:55.042305 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3960/7885] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:55.050303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.050303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.050681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.083569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:55.084905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:55.107629 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3926/7886] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:55.111570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.130764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169955b3-f6a6-4575-a84a-b89cdc7b46c7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.138892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.139598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.139927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.140236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.141051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:22:55.141377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.143016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.172797 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3961/7887] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:22:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:22:55.174287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.187719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0606a2-00ef-43ca-a0a1-36e13756e921 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.201740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.202208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.203028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.203553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.205565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.210114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.264747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3927/7888] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:55 2021] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:55.268428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.284258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d832-1ba7-4717-9d8f-7819fb850fd6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.417944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.418183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.418464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.418733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.419662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.421598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.456043 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3962/7889] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:55 2021] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:55.460486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.473625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b3bf4-369a-4139-9f1e-b2e11f204ec4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.479174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.480070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.480342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.480632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.481425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.483650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.495079 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3928/7890] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:55.499266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.516795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdcf6-f43d-4eec-90dd-30ce9c7031d7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.526292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.527810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.528319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.528801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.529714 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.531970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b492-8f5a-406c-895c-92687593efe9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.574224 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3963/7891] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:55.579102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.599267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a9166-f5c7-4365-bc9c-cb78d3435d54 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:55.605580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:55.607266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.607674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.608057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] PATH_INFO: `/v3/projects/4d62a6f0117a4f2194c44a9e41d6c3d4/users/b0f8ed76dcab4875890d7325914b22ae/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.651103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d62a6f0117a4f2194c44a9e41d6c3d4, user_id=b0f8ed76dcab4875890d7325914b22ae, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:55.654823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:55.696019 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3929/7892] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:55 2021] PUT /identity/v3/projects/4d62a6f0117a4f2194c44a9e41d6c3d4/users/b0f8ed76dcab4875890d7325914b22ae/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:55.707622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:55.708009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:55.708356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:55.778927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] MFA Rules not processed for user `b0f8ed76dcab4875890d7325914b22ae`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:55.780181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:55.973665 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3964/7893] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:55.984715 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:55.987894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:56.150656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956021-628c-4f69-b13e-54d791cef6fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:56.163364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:56.164144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:56.164530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:56.164949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:56.184462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:56.186067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a868ab-b41c-492a-96c7-a097acd32d64 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:56.202143 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3930/7894] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:55 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:56.520699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:56.523326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:56.681254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1433d8-de22-4730-86a9-19cc7513362c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:56.691814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:56.693994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:56.694377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:56.695097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:56.701481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:56.937198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:56.942321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:56.969638 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3965/7895] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:56 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:57.866241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80f973-d225-4bc1-8df0-c5c414f211c2 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:57.866707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80f973-d225-4bc1-8df0-c5c414f211c2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:57.866795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80f973-d225-4bc1-8df0-c5c414f211c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:57.895747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1d80f973-d225-4bc1-8df0-c5c414f211c2 None None] MFA Rules not processed for user `b0f8ed76dcab4875890d7325914b22ae`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:57.897205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1d80f973-d225-4bc1-8df0-c5c414f211c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:57.915232 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3931/7896] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:57.974064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:57.975642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:58.095940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8da67-9e0b-49db-82fd-50e0f9c2a354 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.100161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.101050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.101518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.101966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.105166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:58.333965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.335685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.374593 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3966/7897] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:22:58.469728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.469927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.470174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.501247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:22:58.503077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:58.568969 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3932/7898] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:22:58 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:22:58.573650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.575132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:58.644364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d5a4-7016-4c15-b28c-2843113a4ac4 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.648936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.649586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.649967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.650238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.650970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.652959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.686911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3967/7899] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:22:58 2021] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:58.688422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.701440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1290d7-9291-492c-bcb0-e03fe2cc85cb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.757613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.758243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.758526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.758798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.759502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.761464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.784098 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3933/7900] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:22:58 2021] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:22:58.787857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.798847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725498c-1e13-4e36-9c85-250d1651ffdc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.810205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.810896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.811174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.811446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.812209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.813906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.826738 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3968/7901] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:58 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:22:58.831098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.842701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bf816-dfcd-4bab-9ee5-8aaca9161f3e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.848081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.849043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.849322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.849593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] PATH_INFO: `/v3/projects/3680a125dba7419089bebecd3a577d6d/users/e4efc887205a45c2bb91fe2d16ae156e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.865911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3680a125dba7419089bebecd3a577d6d, user_id=e4efc887205a45c2bb91fe2d16ae156e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.868549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.884029 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3934/7902] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:58 2021] PUT /identity/v3/projects/3680a125dba7419089bebecd3a577d6d/users/e4efc887205a45c2bb91fe2d16ae156e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:58.888684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.900781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44873-c2c7-48c8-add4-af0d4f1585f9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.959733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.960397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.960704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.960975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.961700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:58.963277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:58.976416 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3969/7903] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:22:58 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:22:58.977688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:58.988808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5457d1-1499-4469-b984-5445c480fd49 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:58.993571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:58.994472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:58.994766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:58.995039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] PATH_INFO: `/v3/projects/3680a125dba7419089bebecd3a577d6d/users/e4efc887205a45c2bb91fe2d16ae156e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:58.997641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3680a125dba7419089bebecd3a577d6d, user_id=e4efc887205a45c2bb91fe2d16ae156e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:59.000248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:59.011879 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3935/7904] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:22:58 2021] PUT /identity/v3/projects/3680a125dba7419089bebecd3a577d6d/users/e4efc887205a45c2bb91fe2d16ae156e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:22:59.572840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:59.576824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:59.594760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:22:59.596841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:59.701038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4abf4-3069-4052-84f0-2a92bd6fd7c6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:59.765045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc3a8-b212-4ffb-b260-47bda4c06b63 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:22:59.780580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:59.781187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:59.781465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:59.781736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:59.787063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:59.791231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:22:59.792134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:22:59.792573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:22:59.792946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:22:59.795756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:22:59.812950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:59.815927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:59.840015 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3936/7905] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:22:59.941636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:22:59.942916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:22:59.969380 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3970/7906] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:22:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:03.523566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:03.542178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab933af-0ce2-4de5-83e4-4e2f0e92a0ca service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:03.555555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:03.558286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:03.558570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:03.558841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:03.569817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:03.609495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:03.611437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228945-9dbe-4a8a-ad75-c6d1b4d1b436 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:03.641358 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3937/7907] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:05.330268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:05.333617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:05.365294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086dbf-04c8-4c2e-b6c9-96ef7ff3dab5 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:05.386971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:05.388378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:05.388827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:05.389191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:05.391564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:05.463337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:05.479418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:05.517507 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3971/7908] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:07.268184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af489-f9a7-4a9e-9e09-395576d9bf87 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:07.268703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af489-f9a7-4a9e-9e09-395576d9bf87 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:07.268814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af489-f9a7-4a9e-9e09-395576d9bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:07.299225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-809af489-f9a7-4a9e-9e09-395576d9bf87 None None] MFA Rules not processed for user `e4efc887205a45c2bb91fe2d16ae156e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:07.300777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-809af489-f9a7-4a9e-9e09-395576d9bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:07.378802 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3938/7909] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:07 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:07.393421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:07.453177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98355583-851e-4c4b-94fc-baf2fbec5f78 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:07.457293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:07.458148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:07.458428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:07.458758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:07.539519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:07.541059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:07.551536 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3972/7910] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:07 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:10.597858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f85d-84c0-419b-8777-3f2a4693d02f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:10.598394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f85d-84c0-419b-8777-3f2a4693d02f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:10.598394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f85d-84c0-419b-8777-3f2a4693d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:10.618911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-00e8f85d-84c0-419b-8777-3f2a4693d02f None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:10.620437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-00e8f85d-84c0-419b-8777-3f2a4693d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:10.650710 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3939/7911] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:11.714976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:11.719058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:11.861339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2feb-cb26-427c-ac1a-d03571f78fce service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:11.866429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:11.867616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:11.868098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:11.868723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] PATH_INFO: `/v3/users/9c7af06366584fed9baab1e819fb9a7b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:11.870419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7af06366584fed9baab1e819fb9a7b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:11.873914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:11.936871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7af06366584fed9baab1e819fb9a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:11.946481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7af06366584fed9baab1e819fb9a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:11.947306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7af06366584fed9baab1e819fb9a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:11.969896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7af06366584fed9baab1e819fb9a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:11.980947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7af06366584fed9baab1e819fb9a7b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:11.988038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3973/7912] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:11 2021] DELETE /identity/v3/users/9c7af06366584fed9baab1e819fb9a7b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:11.993314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:11.993788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:11.993881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:12.013037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:12.015712 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:12.084135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3940/7913] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:12.103383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:12.105490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:12.198956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e4de-ef97-4c5a-8967-94f090dba732 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:12.205107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:12.206119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:12.206630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:12.207111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:12.220575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:12.222534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:12.258987 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3974/7914] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:23:12.601519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:12.602962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:12.620112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df94260-4fee-419d-94fb-6b0535e59564 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:12.629547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:12.630648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:12.631097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:12.631555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] PATH_INFO: `/v3/projects/ba2a28125b064b74bba7dd271ece65a8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:12.633122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2a28125b064b74bba7dd271ece65a8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:12.636186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:12.694791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2a28125b064b74bba7dd271ece65a8', 'request_id': 'req-f7a6f387-7d48-4304-9d52-5ee7eca09659'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.701954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2a28125b064b74bba7dd271ece65a8', 'request_id': 'req-f7a6f387-7d48-4304-9d52-5ee7eca09659'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.709264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2a28125b064b74bba7dd271ece65a8', 'request_id': 'req-f7a6f387-7d48-4304-9d52-5ee7eca09659'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.735083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] The token cache is being invalidate because project ba2a28125b064b74bba7dd271ece65a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:12.735477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.736191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.738554 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3941/7915] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:12 2021] DELETE /identity/v3/projects/ba2a28125b064b74bba7dd271ece65a8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:12.742343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:12.755742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3742ea-14fd-451f-8049-1a62f86398bf service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:12.876838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:12.877992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:12.878399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:12.878772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] PATH_INFO: `/v3/users/a8f262a227104dc7a08dad38b2c6001e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:12.880310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f262a227104dc7a08dad38b2c6001e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:12.883036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:12.952006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f262a227104dc7a08dad38b2c6001e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.965960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f262a227104dc7a08dad38b2c6001e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.967259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f262a227104dc7a08dad38b2c6001e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.984736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f262a227104dc7a08dad38b2c6001e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:12.998416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f262a227104dc7a08dad38b2c6001e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:13.005492 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3975/7916] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:12 2021] DELETE /identity/v3/users/a8f262a227104dc7a08dad38b2c6001e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:13.761767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:13.764470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:13.789322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f387-7d48-4304-9d52-5ee7eca09659 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:13.940196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:13.943320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:13.944706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:13.946790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] PATH_INFO: `/v3/projects/781524854da145a5bfe807c4cff10bf6` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:13.961641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781524854da145a5bfe807c4cff10bf6)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:13.964324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:14.068538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781524854da145a5bfe807c4cff10bf6', 'request_id': 'req-0e68b649-545b-4cbc-b414-ea3ff4925090'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.082797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781524854da145a5bfe807c4cff10bf6', 'request_id': 'req-0e68b649-545b-4cbc-b414-ea3ff4925090'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.093132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781524854da145a5bfe807c4cff10bf6', 'request_id': 'req-0e68b649-545b-4cbc-b414-ea3ff4925090'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.133463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] The token cache is being invalidate because project 781524854da145a5bfe807c4cff10bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:14.133976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.135824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.140998 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3942/7917] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:13 2021] DELETE /identity/v3/projects/781524854da145a5bfe807c4cff10bf6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:14.144841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:14.146987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:14.186166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616d32-660a-4028-aa66-963e5e96b19c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:14.294393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:14.298227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:14.299029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:14.299502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] PATH_INFO: `/v3/users/a16d038e5d9d4c1ab79f2435750cb4ee` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:14.301727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16d038e5d9d4c1ab79f2435750cb4ee)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:14.304996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:14.423296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16d038e5d9d4c1ab79f2435750cb4ee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.443728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16d038e5d9d4c1ab79f2435750cb4ee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.444895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16d038e5d9d4c1ab79f2435750cb4ee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.493566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16d038e5d9d4c1ab79f2435750cb4ee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.507860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16d038e5d9d4c1ab79f2435750cb4ee'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:14.548856 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3976/7918] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:14 2021] DELETE /identity/v3/users/a16d038e5d9d4c1ab79f2435750cb4ee => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:14.698569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:14.700857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:14.903596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:14.905130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:14.929795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b649-545b-4cbc-b414-ea3ff4925090 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:15.080213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ad2e-cb37-46a2-b1c8-77b26042da97 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:15.089350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:15.091358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:15.091718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:15.092362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:15.093782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:15.095128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:15.096930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:15.097316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:15.097701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:15.102921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:15.126092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:15.130333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:15.140655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:15.146399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9d221-bdb5-41b5-8130-00642356968d service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:15.165950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3977/7919] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:15.174920 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3943/7920] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:15.756941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:15.758593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:15.904475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631596-62a7-4d52-9ead-056296380d5c service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:15.910819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:15.911662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:15.912050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:15.912326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] PATH_INFO: `/v3/projects/1c7986727ef346b287e754d0de5d6143` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:15.913591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7986727ef346b287e754d0de5d6143)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:15.917060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:15.983232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7986727ef346b287e754d0de5d6143', 'request_id': 'req-526cd00b-856a-4268-b6e5-149e841665c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:15.993147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7986727ef346b287e754d0de5d6143', 'request_id': 'req-526cd00b-856a-4268-b6e5-149e841665c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:16.000326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7986727ef346b287e754d0de5d6143', 'request_id': 'req-526cd00b-856a-4268-b6e5-149e841665c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:16.024222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] The token cache is being invalidate because project 1c7986727ef346b287e754d0de5d6143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:16.024222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:16.025147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-526cd00b-856a-4268-b6e5-149e841665c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:16.032900 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3978/7921] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:15 2021] DELETE /identity/v3/projects/1c7986727ef346b287e754d0de5d6143 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:16.035363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.035862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.035985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.067157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:16.070309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:16.152028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3944/7922] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:16.160481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.160887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.161220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.183469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:16.184874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:16.195439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3979/7923] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:16.199615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.211944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9be80-b199-44f8-b74b-e14608d39f7b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.219487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.220652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.221190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.221727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.222755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:16.223306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.225287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.247819 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3945/7924] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:23:16.248980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.260639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a0433-8e7c-4744-986e-bf4a10edb367 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.266134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.267449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.272863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.273501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.274454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.276708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.326083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.329279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3980/7925] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:16.345513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d8ae3-28f3-4f42-b911-ff72b6c1122f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.435667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.436827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.437443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.437581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.438261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.443711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.490496 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3946/7926] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:16.494594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.507880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8341-7852-4fdf-a291-787eb233a9d6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.523347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.524496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.524982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.525434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.526377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.528920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.547755 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3981/7927] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:16.551589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.568501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9412-8884-4d21-a6ec-5d8a228a67c6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.584355 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.585584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.585714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.585977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.589219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.591423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46903a-7518-4466-bab1-42ea4e67c8d8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.628238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:16.639073 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3947/7928] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:16.647821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2b568-3fa7-4dd9-b1f0-eda2cb1f88a5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:16.659194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:16.661040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.661931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.663997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] PATH_INFO: `/v3/projects/b2fa98054123484aa2faa30e5e88dbb9/users/00d9b616d75a4018824473d4a31f50cc/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.707792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fa98054123484aa2faa30e5e88dbb9, user_id=00d9b616d75a4018824473d4a31f50cc, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:16.725921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:16.749252 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3982/7929] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:16 2021] PUT /identity/v3/projects/b2fa98054123484aa2faa30e5e88dbb9/users/00d9b616d75a4018824473d4a31f50cc/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:16.760678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:16.760977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:16.761371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:16.802442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] MFA Rules not processed for user `00d9b616d75a4018824473d4a31f50cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:16.804563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:16.960184 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3948/7930] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:16.963895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.035076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea424f6f-ca2d-43fb-924a-5db2cc98886b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.040386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.041100 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.041382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.041658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.042623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.044753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.080102 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3983/7931] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:16 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:23:17.083834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.102146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a087c8-341a-4299-9a4e-d4f94fc3966d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.179986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.181328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.184873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.185238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.186349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.189977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.224037 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3949/7932] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:17 2021] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:17.227636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.239039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878fc9b-64a2-4bc6-9e86-f38028ebcd03 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.247426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.248099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.248637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.249093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.250026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.251782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.269268 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3984/7933] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:17 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:23:17.273708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.286976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cea2-f7e2-4772-805c-6af481fb4ca5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.292850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.294692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.295264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.295541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] PATH_INFO: `/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66/users/eae5185258614a738a3f1c9810583ea7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.314350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5d40fbd9d44af832c25a2fab96e66, user_id=eae5185258614a738a3f1c9810583ea7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.317633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.336070 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3950/7934] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:17 2021] PUT /identity/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66/users/eae5185258614a738a3f1c9810583ea7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:17.340126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.350087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97048e-eeaf-4e74-9043-e0a754e49c34 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.431804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.433979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.434356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.434689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.436292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.438773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfe654-43ed-4fb1-a55a-290472d932fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.482746 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3985/7935] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:17 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:17.487460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.507302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fa27f-aeb6-40ce-87b4-550be1e0471b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.513580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.515443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.515824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.516266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] PATH_INFO: `/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66/users/eae5185258614a738a3f1c9810583ea7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.521939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5d40fbd9d44af832c25a2fab96e66, user_id=eae5185258614a738a3f1c9810583ea7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.525470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.550672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3951/7936] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:17 2021] PUT /identity/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66/users/eae5185258614a738a3f1c9810583ea7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:17.550825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.551028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.551306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.597689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] MFA Rules not processed for user `eae5185258614a738a3f1c9810583ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:17.598934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:17.752295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:17.754259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:17.764577 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3986/7937] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:17 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:17.836936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9f42-376b-4c00-afab-6774b0cf185a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:17.842303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:17.843220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:17.843501 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:17.843850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:17.855651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:17.858335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3c6c-8652-48af-b52a-5f46a4d9040f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:17.870317 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3952/7938] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:17 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:20.150867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:20.245553 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1713c02-e4e2-43e0-b677-cde8bdfd564e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:20.250936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:20.252194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:20.252341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:20.252508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] PATH_INFO: `/v3/users/00d9b616d75a4018824473d4a31f50cc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:20.253793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d9b616d75a4018824473d4a31f50cc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:20.256217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:20.314002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d9b616d75a4018824473d4a31f50cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:20.325074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d9b616d75a4018824473d4a31f50cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:20.325818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d9b616d75a4018824473d4a31f50cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:20.340030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d9b616d75a4018824473d4a31f50cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:20.351824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d9b616d75a4018824473d4a31f50cc'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:20.362361 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3987/7939] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:20 2021] DELETE /identity/v3/users/00d9b616d75a4018824473d4a31f50cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:20.366643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f154-c053-4618-b729-3904e92066ad None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:20.367206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f154-c053-4618-b729-3904e92066ad None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:20.367206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f154-c053-4618-b729-3904e92066ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:20.387264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7468f154-c053-4618-b729-3904e92066ad None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:20.391754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7468f154-c053-4618-b729-3904e92066ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:20.459115 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3953/7940] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:20.469388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:20.471032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:20.540496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e79d-fec9-44cf-b4d9-05dcb1066ae6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:20.546488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:20.547149 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:20.547431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:20.547708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:20.560837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:20.562407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:20.574016 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3988/7941] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:20.916015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f154-c053-4618-b729-3904e92066ad None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:20.917469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7468f154-c053-4618-b729-3904e92066ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:20.931204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f154-c053-4618-b729-3904e92066ad None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:20.935955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:20.936844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:20.937118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:20.937388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] PATH_INFO: `/v3/projects/b2fa98054123484aa2faa30e5e88dbb9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:20.944797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fa98054123484aa2faa30e5e88dbb9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:20.946981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:20.996946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fa98054123484aa2faa30e5e88dbb9', 'request_id': 'req-f00962aa-a08c-4f41-9a07-ccb05c42d51f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.010594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fa98054123484aa2faa30e5e88dbb9', 'request_id': 'req-f00962aa-a08c-4f41-9a07-ccb05c42d51f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.025432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fa98054123484aa2faa30e5e88dbb9', 'request_id': 'req-f00962aa-a08c-4f41-9a07-ccb05c42d51f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.042672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] The token cache is being invalidate because project b2fa98054123484aa2faa30e5e88dbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:21.043079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.044141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.045703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3954/7942] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:20 2021] DELETE /identity/v3/projects/b2fa98054123484aa2faa30e5e88dbb9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:21.049807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:21.063634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e55b4-f1cc-49c2-b005-94905f637d69 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:21.162631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:21.165229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:21.166076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:21.166472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] PATH_INFO: `/v3/users/eae5185258614a738a3f1c9810583ea7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:21.168372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae5185258614a738a3f1c9810583ea7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:21.170689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:21.264576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae5185258614a738a3f1c9810583ea7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.275727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae5185258614a738a3f1c9810583ea7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.280771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae5185258614a738a3f1c9810583ea7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.300676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae5185258614a738a3f1c9810583ea7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.316894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-cffb9006-4044-4dec-b852-562d63b24352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae5185258614a738a3f1c9810583ea7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:21.332957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3989/7943] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:21 2021] DELETE /identity/v3/users/eae5185258614a738a3f1c9810583ea7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:22.135624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.137130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:22.156771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00962aa-a08c-4f41-9a07-ccb05c42d51f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.231264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.233012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.233517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.233961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] PATH_INFO: `/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.235487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc5d40fbd9d44af832c25a2fab96e66)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.237941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.333346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc5d40fbd9d44af832c25a2fab96e66', 'request_id': 'req-e4448c66-6c88-4630-9d70-e7f5cbfa3319'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:22.343270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc5d40fbd9d44af832c25a2fab96e66', 'request_id': 'req-e4448c66-6c88-4630-9d70-e7f5cbfa3319'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:22.374973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc5d40fbd9d44af832c25a2fab96e66', 'request_id': 'req-e4448c66-6c88-4630-9d70-e7f5cbfa3319'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:22.399656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] The token cache is being invalidate because project 9cc5d40fbd9d44af832c25a2fab96e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:22.400055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:22.403407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e4448c66-6c88-4630-9d70-e7f5cbfa3319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:22.405271 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3955/7944] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:22 2021] DELETE /identity/v3/projects/9cc5d40fbd9d44af832c25a2fab96e66 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:22.410891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.411361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.411524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.449429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:22.450986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:22.549608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3990/7945] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:22.554170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.554368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.554651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.588340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:22.593515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:22.614162 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3956/7946] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:22.614331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.626020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89f2fa-8ff2-4d95-94c5-2946ec259047 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.638025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.638761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.639046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.639320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.640070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:22.640376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.642010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.658029 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3991/7947] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:23:22.662330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.675837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f2d4b-6aa5-4612-a4ac-19896b33f393 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.691009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.692045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.692327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.692652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.693536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.696669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.742590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3957/7948] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:22 2021] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:22.746816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.758085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2701f-bdfd-4849-b44d-6c8982e20e7b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.832306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.833195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.833863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.834140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.835030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.837687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.863792 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3992/7949] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:22 2021] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:22.868180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.889275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d989f8-922e-495e-8d40-70c8d554dc88 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.894673 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.895348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.895633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.895910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.896700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.898473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.910445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3958/7950] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:22 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:23:22.914221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.926397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a1e7-3998-48b2-9446-e416b3edadb2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.932274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.932977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.934006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.934297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:22.935106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:22.936863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571cb2b-d5b7-4320-a7fe-ea4a16c9e15a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:22.952979 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3993/7951] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:22.957168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:22.970860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb255db-5f68-4127-8997-77c79a88eceb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:22.983050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:22.985030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:22.986658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:22.987966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] PATH_INFO: `/v3/projects/2227e864b2894d59be84a55b3fac7286/users/57a2de352b6444ebbf3d25b409ea4c55/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.007530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2227e864b2894d59be84a55b3fac7286, user_id=57a2de352b6444ebbf3d25b409ea4c55, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.011808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.042843 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3959/7952] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:22 2021] PUT /identity/v3/projects/2227e864b2894d59be84a55b3fac7286/users/57a2de352b6444ebbf3d25b409ea4c55/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:23.128678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.129592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.129876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.159296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] MFA Rules not processed for user `57a2de352b6444ebbf3d25b409ea4c55`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:23.161203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:23.231543 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3994/7953] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:23.236174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.307378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcd14-6703-4984-bdbe-f49a1c04e0be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.312645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.313634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.314020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.314397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.315354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.317502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.348546 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3960/7954] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:23 2021] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:23.353484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.374917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e270726-66a7-457a-9e0e-da0dc5843bed None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.434889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.435636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.435841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.436121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.437011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.438998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.463512 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3995/7955] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:23 2021] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:23.464367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.475647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c036c-ebc8-4cf4-8c87-f7ab03378f3c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.480236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.480952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.481233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.481504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.482239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.483840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.496173 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3961/7956] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:23:23.501487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.512297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4653ae-63ee-4fc1-add7-f2054a6297da admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.517073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.517960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.518240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.518509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] PATH_INFO: `/v3/projects/c98d022c11dd4884ac4b47167e7766ca/users/c002adb463d6483d9c5fbf785d1147e7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.535041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98d022c11dd4884ac4b47167e7766ca, user_id=c002adb463d6483d9c5fbf785d1147e7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.538010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.551434 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3996/7957] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:23 2021] PUT /identity/v3/projects/c98d022c11dd4884ac4b47167e7766ca/users/c002adb463d6483d9c5fbf785d1147e7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:23:23.555508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.568924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617781d-6bc7-49c9-923c-9cdeb96d6187 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.627079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.627623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.627900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.628173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.628934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.630788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84122-8bf3-4a1b-8629-ae1c9d18734a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.644056 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3962/7958] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:23:23.645289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.655332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970ccc-0755-4e78-8e1f-41023aab1ffe admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.660027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.660946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.661219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.661489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] PATH_INFO: `/v3/projects/c98d022c11dd4884ac4b47167e7766ca/users/c002adb463d6483d9c5fbf785d1147e7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.663474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98d022c11dd4884ac4b47167e7766ca, user_id=c002adb463d6483d9c5fbf785d1147e7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.666466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.678439 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3997/7959] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:23 2021] PUT /identity/v3/projects/c98d022c11dd4884ac4b47167e7766ca/users/c002adb463d6483d9c5fbf785d1147e7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:23.692521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.692853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.693133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.725137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] MFA Rules not processed for user `c002adb463d6483d9c5fbf785d1147e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:23.725921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:23.827658 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3963/7960] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:23 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:23.833272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.848734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743637f3-e7a3-4ca4-88fa-080f4a15e980 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.861659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c002adb463d6483d9c5fbf785d1147e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98d022c11dd4884ac4b47167e7766ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.862672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.863236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.863757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.865718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:23.866269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.869076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.888193 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3998/7961] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:23:23.889563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.901692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d0f6-a593-442f-80b0-348bd87d6171 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:23.907250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c002adb463d6483d9c5fbf785d1147e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98d022c11dd4884ac4b47167e7766ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:23.907918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:23.908197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:23.908470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:23.909459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:23.911450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:23.946498 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3964/7962] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:23 2021] POST /identity/v3/projects => generated 350 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:23.952363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:23.965606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03db-de1e-4af2-8e78-c50aba427075 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:24.067776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c002adb463d6483d9c5fbf785d1147e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98d022c11dd4884ac4b47167e7766ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:24.068857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:24.069144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:24.069426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:24.071289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:24.071876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:24.075174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:24.092521 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 3999/7963] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:23:24.102302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:24.107095 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:24.189607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4085ae-200d-4b99-abaf-83b86b5c71a3 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:24.194254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:24.194922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:24.195379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:24.195663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:24.208419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:24.209733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:24.221485 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3965/7964] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:24 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:26.095347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:26.106920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecbf6-6d8d-4e8b-a8bb-ecfedfa69944 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:26.111902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c002adb463d6483d9c5fbf785d1147e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98d022c11dd4884ac4b47167e7766ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:26.112813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:26.113096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:26.113373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] PATH_INFO: `/v3/projects/28130ccb2d524c94bf6c4370ea65f0ec` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:26.114584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28130ccb2d524c94bf6c4370ea65f0ec)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:26.116505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:26.164531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28130ccb2d524c94bf6c4370ea65f0ec', 'request_id': 'req-171bf0cb-d87d-4b69-8510-415de1349072'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.170629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28130ccb2d524c94bf6c4370ea65f0ec', 'request_id': 'req-171bf0cb-d87d-4b69-8510-415de1349072'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.178013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28130ccb2d524c94bf6c4370ea65f0ec', 'request_id': 'req-171bf0cb-d87d-4b69-8510-415de1349072'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.192230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] The token cache is being invalidate because project 28130ccb2d524c94bf6c4370ea65f0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:26.192597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.193345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-171bf0cb-d87d-4b69-8510-415de1349072 tempest-QuotasNegativeTest-992281987 tempest-QuotasNegativeTest-992281987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.194927 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4000/7965] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:26 2021] DELETE /identity/v3/projects/28130ccb2d524c94bf6c4370ea65f0ec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:26.200689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:26.273277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155590e-b85c-457c-95a6-ce9d649495bf service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:26.328344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:26.329503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:26.329786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:26.330055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] PATH_INFO: `/v3/users/57a2de352b6444ebbf3d25b409ea4c55` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:26.331383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a2de352b6444ebbf3d25b409ea4c55)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:26.333742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:26.382925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a2de352b6444ebbf3d25b409ea4c55'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.390360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a2de352b6444ebbf3d25b409ea4c55'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.391224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a2de352b6444ebbf3d25b409ea4c55'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.391921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a2de352b6444ebbf3d25b409ea4c55'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.402039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a2de352b6444ebbf3d25b409ea4c55'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:26.420931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3966/7966] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:26 2021] DELETE /identity/v3/users/57a2de352b6444ebbf3d25b409ea4c55 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:26.425433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:26.425946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:26.426316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:26.445621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:26.446942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:26.515878 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4001/7967] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:26.528010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:26.529512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:26.606670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6413-8f22-477e-8b4e-849e08e17e95 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:26.610784 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:26.611525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:26.611922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:26.612258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:26.623572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:26.625505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:26.635962 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3967/7968] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:27.183072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:27.186070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:27.202883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dc866-ff30-4d68-9bb4-1a932d534984 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:27.210034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:27.211769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:27.212337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:27.212876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] PATH_INFO: `/v3/projects/2227e864b2894d59be84a55b3fac7286` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:27.214657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2227e864b2894d59be84a55b3fac7286)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:27.219123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:27.293281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2227e864b2894d59be84a55b3fac7286', 'request_id': 'req-652155b8-34de-4e38-8d9e-54db5a3f4b7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.300687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2227e864b2894d59be84a55b3fac7286', 'request_id': 'req-652155b8-34de-4e38-8d9e-54db5a3f4b7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.313986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2227e864b2894d59be84a55b3fac7286', 'request_id': 'req-652155b8-34de-4e38-8d9e-54db5a3f4b7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.336896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] The token cache is being invalidate because project 2227e864b2894d59be84a55b3fac7286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:27.337578 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.338422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.342144 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4002/7969] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:27 2021] DELETE /identity/v3/projects/2227e864b2894d59be84a55b3fac7286 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:27.346436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:27.359250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8821-789c-4e7e-800c-d31b957200fe service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:27.442055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:27.444310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:27.444666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:27.446460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] PATH_INFO: `/v3/users/c002adb463d6483d9c5fbf785d1147e7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:27.447530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c002adb463d6483d9c5fbf785d1147e7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:27.450257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:27.521567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c002adb463d6483d9c5fbf785d1147e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.543762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c002adb463d6483d9c5fbf785d1147e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.548639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c002adb463d6483d9c5fbf785d1147e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.549418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c002adb463d6483d9c5fbf785d1147e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.563861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95373909-e1b0-48e2-b46f-cc2b0e04a7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c002adb463d6483d9c5fbf785d1147e7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:27.605487 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3968/7970] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:27 2021] DELETE /identity/v3/users/c002adb463d6483d9c5fbf785d1147e7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:28.270200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.271660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:28.306984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652155b8-34de-4e38-8d9e-54db5a3f4b7d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:28.397204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:28.398427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.398809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.399666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] PATH_INFO: `/v3/projects/c98d022c11dd4884ac4b47167e7766ca` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.401102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98d022c11dd4884ac4b47167e7766ca)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:28.403919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:28.469745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98d022c11dd4884ac4b47167e7766ca', 'request_id': 'req-237c9c79-512e-4546-b847-842c41710799'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:28.475847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98d022c11dd4884ac4b47167e7766ca', 'request_id': 'req-237c9c79-512e-4546-b847-842c41710799'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:28.484147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98d022c11dd4884ac4b47167e7766ca', 'request_id': 'req-237c9c79-512e-4546-b847-842c41710799'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:28.497710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] The token cache is being invalidate because project c98d022c11dd4884ac4b47167e7766ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:28.497992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:28.498613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-237c9c79-512e-4546-b847-842c41710799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:28.500166 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4003/7971] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:28 2021] DELETE /identity/v3/projects/c98d022c11dd4884ac4b47167e7766ca => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:28.506117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.506947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.507184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.527024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:28.528870 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:28.613763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3969/7972] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:28.622435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.622792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.623089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.645666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:28.646903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:28.656576 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4004/7973] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:28.660464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.682150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc658d2-b162-4188-9bb6-90808a17c6bc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:28.688317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:28.689016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.689333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.689743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.690500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:28.690805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:28.692602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:28.708130 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3970/7974] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:23:28.712173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.722600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af1f0-7c12-4e50-baed-48a0a4f6057b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:28.735945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:28.736656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.737138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.737574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.739356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:28.741513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:28.778244 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4005/7975] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:28 2021] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:28.782181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.793370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4c4f-0d40-4aaf-ba68-ff9f013c8be3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:28.873069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:28.874397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.874952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.875481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.876421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:28.878521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:28.923190 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3971/7976] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:28 2021] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:28.924055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.935556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254094d-51b1-4077-8dda-593eaec33134 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:28.947121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:28.947870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:28.948572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:28.949512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:28.950322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:28.952050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:28.970952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4006/7977] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:28 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:28.972137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:28.987656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ffc37-9555-4e48-993b-3176cbdc5d4f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.000230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.001108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.001453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.001790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.002598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.004718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb897cc-72be-4e35-972a-fae2f1063f0e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.024212 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3972/7978] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:28 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:29.028500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.046682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8f233-5ab8-4513-a123-3d8734b0d134 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.055825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.057208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.057208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.057564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] PATH_INFO: `/v3/projects/d211a3fb0da444ed93f655b3f2dee7e0/users/32befa8818844690af17930ce0ea7b0a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.079736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d211a3fb0da444ed93f655b3f2dee7e0, user_id=32befa8818844690af17930ce0ea7b0a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.082667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.096652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4007/7979] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:29 2021] PUT /identity/v3/projects/d211a3fb0da444ed93f655b3f2dee7e0/users/32befa8818844690af17930ce0ea7b0a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:23:29.109451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.110129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.110496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.139918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] MFA Rules not processed for user `32befa8818844690af17930ce0ea7b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:29.141228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:29.221681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3973/7980] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:29 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:29.226443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.296496 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646d52-df29-45e4-b55a-3d1e0afcbb1d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.301587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.302241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.302520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.302824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.303520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.305444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.337379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4008/7981] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:29 2021] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:29.338472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.350307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b71e4-af3e-43af-a6e4-088ccd76881c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.437613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.438431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.438802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.439174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.440018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.442251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.468470 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3974/7982] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:29 2021] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:29.470440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.494650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509a66-236f-4fde-a4f3-2e623b9ef38e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.500328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.501257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.502152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.503252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.504855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.506683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.521269 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4009/7983] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:29 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:29.524294 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.535700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719e5f-c86e-44d9-a4ea-91b6a468fe6b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.543487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.548075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.548555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.549058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] PATH_INFO: `/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b/users/f61c1c2150dc4c29a734c5435e9a35d0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.568762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce0d53096e4ee8b9d2397eda9a6c8b, user_id=f61c1c2150dc4c29a734c5435e9a35d0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.571764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.590229 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3975/7984] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:29 2021] PUT /identity/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b/users/f61c1c2150dc4c29a734c5435e9a35d0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:29.594198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.604153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dca08-d3a1-44c0-8b75-c401344f0fb1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.665585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.666576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.667090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.667557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.669270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.671091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5891e80-34bf-4158-9499-eb5950193a25 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.683358 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4010/7985] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:29 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:29.687369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.700532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d18-d960-4cc1-9d8b-3a042282a82b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.706353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.707458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.707744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.708019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] PATH_INFO: `/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b/users/f61c1c2150dc4c29a734c5435e9a35d0/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.710361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce0d53096e4ee8b9d2397eda9a6c8b, user_id=f61c1c2150dc4c29a734c5435e9a35d0, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.713600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.743585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.743869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.744483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.748212 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3976/7986] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:29 2021] PUT /identity/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b/users/f61c1c2150dc4c29a734c5435e9a35d0/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:29.779130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] MFA Rules not processed for user `f61c1c2150dc4c29a734c5435e9a35d0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:29.780706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:29.871407 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4011/7987] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:29 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:29.882337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:29.884127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:29.942669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc065cb-3f8f-4dfd-b70b-140f04290aaa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:29.946363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:29.947003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:29.947278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:29.947543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:29.957674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:29.959107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:29.970121 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3977/7988] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:29 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:30.527407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:30.530222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:30.641241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b65de-0efb-41de-96f8-8d723fc20ea8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:30.649150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:30.649807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:30.650296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:30.650734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:30.653335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:30.672185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:30.675946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1a94-cc55-42bb-8b66-b0bacb99cfa8 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:30.694554 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4012/7989] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:33.311357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:33.381327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672693ce-d45d-4def-8112-645bca3e2083 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:33.387823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:33.388746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:33.389210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:33.389589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] PATH_INFO: `/v3/users/32befa8818844690af17930ce0ea7b0a` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:33.391202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32befa8818844690af17930ce0ea7b0a)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:33.393357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:33.499762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32befa8818844690af17930ce0ea7b0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:33.517005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32befa8818844690af17930ce0ea7b0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:33.518116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32befa8818844690af17930ce0ea7b0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:33.519305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32befa8818844690af17930ce0ea7b0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:33.544371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32befa8818844690af17930ce0ea7b0a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:33.588924 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3978/7990] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:33 2021] DELETE /identity/v3/users/32befa8818844690af17930ce0ea7b0a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:33.593256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:33.593800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:33.593911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:33.612942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:33.614178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:33.695414 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4013/7991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:33.706977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:33.708494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:33.815067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfec87e-d050-4059-86ce-c3da60fced14 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:33.819730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:33.820649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:33.821118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:33.821855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:33.850219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:33.851867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:33.865250 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3979/7992] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:34.588038 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:34.591085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:34.616108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8da2fe-e828-4900-b836-d9a038cf117f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:34.623895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:34.625831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:34.626633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:34.627164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] PATH_INFO: `/v3/projects/d211a3fb0da444ed93f655b3f2dee7e0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:34.629021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d211a3fb0da444ed93f655b3f2dee7e0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:34.631758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:34.714486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd211a3fb0da444ed93f655b3f2dee7e0', 'request_id': 'req-df27e166-2294-4822-a7bf-dd8d9a3f8634'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.723077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd211a3fb0da444ed93f655b3f2dee7e0', 'request_id': 'req-df27e166-2294-4822-a7bf-dd8d9a3f8634'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.733072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd211a3fb0da444ed93f655b3f2dee7e0', 'request_id': 'req-df27e166-2294-4822-a7bf-dd8d9a3f8634'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.753326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] The token cache is being invalidate because project d211a3fb0da444ed93f655b3f2dee7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:34.753633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.754348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.756184 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4014/7993] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:34 2021] DELETE /identity/v3/projects/d211a3fb0da444ed93f655b3f2dee7e0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:34.760342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:34.771271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff7d-39b5-48a5-9c58-2d30f7c3f601 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:34.860868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:34.862023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:34.862476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:34.862915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] PATH_INFO: `/v3/users/f61c1c2150dc4c29a734c5435e9a35d0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:34.864425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61c1c2150dc4c29a734c5435e9a35d0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:34.866732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:34.944894 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61c1c2150dc4c29a734c5435e9a35d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.954365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61c1c2150dc4c29a734c5435e9a35d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.955362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61c1c2150dc4c29a734c5435e9a35d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.956029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61c1c2150dc4c29a734c5435e9a35d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:34.967538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d25cb08f-62eb-4909-8d50-b3e5f29018ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61c1c2150dc4c29a734c5435e9a35d0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.000329 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3980/7994] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:23:34 2021] DELETE /identity/v3/users/f61c1c2150dc4c29a734c5435e9a35d0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:35.428767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:35.430519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:35.450833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27e166-2294-4822-a7bf-dd8d9a3f8634 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:35.518216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:35.519080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.519447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.519730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] PATH_INFO: `/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.520986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ce0d53096e4ee8b9d2397eda9a6c8b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:35.522893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:35.572402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ce0d53096e4ee8b9d2397eda9a6c8b', 'request_id': 'req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.577696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ce0d53096e4ee8b9d2397eda9a6c8b', 'request_id': 'req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.583949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ce0d53096e4ee8b9d2397eda9a6c8b', 'request_id': 'req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.595548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] The token cache is being invalidate because project 26ce0d53096e4ee8b9d2397eda9a6c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:23:35.595834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.596704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bbd22d6-9c96-44d8-bf2b-2f3bed33ca06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:23:35.598086 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4015/7995] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:23:35 2021] DELETE /identity/v3/projects/26ce0d53096e4ee8b9d2397eda9a6c8b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:35.604248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.604661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.605519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.625679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:35.626899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:35.684757 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3981/7996] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:35.693594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.694070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.694179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.713234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:35.714985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:35.723620 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4016/7997] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:35.727889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:35.737967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d8ffc-b76f-49e9-8dad-e01f33aa83d7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:35.742926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:35.743570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.743859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.744829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.745598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:23:35.745901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:35.747480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:35.759060 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3982/7998] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:23:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:23:35.763431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:35.775102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f712e6-8a68-45c4-82b1-c9895eb40052 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:35.782243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:35.782994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.783374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.783918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.784728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:35.787045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:35.823552 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4017/7999] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:23:35 2021] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:35.828364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:35.845444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21a536-7c6a-45dd-8337-0e99f876cfda admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:35.906923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:35.908001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.908277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.908549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.909460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:35.911373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:35.949822 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3983/8000] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:23:35 2021] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:23:35.954622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:35.983510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55936-08b0-4789-9d1e-25fb05206dac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:35.990820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:35.994511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:35.995265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:35.995580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:35.997224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:36.015799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:36.047329 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4018/8001] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:35 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:36.051275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:36.063072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff14d-e98d-4fcd-b70f-899551e03f2e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:36.068383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:36.069193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:36.069543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:36.069892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:36.070707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:36.072441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fb3c2-3c89-46f8-9110-9cdba7304dd9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:36.085261 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3984/8002] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:23:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:23:36.090116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:36.102646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb262a-92b8-470f-ae35-1cecd0339419 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:36.109227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:36.110115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:36.110391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:36.110913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] PATH_INFO: `/v3/projects/5f3e0dcbd10443e3997f299edd5f60a6/users/a1b2d6486be54149bb58115da92674aa/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:36.128921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3e0dcbd10443e3997f299edd5f60a6, user_id=a1b2d6486be54149bb58115da92674aa, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:36.132159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:36.150589 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4019/8003] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:23:36 2021] PUT /identity/v3/projects/5f3e0dcbd10443e3997f299edd5f60a6/users/a1b2d6486be54149bb58115da92674aa/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:23:36.161810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666f50-bdc1-4de0-90b9-86f8a4125ebf None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:36.162097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666f50-bdc1-4de0-90b9-86f8a4125ebf None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:36.162370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666f50-bdc1-4de0-90b9-86f8a4125ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:36.193642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c666f50-bdc1-4de0-90b9-86f8a4125ebf None None] MFA Rules not processed for user `a1b2d6486be54149bb58115da92674aa`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:36.194920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c666f50-bdc1-4de0-90b9-86f8a4125ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:36.281598 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3985/8004] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:36 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:23:36.288283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:23:36.290234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:36.349414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741f6c-2f5f-4971-ab50-a19a4a9e5860 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:23:36.353028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:23:36.353663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:36.353939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:36.354208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:36.362602 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:23:36.364014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:23:36.373296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4020/8005] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:23:36 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:23:39.921121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3899b7-b42f-4ada-aa45-e2a67cae9a3a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:23:39.923951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3899b7-b42f-4ada-aa45-e2a67cae9a3a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:23:39.924480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3899b7-b42f-4ada-aa45-e2a67cae9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:23:39.954948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4f3899b7-b42f-4ada-aa45-e2a67cae9a3a None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:23:39.956189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4f3899b7-b42f-4ada-aa45-e2a67cae9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:23:40.081798 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3986/8006] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:23:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:01.711127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:01.713145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:01.817014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a6e96-85d3-41a2-bb6b-8dfb4803386b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:01.817537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a6e96-85d3-41a2-bb6b-8dfb4803386b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:01.817537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a6e96-85d3-41a2-bb6b-8dfb4803386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:01.850589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ea9a6e96-85d3-41a2-bb6b-8dfb4803386b None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:01.851833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ea9a6e96-85d3-41a2-bb6b-8dfb4803386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:01.860991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93922e-2f2e-4001-a773-084735a528e3 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:01.871839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:01.873045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:01.873543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:01.873934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] PATH_INFO: `/v3/users/d76980aba7d748a78e00108af0803638` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:01.877657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76980aba7d748a78e00108af0803638)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:01.880299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:01.949363 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3987/8007] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:24:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:24:01.955476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76980aba7d748a78e00108af0803638'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:01.965996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76980aba7d748a78e00108af0803638'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:01.967137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76980aba7d748a78e00108af0803638'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:01.984366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76980aba7d748a78e00108af0803638'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:01.999255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76980aba7d748a78e00108af0803638'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.009051 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4021/8008] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:24:01 2021] DELETE /identity/v3/users/d76980aba7d748a78e00108af0803638 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:02.014634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.015181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.015627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.024694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:02.026431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.039358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:02.040571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.114747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3988/8009] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:02.125817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:02.128564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.166800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593775-677c-40c7-98f0-a5f1dd2fdeeb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:02.178011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:02.178684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.179394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.179394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.185667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.208393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf5bc-04ff-46ba-b60a-a20d5f13719c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:02.212957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:02.214211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.214731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.215234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.226348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:02.228188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:02.254985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3989/8010] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:02.278158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:02.280945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c15d6-9818-40e3-81af-91916ec56183 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:02.297494 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4022/8011] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:24:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:24:02.488641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:02.490820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.519592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1629d3-cfba-4ef4-a80d-35bb4c517210 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:02.529502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:02.530662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.531120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.531579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] PATH_INFO: `/v3/projects/bead5623914b475eb34a08218c3363e0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.556040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bead5623914b475eb34a08218c3363e0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:02.558629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:02.631128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bead5623914b475eb34a08218c3363e0', 'request_id': 'req-86c8a334-a195-4190-86ff-2ad4c9ec883e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.640248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bead5623914b475eb34a08218c3363e0', 'request_id': 'req-86c8a334-a195-4190-86ff-2ad4c9ec883e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.652916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bead5623914b475eb34a08218c3363e0', 'request_id': 'req-86c8a334-a195-4190-86ff-2ad4c9ec883e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.670605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d581c-6476-482d-a757-04ed38dc08ea None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.670950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d581c-6476-482d-a757-04ed38dc08ea None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.671158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d581c-6476-482d-a757-04ed38dc08ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.676475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] The token cache is being invalidate because project bead5623914b475eb34a08218c3363e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:24:02.676874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.677536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-86c8a334-a195-4190-86ff-2ad4c9ec883e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:02.679520 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3990/8012] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:24:02 2021] DELETE /identity/v3/projects/bead5623914b475eb34a08218c3363e0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:02.684941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.685579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.686154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.696761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4b5d581c-6476-482d-a757-04ed38dc08ea None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:02.698025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4b5d581c-6476-482d-a757-04ed38dc08ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.707790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:02.709144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.784394 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4023/8013] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:02.812335 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3991/8014] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:24:02.818760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.819953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.820446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.861867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:02.863109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:02.904002 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4024/8015] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:02.905273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:02.921230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eff50-d0ea-443a-969e-0fdd510dd695 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:02.931405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:02.932281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:02.932561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:02.933071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:02.933822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:24:02.934131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:02.935764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:02.985268 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3992/8016] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:24:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:24:02.989847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.003248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802bb2-5f76-4fba-b34a-a11a87a76128 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.020300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.021020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.022172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.022633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.023346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.026062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.056008 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4025/8017] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:24:02 2021] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:03.060454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.079118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff084e4-6b5c-47f0-8a9f-9cfb87cca8a3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.156007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.156887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.157004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.157250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.157971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.160251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.188971 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3993/8018] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:24:03 2021] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:03.192135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.192953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.194351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:03.211922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8869d-fad2-46f0-8900-6b47fb56d9be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.217658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.218568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.218976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.219343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.220179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.221980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.233086 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3994/8019] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:03 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:24:03.237059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.248489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352e3f1-9c13-482d-8fbe-ac3003344839 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.253335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.253994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.254275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.254756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.255504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.257116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.264653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731324-3763-4029-ae62-3b7e19f2634b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.268180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3995/8020] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:24:03.269493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.270134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.270603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.271060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.272551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.273538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:03.282689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4723a-1478-45cd-85f8-7a92c706aa82 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.289140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.289952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.290935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.291229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.292140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] PATH_INFO: `/v3/projects/81176cf847ef4a35a18d304284296919/users/bd2430d5478943139131496c047fffac/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.300940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d6511-9414-4268-a36f-6a174d95b664 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.324700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81176cf847ef4a35a18d304284296919, user_id=bd2430d5478943139131496c047fffac, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.325319 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4026/8021] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:03.327593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.348163 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3996/8022] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:24:03 2021] PUT /identity/v3/projects/81176cf847ef4a35a18d304284296919/users/bd2430d5478943139131496c047fffac/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:03.361142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.361906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.362415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.406101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] MFA Rules not processed for user `bd2430d5478943139131496c047fffac`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:03.412658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:03.536062 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4027/8023] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:03 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:03.550819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:03.554241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:03.643175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedddb2-e248-4c03-9884-3a710c1d8547 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:03.647686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:03.648267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:03.648538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:03.648862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:03.659902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:03.661937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ea706-9737-4986-8e86-1585fbf3a6fe service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:03.675876 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3997/8024] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:03 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:05.175242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:05.176790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:05.321525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634c7d8-753c-4675-9357-bbe78d77bc92 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:05.326409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:05.327275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:05.327548 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:05.327980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] PATH_INFO: `/v3/users/b0f8ed76dcab4875890d7325914b22ae` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:05.330389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f8ed76dcab4875890d7325914b22ae)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:05.332723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:05.405231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f8ed76dcab4875890d7325914b22ae'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:05.416015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f8ed76dcab4875890d7325914b22ae'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:05.417354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f8ed76dcab4875890d7325914b22ae'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:05.431013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f8ed76dcab4875890d7325914b22ae'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:05.443582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f8ed76dcab4875890d7325914b22ae'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:05.456659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4028/8025] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:24:05 2021] DELETE /identity/v3/users/b0f8ed76dcab4875890d7325914b22ae => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:05.458678 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:05.459173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:05.459282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:05.485015 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:05.486221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:05.579651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3998/8026] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:05.596226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:05.597903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:05.712050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447f40-9578-4ca0-a2d7-af5d979fa4b0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:05.718581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:05.720502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:05.721148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:05.721282 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:05.743191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:05.745339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da117911-2441-4514-82bf-18001c76a83e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:05.776885 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4029/8027] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:06.274676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:06.277759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:06.322432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eac1e7-fcd6-45cb-a5f4-a701f539ef56 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:06.331789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:06.333344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:06.334021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:06.334877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] PATH_INFO: `/v3/projects/4d62a6f0117a4f2194c44a9e41d6c3d4` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:06.336474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d62a6f0117a4f2194c44a9e41d6c3d4)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:06.339248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:06.480389 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d62a6f0117a4f2194c44a9e41d6c3d4', 'request_id': 'req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:06.505323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d62a6f0117a4f2194c44a9e41d6c3d4', 'request_id': 'req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:06.522777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d62a6f0117a4f2194c44a9e41d6c3d4', 'request_id': 'req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:06.550399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] The token cache is being invalidate because project 4d62a6f0117a4f2194c44a9e41d6c3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:24:06.550702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:06.551415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-81ad1b20-27b9-4206-b1d2-fb1f3af48ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:06.557722 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 3999/8028] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:24:06 2021] DELETE /identity/v3/projects/4d62a6f0117a4f2194c44a9e41d6c3d4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:06.564904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:06.566532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:06.567039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:06.615467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:06.618026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:06.737118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4030/8029] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:06.745627 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:06.745938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:06.746217 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:06.779366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:06.781132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:06.804123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:06.814453 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4000/8030] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:24:06.821680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde75b-bc68-41ea-b8c0-a2262c3864af None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:06.832338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:06.834770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:06.835303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:06.836320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:06.840462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:24:06.842247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:06.845339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:06.886112 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:06.886382 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4031/8031] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:24:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:24:06.912528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592365f4-a151-475f-b240-0b3b1239dadc None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:06.923013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:06.924148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:06.924686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:06.925169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:06.926661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:06.929919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:06.994678 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4001/8032] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:24:06 2021] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:06.997751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:07.009500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f48c5-0069-48bf-83d7-6e0f418f72b8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:07.075876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:07.076819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.077198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.077650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.078960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:07.081444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:07.118332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4032/8033] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:24:06 2021] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:07.120301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:07.131222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0eef-9a23-4723-b406-51ccce48e598 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:07.137546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:07.138693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.139222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.139717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.140789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:07.142628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:07.157001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4002/8034] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:24:07.161278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:07.175725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b171-3957-4270-9b74-fe02248ee226 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:07.189524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:07.189524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.189524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.189524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.190089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:07.190851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeaabc-148f-4c36-b052-016bc1974838 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:07.207129 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4033/8035] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:24:07.211672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:07.226810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa06a2-47af-43be-8b3c-319855605b52 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:07.257152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:07.261079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.261502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.262017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] PATH_INFO: `/v3/projects/6ec396383baa48d6ba4de8277a76dc3f/users/24ce760664c24c1491bf04e612c2fee4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.288879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec396383baa48d6ba4de8277a76dc3f, user_id=24ce760664c24c1491bf04e612c2fee4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:07.291836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:07.310533 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4003/8036] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:24:07 2021] PUT /identity/v3/projects/6ec396383baa48d6ba4de8277a76dc3f/users/24ce760664c24c1491bf04e612c2fee4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:07.414936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.415323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.415848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.472546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] MFA Rules not processed for user `24ce760664c24c1491bf04e612c2fee4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:07.473873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:07.599947 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4034/8037] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:07 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:07.613922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:07.616847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:07.775653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a772f-fce1-484b-81ae-885887fd019c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:07.800942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:07.801702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:07.802019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:07.804054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:07.862149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:07.864187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949568f6-4882-434c-a46f-423421f64242 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:07.906999 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4004/8038] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:07 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:13.844901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:13.927266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c9345-a3d7-4e67-aebd-d6a9dad683e5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:13.933992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:13.935525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:13.935781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:13.936248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] PATH_INFO: `/v3/users/24ce760664c24c1491bf04e612c2fee4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:13.937793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ce760664c24c1491bf04e612c2fee4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:13.940562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:14.048570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ce760664c24c1491bf04e612c2fee4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:14.079494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ce760664c24c1491bf04e612c2fee4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:14.081886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ce760664c24c1491bf04e612c2fee4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:14.109672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ce760664c24c1491bf04e612c2fee4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:14.134493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ce760664c24c1491bf04e612c2fee4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:14.151567 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4035/8039] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:24:13 2021] DELETE /identity/v3/users/24ce760664c24c1491bf04e612c2fee4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:14.152646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:14.153130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:14.153253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:14.188654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:14.189970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:14.272884 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4005/8040] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:14.289490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:14.293489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:14.415056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5332671-0238-4024-93e5-3ecd61105414 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:14.420969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:14.422294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:14.423444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:14.424156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:14.449271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:14.451790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb7288-e089-4fd9-a742-924bea18b63c service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:14.468405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4036/8041] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:15.329913 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:15.331350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:15.343271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4d13-e403-4917-a115-62f2922970f5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:15.348213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:15.349101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.349378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.349658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] PATH_INFO: `/v3/projects/6ec396383baa48d6ba4de8277a76dc3f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.350843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec396383baa48d6ba4de8277a76dc3f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:15.352975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:15.434986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec396383baa48d6ba4de8277a76dc3f', 'request_id': 'req-96b22aad-f9c5-440c-941b-eaaeda0c69e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:15.444549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec396383baa48d6ba4de8277a76dc3f', 'request_id': 'req-96b22aad-f9c5-440c-941b-eaaeda0c69e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:15.457476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec396383baa48d6ba4de8277a76dc3f', 'request_id': 'req-96b22aad-f9c5-440c-941b-eaaeda0c69e3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:15.478577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] The token cache is being invalidate because project 6ec396383baa48d6ba4de8277a76dc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:24:15.479834 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:15.480854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-96b22aad-f9c5-440c-941b-eaaeda0c69e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:24:15.483252 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4006/8042] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:24:15 2021] DELETE /identity/v3/projects/6ec396383baa48d6ba4de8277a76dc3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:15.490449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.491380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.491844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.518103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:15.519411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:15.594993 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4037/8043] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:15.603334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.604270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.604546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.626496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:15.627280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:15.636505 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4007/8044] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:24:15.640958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:15.652738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99580c6f-27cd-4304-a517-126fbd06d6d3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:15.660507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:15.661228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.661564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.662357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.664834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:24:15.665152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:15.667807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:15.692230 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4038/8045] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:24:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:24:15.693536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:15.705300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fd670-cae5-4856-b411-6c6ca02a97fa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:15.712495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:15.714097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.715117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.715505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.716338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:15.718840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:15.760913 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4008/8046] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:24:15 2021] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:15.762352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:15.779045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc6ae-d879-4d60-a2fa-16fab04623ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:15.870760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:15.871439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.871723 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.872001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.872768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:15.877190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:15.913835 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4039/8047] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:24:15 2021] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:15.916512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:15.932134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539339a-4cda-4146-8e22-fe6a8bd7d89c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:15.938680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:15.939635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:15.940087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:15.940809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:15.942169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:15.948130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:15.984631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4009/8048] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:24:15.986214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:16.001422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af2ce-142c-4deb-a610-09291b7d2000 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:16.007598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:16.008172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:16.009256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:16.009408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:16.011284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:16.012955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ac3be-b69a-4b23-8e53-4ed65ddeece8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:16.031850 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4040/8049] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:24:16.032877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:16.047238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b65c95-3863-4eeb-8fb1-8dcaa9b57e1c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:16.054641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:16.055931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:16.056648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:16.057268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] PATH_INFO: `/v3/projects/242309b27e9d4a26acf25eb0f4aeea24/users/f090bc043e4744e78d8ee6ddd73dc1c3/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:16.081385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242309b27e9d4a26acf25eb0f4aeea24, user_id=f090bc043e4744e78d8ee6ddd73dc1c3, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:16.087460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:16.108835 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4010/8050] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:24:16 2021] PUT /identity/v3/projects/242309b27e9d4a26acf25eb0f4aeea24/users/f090bc043e4744e78d8ee6ddd73dc1c3/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:16.114425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e626-7db1-4aa3-8b89-0059b4271b20 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:16.114958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e626-7db1-4aa3-8b89-0059b4271b20 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:16.115570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e626-7db1-4aa3-8b89-0059b4271b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:16.141094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7a48e626-7db1-4aa3-8b89-0059b4271b20 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:16.142312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7a48e626-7db1-4aa3-8b89-0059b4271b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:16.213608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4041/8051] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:16.232984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:16.234794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:16.400099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822599-e1e9-4cc1-ba08-4e9b5cc28345 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:16.405593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:16.406220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:16.406500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:16.411105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:16.432183 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:16.434310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:16.449741 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4011/8052] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:27.446535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:27.447870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:27.447870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:27.491113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] MFA Rules not processed for user `f090bc043e4744e78d8ee6ddd73dc1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:27.494046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:27.698093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4042/8053] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:27 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:27.703083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:27.716567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0c52-e9b2-43d0-b7b1-3fcab714c08b service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:27.724990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:27.726066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:27.726632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:27.727188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:27.729062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:27.731708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:27.789706 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4012/8054] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:24:27 2021] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:27.792164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:27.821123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ef746-7b1f-4cfd-beba-a2a0a858ee95 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:27.970292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:27.971284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:27.972067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:27.972473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:27.975755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:27.978201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:28.038483 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4043/8055] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:24:27 2021] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:24:28.041655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:28.054748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4010ca-0be5-4bec-bd36-60e99d24c84d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:28.068703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:28.069675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:28.070121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:28.070566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:28.071472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:28.073938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:28.095403 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4013/8056] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:28 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:24:28.096354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:28.112258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb48963-683d-4316-91fe-a572ceeb9224 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:28.126932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:28.127603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:28.127911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:28.128190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] PATH_INFO: `/v3/projects/4d91e9cfd6d5444084edaa01389436c9/users/9709ae1cb5194f4cab51d216f0e1a66c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:28.157509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d91e9cfd6d5444084edaa01389436c9, user_id=9709ae1cb5194f4cab51d216f0e1a66c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:28.161805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:28.188115 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4044/8057] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:24:28 2021] PUT /identity/v3/projects/4d91e9cfd6d5444084edaa01389436c9/users/9709ae1cb5194f4cab51d216f0e1a66c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:24:28.191977 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:28.206923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fea3e-8dad-4555-93c8-aee390f0e3df admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:28.347535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:28.348313 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:28.349265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:28.349942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:28.351453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:28.354736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2111-dbf1-44ce-9048-587f7994d6c3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:28.378312 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4014/8058] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:24:28 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:24:28.382703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:28.401564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b49d6-608b-4268-a3cd-e2c0a4173956 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:28.409844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:28.411558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:28.412260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:28.412965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] PATH_INFO: `/v3/projects/4d91e9cfd6d5444084edaa01389436c9/users/9709ae1cb5194f4cab51d216f0e1a66c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:28.418941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d91e9cfd6d5444084edaa01389436c9, user_id=9709ae1cb5194f4cab51d216f0e1a66c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:28.423301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:28.450116 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4045/8059] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:24:28 2021] PUT /identity/v3/projects/4d91e9cfd6d5444084edaa01389436c9/users/9709ae1cb5194f4cab51d216f0e1a66c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:24:41.425518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ae61-b06b-4ca1-bf19-e4ff16723d2c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:41.426080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ae61-b06b-4ca1-bf19-e4ff16723d2c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:41.426080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ae61-b06b-4ca1-bf19-e4ff16723d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:41.466239 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b419ae61-b06b-4ca1-bf19-e4ff16723d2c None None] MFA Rules not processed for user `9709ae1cb5194f4cab51d216f0e1a66c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:41.470548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b419ae61-b06b-4ca1-bf19-e4ff16723d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:41.615070 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4015/8060] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:41 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:41.634970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:24:41.637220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:41.807367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce391-2516-477a-b57d-cf21e388e67e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:24:41.821218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:24:41.822490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:41.823012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:41.823535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:41.837680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:24:41.840026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83775c4-eb02-4d05-8d27-4528ad691e83 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:24:41.856636 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4046/8061] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:24:41 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:24:41.910592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efac86-e8be-48ea-9767-575ad2766833 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:41.910877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efac86-e8be-48ea-9767-575ad2766833 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:41.911342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efac86-e8be-48ea-9767-575ad2766833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:41.934912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-95efac86-e8be-48ea-9767-575ad2766833 None None] MFA Rules not processed for user `f090bc043e4744e78d8ee6ddd73dc1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:41.936337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-95efac86-e8be-48ea-9767-575ad2766833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:42.021724 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4016/8062] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:41 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:24:57.484590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:24:57.485234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:24:57.485579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:24:57.511372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] MFA Rules not processed for user `f090bc043e4744e78d8ee6ddd73dc1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:24:57.512809 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:24:57.522593 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4047/8063] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:24:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:25:02.194396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ec50-2f3e-42fb-ace7-cb7a1c51aaf8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:02.195306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ec50-2f3e-42fb-ace7-cb7a1c51aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:02.196398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ec50-2f3e-42fb-ace7-cb7a1c51aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:02.225804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-77c6ec50-2f3e-42fb-ace7-cb7a1c51aaf8 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:02.233767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-77c6ec50-2f3e-42fb-ace7-cb7a1c51aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:02.344675 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4017/8064] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:25:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:02.418265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:02.419758 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:02.531741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aafb4-d0ef-42f5-8c29-76b5f1cab822 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:02.537674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:02.538333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:02.538946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:02.540062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:02.552080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:02.554431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:02.573150 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4048/8065] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:25:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:25:07.308439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:07.309088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:07.309088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:07.347070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:07.348484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:07.422440 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4018/8066] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:25:16.111005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:16.116720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:16.244858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79f2c-f15f-4f44-8186-7438deb1048b service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:16.254010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:16.254671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:16.254948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:16.255219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:16.257137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:16.289081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:16.291135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:16.329227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4049/8067] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:25.366024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:25.396698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d553d5b-0a04-4276-8f57-bedb77c50f18 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:25.416061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:25.416774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:25.419026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:25.419026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:25.426935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:25.461968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:25.463677 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:25.498092 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4019/8068] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:29.920586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:29.922793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:30.072937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6be8c-c722-429d-be52-9926f3b0b66c service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:30.079193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:30.080707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:30.082495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:30.083087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:30.101852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:30.263620 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:30.265495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:30.288663 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4050/8069] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:29 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:35.699405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:35.860368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6e2e-ce13-4959-804f-cd4ecc5ad38e service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:35.867306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:35.868373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:35.869469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:35.869880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] PATH_INFO: `/v3/users/f090bc043e4744e78d8ee6ddd73dc1c3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:35.871555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f090bc043e4744e78d8ee6ddd73dc1c3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:35.873637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:35.938584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f090bc043e4744e78d8ee6ddd73dc1c3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:35.947603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f090bc043e4744e78d8ee6ddd73dc1c3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:35.948774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f090bc043e4744e78d8ee6ddd73dc1c3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:35.949860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f090bc043e4744e78d8ee6ddd73dc1c3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:35.962615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f090bc043e4744e78d8ee6ddd73dc1c3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:35.984778 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4020/8070] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:25:35 2021] DELETE /identity/v3/users/f090bc043e4744e78d8ee6ddd73dc1c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:36.414086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:36.434353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942060-6bad-4c54-96c9-e055cbc9a64b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:36.598942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:36.600799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:36.601515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:36.603352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] PATH_INFO: `/v3/projects/242309b27e9d4a26acf25eb0f4aeea24` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:36.605241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242309b27e9d4a26acf25eb0f4aeea24)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:36.607150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:36.726586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242309b27e9d4a26acf25eb0f4aeea24', 'request_id': 'req-065af17e-250f-43d7-85e7-0a6c6294d886'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:36.745609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242309b27e9d4a26acf25eb0f4aeea24', 'request_id': 'req-065af17e-250f-43d7-85e7-0a6c6294d886'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:36.768119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242309b27e9d4a26acf25eb0f4aeea24', 'request_id': 'req-065af17e-250f-43d7-85e7-0a6c6294d886'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:36.804561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] The token cache is being invalidate because project 242309b27e9d4a26acf25eb0f4aeea24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:25:36.804561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:36.807552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:36.811824 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4051/8071] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:25:36 2021] DELETE /identity/v3/projects/242309b27e9d4a26acf25eb0f4aeea24 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:36.814292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:36.817146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:36.839282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9d4b-2e4d-4442-b8d7-492588bc1931 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:36.967353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:36.969048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:36.969427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:36.969774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] PATH_INFO: `/v3/users/9709ae1cb5194f4cab51d216f0e1a66c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:36.971333 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9709ae1cb5194f4cab51d216f0e1a66c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:36.973595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:37.055711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9709ae1cb5194f4cab51d216f0e1a66c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:37.079363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9709ae1cb5194f4cab51d216f0e1a66c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:37.080639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9709ae1cb5194f4cab51d216f0e1a66c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:37.085452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9709ae1cb5194f4cab51d216f0e1a66c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:37.107030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9709ae1cb5194f4cab51d216f0e1a66c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:37.145216 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4021/8072] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:25:36 2021] DELETE /identity/v3/users/9709ae1cb5194f4cab51d216f0e1a66c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:38.099630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:38.101962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:38.134822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af17e-250f-43d7-85e7-0a6c6294d886 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:38.272817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:38.274799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:38.275249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:38.275658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] PATH_INFO: `/v3/projects/4d91e9cfd6d5444084edaa01389436c9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:38.284921 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d91e9cfd6d5444084edaa01389436c9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:38.290174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:38.400582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d91e9cfd6d5444084edaa01389436c9', 'request_id': 'req-07a21957-cd59-4074-a4dc-c5dd8939cfc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:38.408311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d91e9cfd6d5444084edaa01389436c9', 'request_id': 'req-07a21957-cd59-4074-a4dc-c5dd8939cfc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:38.416815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d91e9cfd6d5444084edaa01389436c9', 'request_id': 'req-07a21957-cd59-4074-a4dc-c5dd8939cfc6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:38.455576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] The token cache is being invalidate because project 4d91e9cfd6d5444084edaa01389436c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:25:38.456169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:38.457291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07a21957-cd59-4074-a4dc-c5dd8939cfc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:38.460159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4052/8073] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:25:38 2021] DELETE /identity/v3/projects/4d91e9cfd6d5444084edaa01389436c9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:53.401154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:53.403888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:53.420462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3496c-0101-4251-a6ce-b8df43993735 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:53.509512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:53.510899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:53.511182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:53.511462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] PATH_INFO: `/v3/users/bd2430d5478943139131496c047fffac` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:53.513481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2430d5478943139131496c047fffac)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:53.516089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:53.608292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2430d5478943139131496c047fffac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:53.616564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2430d5478943139131496c047fffac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:53.617314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2430d5478943139131496c047fffac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:53.618173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2430d5478943139131496c047fffac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:53.628025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2430d5478943139131496c047fffac'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:53.654160 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4022/8074] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:25:53 2021] DELETE /identity/v3/users/bd2430d5478943139131496c047fffac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:53.660029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:53.660029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:53.660029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:53.681418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:53.683043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:53.750406 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4053/8075] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:53.764225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:53.765687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:53.833878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da0d4-cddd-4514-a23b-34037e7dae14 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:53.839163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:53.839838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:53.840097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:53.840451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:53.856029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:53.857483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b3548-4b69-4e26-8f1c-21d647eb172a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:53.867356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4023/8076] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:54.064865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.066483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:54.094819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6d4a-313c-45d4-af70-9aa5109c46ba None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.104288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.105146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.105453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.105725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] PATH_INFO: `/v3/projects/81176cf847ef4a35a18d304284296919` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.106981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81176cf847ef4a35a18d304284296919)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.108916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.165888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81176cf847ef4a35a18d304284296919', 'request_id': 'req-4ac2998d-af55-408f-9f0c-b2f4ea496a37'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:54.175083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81176cf847ef4a35a18d304284296919', 'request_id': 'req-4ac2998d-af55-408f-9f0c-b2f4ea496a37'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:54.179683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81176cf847ef4a35a18d304284296919', 'request_id': 'req-4ac2998d-af55-408f-9f0c-b2f4ea496a37'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:54.192878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] The token cache is being invalidate because project 81176cf847ef4a35a18d304284296919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:25:54.193225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:54.193873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4ac2998d-af55-408f-9f0c-b2f4ea496a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:54.195413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4054/8077] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:25:54 2021] DELETE /identity/v3/projects/81176cf847ef4a35a18d304284296919 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:54.201410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.201652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.201890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.223631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:54.225952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:54.294416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4024/8078] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:54.302707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.303068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.304281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.326881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:54.328264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:54.341297 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4055/8079] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:54.342859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.357419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b56dd-7bc0-451b-baeb-1528cce33d6d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.362898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.363762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.364080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.364392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.365257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:25:54.365607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.368134 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.385237 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4025/8080] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:25:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:25:54.389629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.400308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eddb2a-4dde-406c-8c99-fba5ba0fc531 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.406115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.407170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.407170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.407333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.408153 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.410061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.438679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4056/8081] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:25:54 2021] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:25:54.443281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.456136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c8ba-8656-461e-a05e-cbaf279ad2ae admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.523424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.524201 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.524476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.525311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.525562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.528060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.554657 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4026/8082] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:25:54 2021] POST /identity/v3/users => generated 280 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:25:54.556518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.567373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6bf9-e5af-473c-be8b-84f8526f0bc4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.573501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.574311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.574604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.574949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.575797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.577744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.597235 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4057/8083] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:25:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:25:54.597534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.608040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e690d9-d49f-4def-8612-cb47db61b147 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.614265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.615097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.615499 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.615858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.616993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.619067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071ae7b-4638-41d2-97b0-d7109a076d87 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.631909 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4027/8084] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:25:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:25:54.636492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.650183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8a23-e275-47e2-b916-e06ba6dca48a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.656143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.657426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.657919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.658239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] PATH_INFO: `/v3/projects/cd8ab72f7ec34da4b6c93f1a35b7a922/users/34555d2cc6014cf1a13984b2267b5403/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.677487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8ab72f7ec34da4b6c93f1a35b7a922, user_id=34555d2cc6014cf1a13984b2267b5403, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.680212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.696315 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4058/8085] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:25:54 2021] PUT /identity/v3/projects/cd8ab72f7ec34da4b6c93f1a35b7a922/users/34555d2cc6014cf1a13984b2267b5403/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:54.708228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.708588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.709971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.740135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] MFA Rules not processed for user `34555d2cc6014cf1a13984b2267b5403`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:54.741626 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:54.838530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4028/8086] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:54 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:54.852355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:54.854265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:54.928021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490f73-8f24-405f-82aa-7b016caf105c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:54.932780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:54.933579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:54.933857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:54.934396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:54.947634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:54.960355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103fa03-4e38-41c9-ab1f-b5d42f58a85c service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:54.975664 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4059/8087] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:54 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:55.037102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:55.039042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:55.127976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f8eae-e894-43ea-ba35-22fe2f853531 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:55.134748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:55.135688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.135961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.136234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] PATH_INFO: `/v3/users/a1b2d6486be54149bb58115da92674aa` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:55.137737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b2d6486be54149bb58115da92674aa)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:55.140188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:55.193145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b2d6486be54149bb58115da92674aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.201101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b2d6486be54149bb58115da92674aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.201811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b2d6486be54149bb58115da92674aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.202424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b2d6486be54149bb58115da92674aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.210923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b2d6486be54149bb58115da92674aa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.231330 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4029/8088] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:25:55 2021] DELETE /identity/v3/users/a1b2d6486be54149bb58115da92674aa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:55.235856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.236135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.236470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:55.254439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:55.255632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:55.326907 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4060/8089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:55.335865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:55.337390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:55.404431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67aa-9e0a-48d3-a23a-22511aa5e8fe admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:55.411071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:55.412169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.412464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.413019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:55.426295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:55.428825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7385ad4-bfa7-4caf-ba8a-2f4da552b635 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:55.446893 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4030/8090] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:25:55.758727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:55.760666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:55.774746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc255dd2-d42e-448a-9dd3-5a091f48def5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:55.781141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:55.782247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.782523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.782807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] PATH_INFO: `/v3/projects/5f3e0dcbd10443e3997f299edd5f60a6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:55.784062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3e0dcbd10443e3997f299edd5f60a6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:55.786012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:55.846060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3e0dcbd10443e3997f299edd5f60a6', 'request_id': 'req-6cdde85d-b652-441e-b626-ed7fc3aa891b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.853058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3e0dcbd10443e3997f299edd5f60a6', 'request_id': 'req-6cdde85d-b652-441e-b626-ed7fc3aa891b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.861005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3e0dcbd10443e3997f299edd5f60a6', 'request_id': 'req-6cdde85d-b652-441e-b626-ed7fc3aa891b'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.877278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] The token cache is being invalidate because project 5f3e0dcbd10443e3997f299edd5f60a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:25:55.877561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.878634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6cdde85d-b652-441e-b626-ed7fc3aa891b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:25:55.880475 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4061/8091] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:25:55 2021] DELETE /identity/v3/projects/5f3e0dcbd10443e3997f299edd5f60a6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:55.886664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.886949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.887228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:55.905533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:55.906733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:55.971479 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4031/8092] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:55.985049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:55.985366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:55.985644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.005057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:56.006298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:56.015170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4062/8093] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:56.019475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.030158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30059-a441-434f-a9a9-04f4271e89ba None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.035882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.036582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.036905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.037177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.038624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:25:56.038981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.040746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.052972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4032/8094] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:25:56.057629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.067321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffee9-f320-414e-a577-1b0db15805e8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.073241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.074018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.074422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.074770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.076010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.078218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.111503 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4063/8095] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:25:56 2021] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:25:56.112793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.123808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a1a47-cf73-4152-892e-5c4afb4160c4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.189129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.189847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.190146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.190793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.191143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.193377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.223766 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4033/8096] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:25:56 2021] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:25:56.227683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.239993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a94ab-9395-4ab2-870c-54ab3bc639eb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.245617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.246347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.246626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.247005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.247813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.249818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.272579 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4064/8097] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:25:56.273544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.287042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44bd3-7c69-47e5-bb67-d2f3ba1db782 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.293099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.293989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.294502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.294890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.296189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.298077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e4419-1c70-49a9-933b-f54fe91daddb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.310977 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4034/8098] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:25:56.315700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.328963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a510-624a-4a95-9dd7-fe3db2a6f5e0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.337081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.338515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.339507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.339892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] PATH_INFO: `/v3/projects/b11c1eda435445ffa9557fcd3dc5121e/users/6c7946a005f746ecb630cf442f200572/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.362577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11c1eda435445ffa9557fcd3dc5121e, user_id=6c7946a005f746ecb630cf442f200572, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.366850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.382116 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4065/8099] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:25:56 2021] PUT /identity/v3/projects/b11c1eda435445ffa9557fcd3dc5121e/users/6c7946a005f746ecb630cf442f200572/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:25:56.392937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.393547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.393547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.426941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] MFA Rules not processed for user `6c7946a005f746ecb630cf442f200572`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:25:56.428933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:56.519230 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4035/8100] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:25:56 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:25:56.531827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:25:56.533771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:25:56.611041 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37220-b057-4fcc-ac55-d778601c5497 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:25:56.618383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:25:56.619299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:25:56.619464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:25:56.619738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:25:56.642734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:25:56.645246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85068a-b128-4977-b779-6c8093090049 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:25:56.659203 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4066/8101] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:25:56 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:07.690722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:07.814531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7515f92-cba9-423b-9ecd-6b3fdb83d3fd None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:07.814531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:07.814531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:07.814531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:07.815054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] PATH_INFO: `/v3/users/6c7946a005f746ecb630cf442f200572` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:07.816163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7946a005f746ecb630cf442f200572)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:07.820271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:07.895135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7946a005f746ecb630cf442f200572'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:07.904682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7946a005f746ecb630cf442f200572'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:07.905341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7946a005f746ecb630cf442f200572'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:07.905956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7946a005f746ecb630cf442f200572'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:07.916193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7946a005f746ecb630cf442f200572'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:07.941081 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4036/8102] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:07 2021] DELETE /identity/v3/users/6c7946a005f746ecb630cf442f200572 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:07.946848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:07.947419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:07.948271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:07.979416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:07.980521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:08.057744 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4067/8103] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:08.091881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.093982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:08.173463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32297c-d50d-443e-b3a3-ba00d584106d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.179025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.179835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.180121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.180393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.191997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.194455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba56dd-0991-4dba-b9e9-49ec6a026650 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:08.206518 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4037/8104] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:08.433277 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.435037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:08.450670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd2b8-d69a-442b-ab8e-9eaf1c07f3fc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.457528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.458403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.458739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.459667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] PATH_INFO: `/v3/projects/b11c1eda435445ffa9557fcd3dc5121e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.461285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11c1eda435445ffa9557fcd3dc5121e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.463782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:08.525119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11c1eda435445ffa9557fcd3dc5121e', 'request_id': 'req-e13c0459-da10-48d3-b739-48985027f7de'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:08.533101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11c1eda435445ffa9557fcd3dc5121e', 'request_id': 'req-e13c0459-da10-48d3-b739-48985027f7de'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:08.543032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11c1eda435445ffa9557fcd3dc5121e', 'request_id': 'req-e13c0459-da10-48d3-b739-48985027f7de'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:08.558935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] The token cache is being invalidate because project b11c1eda435445ffa9557fcd3dc5121e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:08.559205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:08.559840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e13c0459-da10-48d3-b739-48985027f7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:08.561448 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4068/8105] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:08 2021] DELETE /identity/v3/projects/b11c1eda435445ffa9557fcd3dc5121e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:08.567497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.567860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.568818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.590947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:08.592754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:08.669763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4038/8106] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:08.678801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.679078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.679335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.701640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:08.703053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:08.713788 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4069/8107] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:08.718330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.730178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d28c9-21ad-43fb-ace1-e3605b48a547 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.736443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.737133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.737428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.737682 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.738417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:26:08.738730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.741620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:08.759719 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4039/8108] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:26:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:26:08.761286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.772854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4acb64-6869-450c-aaf0-7241fc7178ea None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.781875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.782301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.782590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.782785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.783830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.787670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:08.843970 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4070/8109] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:08 2021] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:08.845253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.861740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584b19-9bdb-4211-aa0b-0e9be97d3ffb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.928402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.929464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.929775 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.930041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.930751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.933110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:08.964782 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4040/8110] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:08 2021] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:08.966311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:08.986622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74773abe-8b89-4569-af8e-4f3ce2160d3f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:08.993251 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:08.994216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:08.994500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:08.994775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:08.995903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:08.997848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:09.018374 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4071/8111] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:08 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:09.022706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:09.041041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca848f4-f5c4-4331-ba5c-1c6a29cac9c1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:09.046681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:09.047643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:09.047926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:09.048204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:09.048998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:09.050615 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ec872-385e-4d6d-aad3-75283f98f71f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:09.063290 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4041/8112] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:09 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:09.067719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:09.081034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b6363-d9d8-43c3-bf6f-fdd40f894955 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:09.087076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:09.088453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:09.088801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:09.089380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] PATH_INFO: `/v3/projects/552d8e5affc74a8eb0b8b3b6d0860981/users/c83d59e282464c568574d73660f7bb30/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:09.110306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] RBAC: Authorizing `identity:create_grant(project_id=552d8e5affc74a8eb0b8b3b6d0860981, user_id=c83d59e282464c568574d73660f7bb30, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:09.113986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:09.131202 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4072/8113] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:09 2021] PUT /identity/v3/projects/552d8e5affc74a8eb0b8b3b6d0860981/users/c83d59e282464c568574d73660f7bb30/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:09.142213 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:09.142493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:09.142769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:09.174608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] MFA Rules not processed for user `c83d59e282464c568574d73660f7bb30`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:09.175972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:09.260578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4042/8114] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:09.272336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:09.274358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:09.369895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab350a7-a8f4-410a-a280-4b3552d5546e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:09.373801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:09.374477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:09.374784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:09.375031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:09.388147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:09.389701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d0aa0-3e92-406e-a8a4-ae9f5250cea5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:09.404696 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4073/8115] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:29.759717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:29.830222 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2103-60cf-4230-8c14-481d0282a021 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:29.830967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:29.831875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:29.832168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:29.832511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] PATH_INFO: `/v3/users/c83d59e282464c568574d73660f7bb30` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:29.833882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83d59e282464c568574d73660f7bb30)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:29.836034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:29.884552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83d59e282464c568574d73660f7bb30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:29.892692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83d59e282464c568574d73660f7bb30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:29.893317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83d59e282464c568574d73660f7bb30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:29.893933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83d59e282464c568574d73660f7bb30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:29.902541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83d59e282464c568574d73660f7bb30'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:29.920695 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4043/8116] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:29 2021] DELETE /identity/v3/users/c83d59e282464c568574d73660f7bb30 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:29.925151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:29.925695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:29.925795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:29.944324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:29.945605 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:30.009163 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4074/8117] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:30.019253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.020830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:30.082150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8a04b-ad7e-46a1-ab0c-57d385e48a2a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.086083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.086736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.087025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.087300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.096624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.098059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59684d7-75ce-4116-8245-2dd64e0ce695 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.109057 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4044/8118] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:30.426045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.428065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:30.440715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0f0d-b82c-40c4-8c33-1af0c454c021 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.456536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.457287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.457588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.457834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] PATH_INFO: `/v3/projects/552d8e5affc74a8eb0b8b3b6d0860981` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.459789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] RBAC: Authorizing `identity:delete_project(project_id=552d8e5affc74a8eb0b8b3b6d0860981)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.461767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.508666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552d8e5affc74a8eb0b8b3b6d0860981', 'request_id': 'req-95ed4553-71bf-4037-9955-4121ab44694e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:30.513973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552d8e5affc74a8eb0b8b3b6d0860981', 'request_id': 'req-95ed4553-71bf-4037-9955-4121ab44694e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:30.520167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552d8e5affc74a8eb0b8b3b6d0860981', 'request_id': 'req-95ed4553-71bf-4037-9955-4121ab44694e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:30.532985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] The token cache is being invalidate because project 552d8e5affc74a8eb0b8b3b6d0860981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:30.533271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:30.533892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-95ed4553-71bf-4037-9955-4121ab44694e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:30.539972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4075/8119] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:30 2021] DELETE /identity/v3/projects/552d8e5affc74a8eb0b8b3b6d0860981 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:30.542386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.543246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.543246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.566136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:30.567403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:30.630722 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4045/8120] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:26:30.638673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.638956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.639230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.663151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:30.664525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:30.678194 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4076/8121] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:30.679999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.691795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfd060-a54b-4307-b6bd-915ac4f720f3 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.697058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.697981 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.698596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.698973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.699948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:26:30.700335 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.702224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.720590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4046/8122] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:26:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:26:30.722315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.733305 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bde6b-1850-48f9-b859-b9727c51903c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.738269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.738938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.739380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.739661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.740367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.742728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.781017 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4077/8123] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:30 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:30.784012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.794845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27eb8b-f6ac-4412-aca8-1880162839b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.869739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.870411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.870708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.870978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.871683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.873613 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.899093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4047/8124] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:30 2021] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:30.903516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.914952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d378-b974-4c07-af66-743523916756 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.921695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.922431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.922924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.923321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.924064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.925753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.938790 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4078/8125] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:30.942414 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.954720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39671-ca52-4dca-ae46-67cc35900396 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.960460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.961216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.961498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.961767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:30.962500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:30.964129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cd7c6-0152-4f80-ab5a-750ca06e118d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:30.977445 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4048/8126] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:26:30.978814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:30.990562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970657-d1bc-48c1-9e6d-8fe55a6a39a1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:30.995929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:30.996836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:30.997111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:30.997539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] PATH_INFO: `/v3/projects/bcb307ba98bf42f29638d3c396e1cf33/users/e2c73e963fc548fb97b7f4bd7e65098a/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.014159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb307ba98bf42f29638d3c396e1cf33, user_id=e2c73e963fc548fb97b7f4bd7e65098a, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.017049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.031883 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4079/8127] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:30 2021] PUT /identity/v3/projects/bcb307ba98bf42f29638d3c396e1cf33/users/e2c73e963fc548fb97b7f4bd7e65098a/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:31.042317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.042807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.043236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.074800 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] MFA Rules not processed for user `e2c73e963fc548fb97b7f4bd7e65098a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:31.076050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:31.149117 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4049/8128] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:31 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:31.153749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.228870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f910-a8d6-4d4d-8401-de4b430b2fb0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.233837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.234495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.234999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.235120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.235733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.237875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.273383 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4080/8129] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:31 2021] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:31.274327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.287836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1417a-6e04-4dea-ac87-dbe3942f8eb0 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.347881 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.348565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.349218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.349449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.350148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.352032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.374719 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4050/8130] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:31 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:26:31.378491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.389339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a81-fccd-40d5-b5f1-8ab6f63b6907 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.394789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.395470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.395773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.396049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.396814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.398412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.419676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4081/8131] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:31.423774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.435727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59c04-d5af-4114-94c1-8c7cd1ed714a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.452100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.453067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.453345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.454345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] PATH_INFO: `/v3/projects/5feb6ada16204b3a999e1b596c4741d1/users/48f96f67685441c1bcdda9eef837a844/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.474384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6ada16204b3a999e1b596c4741d1, user_id=48f96f67685441c1bcdda9eef837a844, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.477127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.497462 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4051/8132] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:31 2021] PUT /identity/v3/projects/5feb6ada16204b3a999e1b596c4741d1/users/48f96f67685441c1bcdda9eef837a844/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:31.501778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.514144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92d491-bd1c-4ba7-a8c2-5782581820b1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.582733 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.583256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.583538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.583811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.584784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.587832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad47f-86e1-40bd-a125-e73e182a23de admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.618455 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4082/8133] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:31.622723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.634147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8466-d063-436a-8ad6-1a353d8bb8a6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.641882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.642947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.643225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.643596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] PATH_INFO: `/v3/projects/5feb6ada16204b3a999e1b596c4741d1/users/48f96f67685441c1bcdda9eef837a844/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.647407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6ada16204b3a999e1b596c4741d1, user_id=48f96f67685441c1bcdda9eef837a844, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.653779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.670166 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4052/8134] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:31 2021] PUT /identity/v3/projects/5feb6ada16204b3a999e1b596c4741d1/users/48f96f67685441c1bcdda9eef837a844/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:31.686849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.687914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.687914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.727131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] MFA Rules not processed for user `48f96f67685441c1bcdda9eef837a844`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:31.728377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:31.820037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4083/8135] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:31 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:31.831706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:31.834046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:31.901558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc843a-0ef4-4b0f-bac2-bfe025da673c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:31.905466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:31.906132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:31.906555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:31.906879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:31.916921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:31.918415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5366-5f80-41d2-adda-10778560ed39 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:31.932829 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4053/8136] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:31 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:32.222288 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:32.295598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6121f2-45b5-4e3f-a111-548014d198a7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:32.300333 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:32.301321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:32.301603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:32.302443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] PATH_INFO: `/v3/users/e2c73e963fc548fb97b7f4bd7e65098a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:32.303702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c73e963fc548fb97b7f4bd7e65098a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:32.305679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:32.358621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c73e963fc548fb97b7f4bd7e65098a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:32.366666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c73e963fc548fb97b7f4bd7e65098a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:32.367588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c73e963fc548fb97b7f4bd7e65098a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:32.379973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c73e963fc548fb97b7f4bd7e65098a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:32.389097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c73e963fc548fb97b7f4bd7e65098a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:32.395817 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4084/8137] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:32 2021] DELETE /identity/v3/users/e2c73e963fc548fb97b7f4bd7e65098a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:32.400511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:32.401046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:32.401537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:32.421937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:32.423328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:32.501107 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4054/8138] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:32.511174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:32.512591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:32.594570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4633-859a-4579-bffe-9ee2df79b630 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:32.599306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:32.599959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:32.601044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:32.601404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:32.613414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:32.615599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:32.628918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4085/8139] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:32.941344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:32.943036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:32.957280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21841f-f9b2-4adb-9680-4e7a65ff4519 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:32.968363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:32.969263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:32.969543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:32.969876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] PATH_INFO: `/v3/projects/bcb307ba98bf42f29638d3c396e1cf33` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:32.971544 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb307ba98bf42f29638d3c396e1cf33)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:32.973577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:33.041806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb307ba98bf42f29638d3c396e1cf33', 'request_id': 'req-d31275fc-f4df-48c1-bf8e-d944ef91cc94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.047803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb307ba98bf42f29638d3c396e1cf33', 'request_id': 'req-d31275fc-f4df-48c1-bf8e-d944ef91cc94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.054396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb307ba98bf42f29638d3c396e1cf33', 'request_id': 'req-d31275fc-f4df-48c1-bf8e-d944ef91cc94'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.070051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] The token cache is being invalidate because project bcb307ba98bf42f29638d3c396e1cf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:33.070448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.080352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.086870 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4055/8140] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:32 2021] DELETE /identity/v3/projects/bcb307ba98bf42f29638d3c396e1cf33 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:33.091246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:33.105847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555b45-1097-449a-8403-cb617964b711 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:33.195465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:33.197004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.197410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.197780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] PATH_INFO: `/v3/users/48f96f67685441c1bcdda9eef837a844` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.199590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f96f67685441c1bcdda9eef837a844)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:33.201796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:33.266735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f96f67685441c1bcdda9eef837a844'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.279279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f96f67685441c1bcdda9eef837a844'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.280015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f96f67685441c1bcdda9eef837a844'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.293037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f96f67685441c1bcdda9eef837a844'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.301079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3d13c67d-8af9-40db-ba48-a92fc24b651c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f96f67685441c1bcdda9eef837a844'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.308309 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4086/8141] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:33 2021] DELETE /identity/v3/users/48f96f67685441c1bcdda9eef837a844 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:33.627321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:33.628821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:33.643802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31275fc-f4df-48c1-bf8e-d944ef91cc94 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:33.711974 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:33.713053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.713337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.714237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] PATH_INFO: `/v3/projects/5feb6ada16204b3a999e1b596c4741d1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.715772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5feb6ada16204b3a999e1b596c4741d1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:33.718434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:33.769214 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5feb6ada16204b3a999e1b596c4741d1', 'request_id': 'req-287fce0d-eb3c-46c7-9f23-7d82f026500c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.777046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5feb6ada16204b3a999e1b596c4741d1', 'request_id': 'req-287fce0d-eb3c-46c7-9f23-7d82f026500c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.786118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5feb6ada16204b3a999e1b596c4741d1', 'request_id': 'req-287fce0d-eb3c-46c7-9f23-7d82f026500c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.803125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] The token cache is being invalidate because project 5feb6ada16204b3a999e1b596c4741d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:33.803444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.804366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-287fce0d-eb3c-46c7-9f23-7d82f026500c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:33.807734 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4056/8142] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:33 2021] DELETE /identity/v3/projects/5feb6ada16204b3a999e1b596c4741d1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:33.813489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.813795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.814069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.835081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:33.836462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:33.894948 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4087/8143] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:33.903783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.904163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.904374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.922258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:33.923465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:33.931412 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4057/8144] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:33.935584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:33.945849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214dc6e-07d2-43df-ba6e-7d6c9ade4a86 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:33.950387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:33.951023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.951296 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.951562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.952431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:26:33.952770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:33.954609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:33.970061 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4088/8145] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:26:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:26:33.971312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:33.980523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c27b2-c9cc-4273-8dd5-30ad33d40a64 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:33.985506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:33.986168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:33.986595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:33.986871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:33.987579 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:33.989557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.014623 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4058/8146] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:33 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:34.018803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.029417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c23f1-2b45-4164-92d3-e23911a20bd8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.085892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.086563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.086840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.087111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.087799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.089717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.113002 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4089/8147] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:34 2021] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:34.116320 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.135422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a5f0-37f7-4f6a-afad-a1e53b6ecce3 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.140947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.142218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.142570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.142914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.143864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.145571 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.157893 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4059/8148] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:34.162159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.173627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803486-98f8-4f98-9eab-88bf8794818c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.179993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.180711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.181272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.181570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.183134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.184397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766e57-c51e-446d-b260-2ade0abca2b6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.196254 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4090/8149] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:34.200576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.215897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac061a8-a37d-4da3-a074-5ee0170b5efa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.220635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.221577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.221865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.222139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] PATH_INFO: `/v3/projects/cfa03b65226f48b0931e996d9a72c413/users/0530c2e1068047bb89b345012955c919/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.237697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa03b65226f48b0931e996d9a72c413, user_id=0530c2e1068047bb89b345012955c919, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.241633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.256418 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4060/8150] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:34 2021] PUT /identity/v3/projects/cfa03b65226f48b0931e996d9a72c413/users/0530c2e1068047bb89b345012955c919/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:34.266931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.267907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.268852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.304908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] MFA Rules not processed for user `0530c2e1068047bb89b345012955c919`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:34.306189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:34.380165 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4091/8151] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:34 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:34.384802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.446654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1c361-bc43-4658-8d23-b73ea6a35ad6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.451270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.451926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.452205 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.452479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.453228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.455369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.487190 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4061/8152] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:34 2021] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:34.488425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.499814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02beeb-e3ae-48e8-9e65-8e7fe8acb2b8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.563584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.564253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.564543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.564855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.565551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.568081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.590777 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4092/8153] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:34 2021] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:34.594883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.606291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbf1d2-1e91-46ff-9127-d4281d5f6389 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.611555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.612287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.612658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.613003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.613807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.615713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.631364 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4062/8154] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:26:34.632516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.647428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af978-4fed-429d-8f23-e926f7407ade admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.652427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.653431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.653777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.654119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] PATH_INFO: `/v3/projects/cc8a8d1d33114603b20f8161063cbae2/users/3d47a05f4520493397917e1f5cbba10c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.668935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a8d1d33114603b20f8161063cbae2, user_id=3d47a05f4520493397917e1f5cbba10c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.671641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.686923 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4093/8155] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:34 2021] PUT /identity/v3/projects/cc8a8d1d33114603b20f8161063cbae2/users/3d47a05f4520493397917e1f5cbba10c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:34.691046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.702843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9078-5ce2-4e9e-b2ae-4365200a1a75 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.759004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.759676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.759959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.760232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.761065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.762639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aad00-77b2-4f8d-820a-19e7b03dc442 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.773890 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4063/8156] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:26:34.778266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.788773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a307f5-7a65-47d2-aadd-fec3e5e8024d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:34.793791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:34.794689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.794964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.795232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] PATH_INFO: `/v3/projects/cc8a8d1d33114603b20f8161063cbae2/users/3d47a05f4520493397917e1f5cbba10c/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.797290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a8d1d33114603b20f8161063cbae2, user_id=3d47a05f4520493397917e1f5cbba10c, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:34.805144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:34.811695 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4094/8157] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:34 2021] PUT /identity/v3/projects/cc8a8d1d33114603b20f8161063cbae2/users/3d47a05f4520493397917e1f5cbba10c/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:34.823891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:34.824178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:34.824455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:34.857662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] MFA Rules not processed for user `3d47a05f4520493397917e1f5cbba10c`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:34.858936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:34.928517 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4064/8158] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:34 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:34.938367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:34.940081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:35.001320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206c64-da58-44ea-b8e6-344c8218e1c0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:35.006521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:35.007180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:35.007460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:35.007730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:35.018407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:35.019839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b966-f55d-45b9-96f1-ec347b972eec service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:35.029852 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4095/8159] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:34 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:26:36.392904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:36.458968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3197327-06d5-4cf0-90e3-c99f74a72590 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:36.467377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:36.468557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:36.468944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:36.469226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] PATH_INFO: `/v3/users/0530c2e1068047bb89b345012955c919` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:36.470619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0530c2e1068047bb89b345012955c919)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:36.472954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:36.529976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0530c2e1068047bb89b345012955c919'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:36.537478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0530c2e1068047bb89b345012955c919'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:36.538247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0530c2e1068047bb89b345012955c919'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:36.538867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0530c2e1068047bb89b345012955c919'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:36.547734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0530c2e1068047bb89b345012955c919'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:36.566448 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4065/8160] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:36 2021] DELETE /identity/v3/users/0530c2e1068047bb89b345012955c919 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:36.571540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:36.572004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:36.572094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:36.590231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:36.591426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:36.651249 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4096/8161] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:36.661790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:36.663327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:36.725121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7bf3-5f44-43f0-95aa-ee18b9f5e144 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:36.729123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:36.729822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:36.730127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:36.730381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:36.739726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:36.741254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:36.751925 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4066/8162] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:26:37.046143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:37.047735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:37.061385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf0ee-aefb-4515-a6c2-09499b8d0b0a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:37.066900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:37.068411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:37.068820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:37.069327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] PATH_INFO: `/v3/projects/cfa03b65226f48b0931e996d9a72c413` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:37.071192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa03b65226f48b0931e996d9a72c413)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:37.072792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:37.134700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa03b65226f48b0931e996d9a72c413', 'request_id': 'req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.142376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa03b65226f48b0931e996d9a72c413', 'request_id': 'req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.151461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa03b65226f48b0931e996d9a72c413', 'request_id': 'req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.165915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] The token cache is being invalidate because project cfa03b65226f48b0931e996d9a72c413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:37.166182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.166820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.171427 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4097/8163] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:37 2021] DELETE /identity/v3/projects/cfa03b65226f48b0931e996d9a72c413 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:37.172794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:37.183039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546870-0bf1-4796-bd24-d65143878a82 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:37.242749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:37.244230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:37.244506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:37.244823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] PATH_INFO: `/v3/users/3d47a05f4520493397917e1f5cbba10c` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:37.246082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d47a05f4520493397917e1f5cbba10c)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:37.248123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:37.297939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d47a05f4520493397917e1f5cbba10c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.305806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d47a05f4520493397917e1f5cbba10c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.306897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d47a05f4520493397917e1f5cbba10c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.307688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d47a05f4520493397917e1f5cbba10c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.316260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-dd865329-c70d-4cc6-ae5d-53c7043bb6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d47a05f4520493397917e1f5cbba10c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.336707 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4067/8164] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:37 2021] DELETE /identity/v3/users/3d47a05f4520493397917e1f5cbba10c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:37.803734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:37.806043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:37.824388 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ae58-41f9-4e02-b4c5-bab68ca4edd3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:37.898219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:37.899375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:37.899655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:37.899942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] PATH_INFO: `/v3/projects/cc8a8d1d33114603b20f8161063cbae2` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:37.901914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8a8d1d33114603b20f8161063cbae2)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:37.903793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:37.983336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8a8d1d33114603b20f8161063cbae2', 'request_id': 'req-958fb104-e302-4624-b7ac-02cebf051790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:37.992889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8a8d1d33114603b20f8161063cbae2', 'request_id': 'req-958fb104-e302-4624-b7ac-02cebf051790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:38.000668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8a8d1d33114603b20f8161063cbae2', 'request_id': 'req-958fb104-e302-4624-b7ac-02cebf051790'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:38.023684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] The token cache is being invalidate because project cc8a8d1d33114603b20f8161063cbae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:38.023987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:38.024691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-958fb104-e302-4624-b7ac-02cebf051790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:38.026190 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4098/8165] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:37 2021] DELETE /identity/v3/projects/cc8a8d1d33114603b20f8161063cbae2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:38.031992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.032465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.032600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.051096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:38.053181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:38.119202 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4068/8166] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:38.126920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.127210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.127485 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.146473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:38.147677 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:38.156045 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4099/8167] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:38.160287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.170016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ee17-d318-4b1c-8f3f-013a1a008315 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.174742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.175412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.175686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.175984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.177234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:26:38.177536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.179150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.191559 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4069/8168] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:26:38.196415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.206544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195d12-6867-42d7-8591-6a88c5942774 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.211402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.212182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.212528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.212900 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.213674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.215639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.246090 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4100/8169] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:38.250610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.261890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbac9-efaa-4c6f-b408-3aa8f7ab2ad6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.320844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.321518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.321796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.322069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.322777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.324730 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.349904 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4070/8170] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:26:38.351381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.361943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616bc4-d9d9-4066-a542-2f5d3ccc0c4b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.368424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.369466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.369911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.370329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.371227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.373040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.384977 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4101/8171] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:38.389000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.401278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfafdd-f883-4e61-b0bf-7d4e9c3893b4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.406714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.407644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.408004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.408353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.409231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.410909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c884b-0584-476f-82ce-585610b66592 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.422986 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4071/8172] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:38.427861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.438202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1dfe0-6b5f-48ee-9d5e-a41c0b51ea8d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.443287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.444509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.444509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.444726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] PATH_INFO: `/v3/projects/981192c29b204493b01f914076270be8/users/f99895ae83414974b2f461b454643c21/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.461356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981192c29b204493b01f914076270be8, user_id=f99895ae83414974b2f461b454643c21, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.463975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.481031 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4102/8173] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:38 2021] PUT /identity/v3/projects/981192c29b204493b01f914076270be8/users/f99895ae83414974b2f461b454643c21/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:38.492193 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.492472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.492783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.526061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] MFA Rules not processed for user `f99895ae83414974b2f461b454643c21`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:38.527295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:38.604883 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4072/8174] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:38.609621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.679122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08994ba2-27c7-4948-b2f1-1e7965df8bc1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.684106 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.684798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.685075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.685345 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.686039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.687980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.717412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4103/8175] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:38.722737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.736150 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8056e-263d-4b6e-ad67-83fa0f0f1a61 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.811345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.812318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.813261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.814179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.815625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.820259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.849102 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4073/8176] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:38 2021] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:38.851367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.866590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d790-3470-4e45-8fc8-3793602b4b3b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.873050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.873908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.874194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.875577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.875894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.877993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.891650 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4104/8177] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:38 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:38.896668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.907844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9dc3-bb93-4ddf-8934-4b4e79777ec7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.914123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.914799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.915077 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.915397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.916138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.918054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6828f5-a063-4cad-a403-d5645ac8c629 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:38.929583 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4074/8178] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:38.933924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:38.944946 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3d41-1d0b-4cd1-bb85-b908bc579811 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:38.950811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:38.952023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:38.952427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:38.952851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] PATH_INFO: `/v3/projects/4f71051e88234e8184962e09567fc1b7/users/62897f727b27417b83ee336d98d693d0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:38.977036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f71051e88234e8184962e09567fc1b7, user_id=62897f727b27417b83ee336d98d693d0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:38.980580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.000767 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4105/8179] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:38 2021] PUT /identity/v3/projects/4f71051e88234e8184962e09567fc1b7/users/62897f727b27417b83ee336d98d693d0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:39.013534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.013944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.014242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.047397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] MFA Rules not processed for user `62897f727b27417b83ee336d98d693d0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:39.048732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:39.135911 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4075/8180] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:39 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:39.141290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.244387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7976aa-1795-44e4-8a84-410ebe8100ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.251720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.252692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.253478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.254526 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.256066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.258301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.303286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.305869 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4106/8181] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:39 2021] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:39.320920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d637-e714-4555-be29-4ac689a628f5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.406386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.407202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.407491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.407862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.423390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.425680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.473124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4076/8182] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:39 2021] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:39.477928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.493794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43ebf9-9f9f-477c-960a-b416b2f78275 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.502222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.503134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.503665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.509179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.510092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.511778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.528400 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4107/8183] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:39.533465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.546471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dd74-c82a-4228-b5ed-31d72d3cd37d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.554531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.555951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.556228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.556564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] PATH_INFO: `/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d/users/2641def6b4794783b64f833493a69f65/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.581586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a69ac79b0c4cbda3747742bdafb70d, user_id=2641def6b4794783b64f833493a69f65, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.585737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.626084 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4077/8184] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:39 2021] PUT /identity/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d/users/2641def6b4794783b64f833493a69f65/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:39.627990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.644517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bdc03-8f50-4730-8d2c-b18be37c145b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.780262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.780988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.781262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.781533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.782268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.783866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87045f2-bf1e-431b-b684-3c8e3d053adc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.799284 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4108/8185] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:39.807070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:39.816053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981e51-53b3-4ab5-b095-c06d0c201f05 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:39.823086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:39.829122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.829122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.829122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] PATH_INFO: `/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d/users/2641def6b4794783b64f833493a69f65/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.833469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a69ac79b0c4cbda3747742bdafb70d, user_id=2641def6b4794783b64f833493a69f65, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:39.836284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:39.856656 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4078/8186] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:39 2021] PUT /identity/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d/users/2641def6b4794783b64f833493a69f65/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:26:39.861065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:39.862580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:39.863535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:39.898372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] MFA Rules not processed for user `2641def6b4794783b64f833493a69f65`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:39.899690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:39.987763 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4109/8187] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:39 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:40.001962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:40.004125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:40.075235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b115a-8c7e-48d5-b94e-02e8875ea306 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:40.079838 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:40.080687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:40.081122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:40.081391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:40.093879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:40.095433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:40.112756 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4079/8188] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:40 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:40.617183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:40.618604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:40.637813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b73c-f93e-4e3b-a37a-a6af73cb4d26 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:40.642589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:40.643508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:40.643940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:40.644389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:40.705230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:40.706681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:40.717163 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4110/8189] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:40 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:45.245709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:45.278396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310e12-0a28-4f32-922f-d2ed50a96e46 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:45.295176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:45.296286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:45.296856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:45.297290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:45.368423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:45.370650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7e05-3e4e-41f0-bc13-52a3b510f5e6 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:45.382128 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4080/8190] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:45 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:48.043070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:48.120560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4475-fcc0-46f5-9693-b6d284303141 service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:48.127334 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:48.128434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:48.130366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:48.130803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] PATH_INFO: `/v3/users/f99895ae83414974b2f461b454643c21` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:48.132275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99895ae83414974b2f461b454643c21)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:48.134317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:48.214364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99895ae83414974b2f461b454643c21'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:48.225058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99895ae83414974b2f461b454643c21'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:48.225726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99895ae83414974b2f461b454643c21'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:48.248808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99895ae83414974b2f461b454643c21'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:48.261382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99895ae83414974b2f461b454643c21'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:48.276666 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4111/8191] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:48 2021] DELETE /identity/v3/users/f99895ae83414974b2f461b454643c21 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:48.278811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:48.279307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:48.279398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:48.316397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:48.318404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:48.422992 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4081/8192] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:48.436832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:48.438495 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:48.525777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f92da-74a4-4900-b1c1-84c49fd2d7aa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:48.530197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:48.531387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:48.532010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:48.532731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:48.543416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:48.545210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:48.557623 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4112/8193] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:48.902423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:48.904163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:48.931166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a6fd5-2482-475f-8183-b5e8f81bb6d8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:48.941163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:48.942146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:48.942485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:48.942959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] PATH_INFO: `/v3/projects/981192c29b204493b01f914076270be8` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:48.949623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981192c29b204493b01f914076270be8)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:48.952083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:49.018790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981192c29b204493b01f914076270be8', 'request_id': 'req-5c9c4632-e8b3-451e-bc15-3d09a47fb301'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.030781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981192c29b204493b01f914076270be8', 'request_id': 'req-5c9c4632-e8b3-451e-bc15-3d09a47fb301'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.038518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981192c29b204493b01f914076270be8', 'request_id': 'req-5c9c4632-e8b3-451e-bc15-3d09a47fb301'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.060878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] The token cache is being invalidate because project 981192c29b204493b01f914076270be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:49.061600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.062647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.065165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4082/8194] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:48 2021] DELETE /identity/v3/projects/981192c29b204493b01f914076270be8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:49.069191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:49.088621 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c231-750e-420b-8746-96614e6cb9f0 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:49.201384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:49.203492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:49.204232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:49.205322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] PATH_INFO: `/v3/users/62897f727b27417b83ee336d98d693d0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:49.207088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=62897f727b27417b83ee336d98d693d0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:49.210140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:49.293816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62897f727b27417b83ee336d98d693d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.309761 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62897f727b27417b83ee336d98d693d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.310513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62897f727b27417b83ee336d98d693d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.331915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62897f727b27417b83ee336d98d693d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.355751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62897f727b27417b83ee336d98d693d0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.377560 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4113/8195] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:49 2021] DELETE /identity/v3/users/62897f727b27417b83ee336d98d693d0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:49.754955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:49.756557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:49.778046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4632-e8b3-451e-bc15-3d09a47fb301 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:49.849349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:49.850616 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:49.851290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:49.851789 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] PATH_INFO: `/v3/projects/4f71051e88234e8184962e09567fc1b7` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:49.853443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f71051e88234e8184962e09567fc1b7)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:49.855632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:49.938758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f71051e88234e8184962e09567fc1b7', 'request_id': 'req-5df210cc-5311-4617-a5a6-b039bdc6f0cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.944140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f71051e88234e8184962e09567fc1b7', 'request_id': 'req-5df210cc-5311-4617-a5a6-b039bdc6f0cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.950379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f71051e88234e8184962e09567fc1b7', 'request_id': 'req-5df210cc-5311-4617-a5a6-b039bdc6f0cf'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.964993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] The token cache is being invalidate because project 4f71051e88234e8184962e09567fc1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:49.965357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.965920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:49.967692 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4083/8196] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:49 2021] DELETE /identity/v3/projects/4f71051e88234e8184962e09567fc1b7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:49.971551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:49.973119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:49.986380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b175eb0-3b12-4adf-b4b4-0f240f16c8fd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:50.045289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:50.046236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:50.046581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:50.046950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] PATH_INFO: `/v3/users/2641def6b4794783b64f833493a69f65` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:50.048201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2641def6b4794783b64f833493a69f65)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:50.050209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:50.107017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2641def6b4794783b64f833493a69f65'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.116643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2641def6b4794783b64f833493a69f65'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.117403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2641def6b4794783b64f833493a69f65'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.131479 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2641def6b4794783b64f833493a69f65'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.140909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e713adbb-0691-41c3-842d-2d2831390a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2641def6b4794783b64f833493a69f65'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.149227 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4114/8197] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:49 2021] DELETE /identity/v3/users/2641def6b4794783b64f833493a69f65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:50.590412 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:50.591928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:50.607459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df210cc-5311-4617-a5a6-b039bdc6f0cf admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:50.735122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:50.736013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:50.736562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:50.736903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] PATH_INFO: `/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:50.740029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a69ac79b0c4cbda3747742bdafb70d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:50.742204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:50.813469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a69ac79b0c4cbda3747742bdafb70d', 'request_id': 'req-07b43ec3-6820-45d0-915d-35129133510c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.822737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a69ac79b0c4cbda3747742bdafb70d', 'request_id': 'req-07b43ec3-6820-45d0-915d-35129133510c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.830444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a69ac79b0c4cbda3747742bdafb70d', 'request_id': 'req-07b43ec3-6820-45d0-915d-35129133510c'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.850471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] The token cache is being invalidate because project e3a69ac79b0c4cbda3747742bdafb70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:50.851012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.852058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-07b43ec3-6820-45d0-915d-35129133510c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:50.854731 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4084/8198] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:50 2021] DELETE /identity/v3/projects/e3a69ac79b0c4cbda3747742bdafb70d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:50.862459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:50.863164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:50.863883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:50.898867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:50.900347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:51.000101 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4115/8199] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:51.010359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.010643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.010920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.044251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:51.046580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:51.065939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.068865 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4085/8200] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:51.081979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1133-8e82-46c8-87c5-59653e90635b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.095376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.096178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.096552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.096924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.097753 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:26:51.098673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.100419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.133898 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4116/8201] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:26:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:26:51.135061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.153924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7d6e6-7bad-4411-9596-be4e9c89a644 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.161369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.162374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.162835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.163304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.164285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.167036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.229482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.230183 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4086/8202] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:51.241897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed3ee-bcda-4d69-9ec5-a37246005ac4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.444744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.445494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.445772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.446036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.446722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.448587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.471902 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4117/8203] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:26:51.473165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.483006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206904-db2f-4d26-9a69-c27e0a5562df admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.487524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.488173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.488449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.489301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.490032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.491592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.501974 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4087/8204] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:51.506300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.515778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef523-cbaa-4cca-aff6-4bebba5bff53 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.520419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.521090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.521367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.521634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.522352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.523941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcd7e-08c9-4929-beb3-3f1c7b5360d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.533922 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4118/8205] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:26:51.538137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.548377 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c29f5-b5cb-4574-bcdc-4bfd57a7f5af admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.553416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.554287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.554565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.554837 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] PATH_INFO: `/v3/projects/7c794d7d2a054da5a7a201add4a1e14f/users/448b421c6afb4e618ee5eb162cede9a1/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.570153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c794d7d2a054da5a7a201add4a1e14f, user_id=448b421c6afb4e618ee5eb162cede9a1, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.572823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.586663 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4088/8206] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:51 2021] PUT /identity/v3/projects/7c794d7d2a054da5a7a201add4a1e14f/users/448b421c6afb4e618ee5eb162cede9a1/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:51.597492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.597776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.598190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.651372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] MFA Rules not processed for user `448b421c6afb4e618ee5eb162cede9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:51.652600 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:51.753329 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4119/8207] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:26:51.758581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.847514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a0c7e-54d0-44af-a9e3-6cc339459e6b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.853886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.854749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.855181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.855726 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.856690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.858829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:51.890423 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4089/8208] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/projects => generated 407 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:26:51.894098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:51.908858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732e3b-b995-4af2-9e5d-ec02ac205104 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:51.990125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:51.990906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:51.991261 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:51.991606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:51.992398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:51.996476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.022972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4120/8209] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:26:51 2021] POST /identity/v3/users => generated 310 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:26:52.026759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.041005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e6b9-ee13-498b-a8d4-87e021a7548f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.046459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.047146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.047447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.047664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.048405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.050182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.062912 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4090/8210] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:52 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:52.066811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.082591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1384-727f-49c0-bcce-69083b5c7ca3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.092427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.094212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.094650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.095110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] PATH_INFO: `/v3/projects/6ffc4cb9226844cbaa79f93575f04587/users/766aa700753c4d6f99bb88ed84bccaf7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.117021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffc4cb9226844cbaa79f93575f04587, user_id=766aa700753c4d6f99bb88ed84bccaf7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.120215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.137646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4121/8211] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:52 2021] PUT /identity/v3/projects/6ffc4cb9226844cbaa79f93575f04587/users/766aa700753c4d6f99bb88ed84bccaf7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:52.141442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.153234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd96d7-62bc-46fe-b053-1739a19319b5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.215085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.215747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.216023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.216315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.217073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.219055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485c5b-5524-4af5-9f7c-deb195f7b310 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.231967 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4091/8212] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:26:52 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:26:52.235940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.246449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ba8b-d7b0-465f-8845-b39a6dad9d84 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.251012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.251879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.252152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.252418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] PATH_INFO: `/v3/projects/6ffc4cb9226844cbaa79f93575f04587/users/766aa700753c4d6f99bb88ed84bccaf7/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.254783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffc4cb9226844cbaa79f93575f04587, user_id=766aa700753c4d6f99bb88ed84bccaf7, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.257151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.277154 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4122/8213] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:26:52 2021] PUT /identity/v3/projects/6ffc4cb9226844cbaa79f93575f04587/users/766aa700753c4d6f99bb88ed84bccaf7/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:52.278994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.279280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.279554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.307466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] MFA Rules not processed for user `766aa700753c4d6f99bb88ed84bccaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:52.308694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:52.380571 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4092/8214] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:52 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:52.390966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.393349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:52.487056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e24e8-6f95-4da6-b527-c95ec7d91844 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.491320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.491538 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.491818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.492095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.502145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.503564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.522834 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4123/8215] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:52 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:52.717781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:52.735706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4e06c-a248-4f85-b072-6e6d1bcc242f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:52.744229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:52.749273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:52.749559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:52.749836 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:52.841720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:52.844498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76303288-e5fa-47d9-b264-a5286c645c2b service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:52.863253 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4093/8216] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:52 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:58.322760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:58.382443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9deeae-aad0-4d64-9d9b-a0702be2fdcf service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:58.386975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:58.387836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:58.388112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:58.388383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] PATH_INFO: `/v3/users/448b421c6afb4e618ee5eb162cede9a1` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:58.389670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] RBAC: Authorizing `identity:delete_user(user_id=448b421c6afb4e618ee5eb162cede9a1)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:58.391557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:58.436984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448b421c6afb4e618ee5eb162cede9a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:58.443691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448b421c6afb4e618ee5eb162cede9a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:58.444380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448b421c6afb4e618ee5eb162cede9a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:58.455883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448b421c6afb4e618ee5eb162cede9a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:58.464659 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448b421c6afb4e618ee5eb162cede9a1'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:58.470730 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4124/8217] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:58 2021] DELETE /identity/v3/users/448b421c6afb4e618ee5eb162cede9a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:58.475748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:58.476256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:58.476390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:58.492940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:26:58.494147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:58.556446 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4094/8218] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:26:58.566256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:58.568193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:58.629948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2be02-cd6b-4d7d-a670-bb6ff9c5878a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:58.639081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:58.640111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:58.640111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:58.640312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:58.650675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:58.652373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:58.662517 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4125/8219] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:26:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:26:58.984592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:58.986297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:59.008911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5462-fa3e-4441-bbf5-6b485a24da8c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:59.014220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:59.015633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:59.016277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:59.016830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] PATH_INFO: `/v3/projects/7c794d7d2a054da5a7a201add4a1e14f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:59.018444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c794d7d2a054da5a7a201add4a1e14f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:59.021876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:59.096133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c794d7d2a054da5a7a201add4a1e14f', 'request_id': 'req-6483ad13-a47c-4da7-a278-66cbf419c556'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.102432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c794d7d2a054da5a7a201add4a1e14f', 'request_id': 'req-6483ad13-a47c-4da7-a278-66cbf419c556'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.111133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c794d7d2a054da5a7a201add4a1e14f', 'request_id': 'req-6483ad13-a47c-4da7-a278-66cbf419c556'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.128480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] The token cache is being invalidate because project 7c794d7d2a054da5a7a201add4a1e14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:59.128804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.130049 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.131613 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4095/8220] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:58 2021] DELETE /identity/v3/projects/7c794d7d2a054da5a7a201add4a1e14f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:59.135628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:59.145898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846836a-bc04-465b-9840-7cbd38f39341 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:59.215504 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:59.216475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:59.216878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:59.217226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] PATH_INFO: `/v3/users/766aa700753c4d6f99bb88ed84bccaf7` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:59.218521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766aa700753c4d6f99bb88ed84bccaf7)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:59.220692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:59.278547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766aa700753c4d6f99bb88ed84bccaf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.291393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766aa700753c4d6f99bb88ed84bccaf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.292215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766aa700753c4d6f99bb88ed84bccaf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.305731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766aa700753c4d6f99bb88ed84bccaf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.325717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3bcdbc1a-9cb7-4d82-8e34-b5c75bd24ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766aa700753c4d6f99bb88ed84bccaf7'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.343802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4126/8221] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:26:59 2021] DELETE /identity/v3/users/766aa700753c4d6f99bb88ed84bccaf7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:59.797766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:26:59.799926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:26:59.839191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483ad13-a47c-4da7-a278-66cbf419c556 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:26:59.899694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:26:59.900562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:59.900880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:59.901598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] PATH_INFO: `/v3/projects/6ffc4cb9226844cbaa79f93575f04587` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:26:59.902453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffc4cb9226844cbaa79f93575f04587)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:26:59.904347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:26:59.949782 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffc4cb9226844cbaa79f93575f04587', 'request_id': 'req-48fa0055-a279-4102-97b2-8222af6d1af2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.955257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffc4cb9226844cbaa79f93575f04587', 'request_id': 'req-48fa0055-a279-4102-97b2-8222af6d1af2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.962114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffc4cb9226844cbaa79f93575f04587', 'request_id': 'req-48fa0055-a279-4102-97b2-8222af6d1af2'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.975589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] The token cache is being invalidate because project 6ffc4cb9226844cbaa79f93575f04587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:26:59.975873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.976511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-48fa0055-a279-4102-97b2-8222af6d1af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:26:59.982411 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4096/8222] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:26:59 2021] DELETE /identity/v3/projects/6ffc4cb9226844cbaa79f93575f04587 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:26:59.984181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:26:59.984468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:26:59.984786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.001852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:00.003087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:00.060692 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4127/8223] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:26:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:00.069240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.069822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.070108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.089229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:00.090439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:00.098563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4097/8224] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:00.102935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.112582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d82d-0c98-4204-beec-0170493eac5c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.117311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.117952 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.118227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.118494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.119244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:00.119535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.121137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.133327 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4128/8225] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:00.137513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.147768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104036-af1a-4ac4-b161-9517553b5507 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.152474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.154694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.154694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.154694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.154694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.156237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.181410 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4098/8226] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:00.185343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.195516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c4149-42d3-46eb-a9d8-bfef0a0bd0c3 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.251614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.252505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.252817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.253089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.253790 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.256190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.276800 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4129/8227] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:00.280845 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.290888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98726e93-3338-4365-8e27-5e0daaefd51a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.295452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.296082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.296358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.296687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.297393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.298956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.309578 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4099/8228] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:00.313523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.323738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4933-8363-4707-a038-6bda5a0aa8ac admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.328506 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.329459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.329734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.330185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.330909 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.333111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15cee-2d2e-4957-9833-4d30c81778b1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.343587 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4130/8229] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:00.347750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.357634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ddf-4f9d-40e7-b676-8d3ab09de445 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.362367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.363936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.364281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.364557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] PATH_INFO: `/v3/projects/eb2bec88ac5a4e3fa172314f7affc087/users/42a088840e30422680a094a10829bf4c/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.379840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2bec88ac5a4e3fa172314f7affc087, user_id=42a088840e30422680a094a10829bf4c, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.382466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.395667 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4100/8230] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:00 2021] PUT /identity/v3/projects/eb2bec88ac5a4e3fa172314f7affc087/users/42a088840e30422680a094a10829bf4c/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:00.405829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.406119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.406395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.433347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] MFA Rules not processed for user `42a088840e30422680a094a10829bf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:00.434702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:00.497272 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4131/8231] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:00.502065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.565282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887af7-5bb0-489f-a879-1f3f21cc90fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.570606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.571265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.571540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.571829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.572522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.574418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.604792 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4101/8232] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:00.607643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.621224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9ca1-6b23-4f26-8a67-71fbdb2a84e3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.691457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.692522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.693006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.693435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.694314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.697046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.721283 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4132/8233] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:00 2021] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:00.725846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.736119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af529-caaa-4ef9-91d3-29f83803931f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.741118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.741714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.742023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.742256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.743256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.745209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.756472 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4102/8234] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:00.760839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.771265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12311-aaac-4349-b1e2-6cc93ff41c46 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.776181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.777090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.777370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.777641 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] PATH_INFO: `/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71/users/11bac3dbe32444a599cc3929b59eee6e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.792461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6d90e9ae1d4b5cbfb8f176e785da71, user_id=11bac3dbe32444a599cc3929b59eee6e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.795257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.813200 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4133/8235] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:00 2021] PUT /identity/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71/users/11bac3dbe32444a599cc3929b59eee6e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:00.817438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.827895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ce9fc-ecd0-4471-9d18-8132ebe18403 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.884822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.885590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.885873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.886167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.886889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.888470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb1bb7-f245-4023-b48b-498b23b1ba6c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.902064 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4103/8236] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:00.903175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:00.913379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25095c25-86d5-4ccf-9df3-88ecac3200df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:00.918105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:00.918983 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:00.919262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:00.919537 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] PATH_INFO: `/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71/users/11bac3dbe32444a599cc3929b59eee6e/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:00.923275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6d90e9ae1d4b5cbfb8f176e785da71, user_id=11bac3dbe32444a599cc3929b59eee6e, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:00.926142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:00.937019 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4134/8237] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:00 2021] PUT /identity/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71/users/11bac3dbe32444a599cc3929b59eee6e/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:01.036709 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:01.037001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:01.037275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:01.063934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] MFA Rules not processed for user `11bac3dbe32444a599cc3929b59eee6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:01.065474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:01.138674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4104/8238] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:01 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:01.149521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:01.151292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:01.216341 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef0ba-546f-423d-a7c2-c6d8bfcfd7fb admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:01.220202 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:01.220896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:01.221176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:01.221521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:01.297858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:01.299217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1289b-bd2c-48fb-b38d-53933140140d service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:01.309554 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4135/8239] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:01 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:05.140154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.141583 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.202818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453abb12-7ade-4ee4-893d-adec82c2fb56 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.208009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:05.208892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.209166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.209439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] PATH_INFO: `/v3/users/34555d2cc6014cf1a13984b2267b5403` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.210625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34555d2cc6014cf1a13984b2267b5403)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:05.212504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:05.257863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34555d2cc6014cf1a13984b2267b5403'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.264486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34555d2cc6014cf1a13984b2267b5403'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.265160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34555d2cc6014cf1a13984b2267b5403'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.265751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34555d2cc6014cf1a13984b2267b5403'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.273204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34555d2cc6014cf1a13984b2267b5403'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.289866 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4105/8240] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:05 2021] DELETE /identity/v3/users/34555d2cc6014cf1a13984b2267b5403 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:05.294380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.294871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.294982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.311340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:05.312529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.368383 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4136/8241] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:05.378206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.380116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.435809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e850-3994-4cfe-8dbd-c548e929de43 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.439415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:05.440039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.440315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.440586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.449915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:05.451309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490f0e-2386-4c55-9c0f-3357890c0c98 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:05.461507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4106/8242] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:05.640189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.641874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.658355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6ba7-5aa2-41bd-9051-65b02636b2a7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.665821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:05.666864 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.667174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.667466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] PATH_INFO: `/v3/projects/cd8ab72f7ec34da4b6c93f1a35b7a922` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.668847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8ab72f7ec34da4b6c93f1a35b7a922)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:05.671493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:05.721934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8ab72f7ec34da4b6c93f1a35b7a922', 'request_id': 'req-fd5b8d04-c25e-46eb-a50c-874c94d187f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.727762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8ab72f7ec34da4b6c93f1a35b7a922', 'request_id': 'req-fd5b8d04-c25e-46eb-a50c-874c94d187f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.734032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8ab72f7ec34da4b6c93f1a35b7a922', 'request_id': 'req-fd5b8d04-c25e-46eb-a50c-874c94d187f8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.746243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] The token cache is being invalidate because project cd8ab72f7ec34da4b6c93f1a35b7a922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:05.746527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.747140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-fd5b8d04-c25e-46eb-a50c-874c94d187f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:05.748659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4137/8243] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:05 2021] DELETE /identity/v3/projects/cd8ab72f7ec34da4b6c93f1a35b7a922 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:05.755411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.755707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.755961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.773387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:05.774596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.832490 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4107/8244] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:05.839679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.839962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.840233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.859254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:05.860465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:05.869246 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4138/8245] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:05.873443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.883814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5419e9c-21b1-4b05-81dd-022bbdf3441e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.888465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:05.889148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.889431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.889705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.890443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:05.890746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:05.892318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:05.903675 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4108/8246] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:05.907685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.916963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457aafe-6fea-4527-a384-4aa72309635a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.921768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:05.922413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:05.922684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:05.922949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:05.923643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:05.926141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:05.953225 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4139/8247] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:05 2021] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:05.957817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.967676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616eb7a-b4f2-40ca-9d44-7aade0a1c5f4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:05.978737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:05.980554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:06.023386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.024054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.024334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.024642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.025362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.027251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.039856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a46b2-4325-4c6c-a36f-aa9d83556d18 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:06.044172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.044869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.045143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.045411 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.047178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:06.047862 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4109/8248] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:05 2021] POST /identity/v3/users => generated 277 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:06.052500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:06.061872 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c109e-8c95-49ab-b6ce-9d48374ec600 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:06.066595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.067365 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.067644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.067923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.068680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.070242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.080632 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4110/8249] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:06.084402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:06.094287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d33cd-6e1b-42b4-bac3-d4aded5db307 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:06.099429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.100059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.100344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.100758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.101477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.103063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.109906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.111522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a2ac6-1d4a-4637-bc53-bea26aece07f service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.117016 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4111/8250] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:06.117980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:06.121923 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4140/8251] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:05 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:27:06.127344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940220e2-0c32-429e-88a1-82dee3d28b49 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:06.132282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.133179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.133465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.133742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] PATH_INFO: `/v3/projects/2e8d7cad99a44dd8a0157fa492457ca2/users/478bcc3c01754a59b4a8fcb9c89e9feb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.147887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8d7cad99a44dd8a0157fa492457ca2, user_id=478bcc3c01754a59b4a8fcb9c89e9feb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.150447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.164035 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4112/8252] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:06 2021] PUT /identity/v3/projects/2e8d7cad99a44dd8a0157fa492457ca2/users/478bcc3c01754a59b4a8fcb9c89e9feb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:06.174391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.174950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.175233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.204199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] MFA Rules not processed for user `478bcc3c01754a59b4a8fcb9c89e9feb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:06.205612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:06.271296 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4141/8253] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:06 2021] POST /identity/v3/auth/tokens => generated 3220 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:27:06.281716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:06.283373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:06.348934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddabbec-8c41-42bc-a58a-3ab387eedb57 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:06.352642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:06.353276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:06.353560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:06.353841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:06.362182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:06.364234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0d3d-8e9f-4a11-9131-0994bb07d544 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:06.372928 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4113/8254] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:06 2021] GET /identity/v3/auth/tokens => generated 3220 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:27:07.956244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.025782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce5884-a480-48d6-8264-412df01d0372 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.031415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.032386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.032708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.033052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] PATH_INFO: `/v3/users/478bcc3c01754a59b4a8fcb9c89e9feb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.034413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478bcc3c01754a59b4a8fcb9c89e9feb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.037111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.088001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478bcc3c01754a59b4a8fcb9c89e9feb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.094684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478bcc3c01754a59b4a8fcb9c89e9feb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.095660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478bcc3c01754a59b4a8fcb9c89e9feb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.107892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478bcc3c01754a59b4a8fcb9c89e9feb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.114970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478bcc3c01754a59b4a8fcb9c89e9feb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.120590 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4142/8255] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:07 2021] DELETE /identity/v3/users/478bcc3c01754a59b4a8fcb9c89e9feb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:08.125111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.125585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.125674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.142000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:08.143202 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:08.199249 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4114/8256] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:08.209854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.211253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:08.269016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb55b-1dae-46b7-ad30-e87824890cf9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.273222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.273853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.274127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.274397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.283212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.284628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517b425-285b-4541-90fc-7cee146143e1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.293761 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4143/8257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:08.456296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.458385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:08.472122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453ac6-6099-42ea-9191-fbd58bcbab01 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.477045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.477935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.478211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.478487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] PATH_INFO: `/v3/projects/2e8d7cad99a44dd8a0157fa492457ca2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.480586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8d7cad99a44dd8a0157fa492457ca2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.482593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.528424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8d7cad99a44dd8a0157fa492457ca2', 'request_id': 'req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.533646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8d7cad99a44dd8a0157fa492457ca2', 'request_id': 'req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.539511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8d7cad99a44dd8a0157fa492457ca2', 'request_id': 'req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.551023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] The token cache is being invalidate because project 2e8d7cad99a44dd8a0157fa492457ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:08.551306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.551918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d3a7c9f4-c6a6-46aa-9458-647dd0dafd28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:08.553483 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4115/8258] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:08 2021] DELETE /identity/v3/projects/2e8d7cad99a44dd8a0157fa492457ca2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:08.559395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.559680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.559956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.577593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:08.578785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:08.643474 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4144/8259] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:08.653640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.654123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.654797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.683839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:08.684407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:08.693416 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4116/8260] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:08.697908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.709831 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4bfb-92f0-4bbe-a0bf-e6e69880664d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.715893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.716593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.716887 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.717164 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.717907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:08.718209 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.719847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.732724 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4145/8261] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:08.736995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.747319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8761b1b-f6ba-4558-9911-44ddcef6894f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.752089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.752947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.753235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.753513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.754811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.756717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.787294 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4117/8262] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:08 2021] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:08.791228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.801980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16dac8-2265-4dd7-9ac7-6faa9a966b49 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.857755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.858397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.858675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.859613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.860349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.862269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.884170 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4146/8263] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:08 2021] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:08.888639 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.899186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5d0c-c81c-441c-b94c-65897e223a25 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.903878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.904543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.904848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.905126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.905863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.907484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.918659 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4118/8264] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:08.922683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.933215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df6e75-3e41-4f16-973b-2640e6275adf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.937848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.938512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.938803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.939069 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.939800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.942028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06872fcc-9200-4a3f-9ff0-8810d9c4091f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:08.952292 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4147/8265] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:08.956695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:08.966381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04248-cec5-4a2c-89c7-567358916793 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:08.971276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:08.972812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:08.972812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:08.972812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] PATH_INFO: `/v3/projects/d25dd7221e1f48e0a55a68ea0c35e199/users/72ee397c38674679a33f16c9d40f52b6/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:08.987594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25dd7221e1f48e0a55a68ea0c35e199, user_id=72ee397c38674679a33f16c9d40f52b6, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:08.990776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.004814 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4119/8266] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:08 2021] PUT /identity/v3/projects/d25dd7221e1f48e0a55a68ea0c35e199/users/72ee397c38674679a33f16c9d40f52b6/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:09.015689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.016508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.016817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.043015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] MFA Rules not processed for user `72ee397c38674679a33f16c9d40f52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:09.044205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:09.110383 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4148/8267] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:09 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:09.115460 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.174301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983b0f8-c4f1-47be-a3a6-67a91b26912e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.179756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.180408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.180729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.181008 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.181783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.183766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.208749 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4120/8268] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:09 2021] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:09.212720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.223685 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff7bb-45cd-4b17-a2df-c2d7e04e394b None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.276152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.276836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.277115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.277417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.278098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.279980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.301413 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4149/8269] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:09 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:09.305408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.315488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4c1b2-09ef-4b4b-b5ae-e8222aa7f5da admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.320085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.320768 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.321045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.321321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.322218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.323663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.333972 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4121/8270] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:09.338113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.348734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd3f8-2bf5-4e6c-9d97-9f2a370022ff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.353339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.354226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.354611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.354915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] PATH_INFO: `/v3/projects/4683a9d005ab48c2aef3e202e65b25da/users/f148651c3fb44b25824048bdada6bcd8/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.370840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4683a9d005ab48c2aef3e202e65b25da, user_id=f148651c3fb44b25824048bdada6bcd8, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.373447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.386579 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4150/8271] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:09 2021] PUT /identity/v3/projects/4683a9d005ab48c2aef3e202e65b25da/users/f148651c3fb44b25824048bdada6bcd8/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:09.390622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.402218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a998-1ee7-48ea-9bdb-142f3f9b645f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.465488 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.466101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.466385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.466667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.467387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.469079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec36ff-1be6-42a7-9ee0-5f14f2e2ecd6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.480760 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4122/8272] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:09 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:09.485092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.495702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e42b8-de60-4642-aae9-96bfa4ed7594 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.500484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.501524 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.501738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.502095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] PATH_INFO: `/v3/projects/4683a9d005ab48c2aef3e202e65b25da/users/f148651c3fb44b25824048bdada6bcd8/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.504083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4683a9d005ab48c2aef3e202e65b25da, user_id=f148651c3fb44b25824048bdada6bcd8, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.506770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.517173 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4151/8273] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:09 2021] PUT /identity/v3/projects/4683a9d005ab48c2aef3e202e65b25da/users/f148651c3fb44b25824048bdada6bcd8/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:09.528076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.528403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.528708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.557166 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] MFA Rules not processed for user `f148651c3fb44b25824048bdada6bcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:09.558420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:09.632380 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4123/8274] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:09 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:09.645817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.647818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:09.728671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b153c5-821e-4ae4-94ef-9b2426dd177c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.736352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.737285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.737799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.738192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.748747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.750295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.762449 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4152/8275] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:09 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:27:09.833931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:09.845587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc383b69-42b1-4312-9a4e-db09f82754a1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:09.849119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:09.849740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:09.850014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:09.850284 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:09.904447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:09.905880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac633c4-d2b4-40c5-b9ef-792248f5fcee service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:09.914679 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4124/8276] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:09 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:18.040781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:18.102892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2813b-82d9-467c-9b3c-26593cd1255c service cinder] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:18.107396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:18.108563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:18.108871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:18.109135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] PATH_INFO: `/v3/users/72ee397c38674679a33f16c9d40f52b6` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:18.110556 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ee397c38674679a33f16c9d40f52b6)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:18.112422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:18.156248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ee397c38674679a33f16c9d40f52b6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.163469 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ee397c38674679a33f16c9d40f52b6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.164108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ee397c38674679a33f16c9d40f52b6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.175881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ee397c38674679a33f16c9d40f52b6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.182455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ee397c38674679a33f16c9d40f52b6'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.188159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4153/8277] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:18 2021] DELETE /identity/v3/users/72ee397c38674679a33f16c9d40f52b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:18.192774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:18.193592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:18.193922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:18.210767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:18.211948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:18.267901 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4125/8278] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:18.277709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:18.279081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:18.337190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f89cf-9181-4fdf-9c1b-d4ce092205ad admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:18.340893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:18.341527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:18.341806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:18.342077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:18.351626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:18.353168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:18.362412 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4154/8279] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:18.640670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:18.643370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:18.677664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e832f-b775-4636-8265-dd2bf916f23d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:18.682813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:18.683672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:18.683947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:18.684248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] PATH_INFO: `/v3/projects/d25dd7221e1f48e0a55a68ea0c35e199` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:18.685504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25dd7221e1f48e0a55a68ea0c35e199)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:18.687400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:18.733608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25dd7221e1f48e0a55a68ea0c35e199', 'request_id': 'req-27b3f153-a223-4ef0-bcbb-14732567de3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.738893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25dd7221e1f48e0a55a68ea0c35e199', 'request_id': 'req-27b3f153-a223-4ef0-bcbb-14732567de3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.744823 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25dd7221e1f48e0a55a68ea0c35e199', 'request_id': 'req-27b3f153-a223-4ef0-bcbb-14732567de3f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.757312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] The token cache is being invalidate because project d25dd7221e1f48e0a55a68ea0c35e199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:18.757593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.758210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.759722 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4126/8280] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:18 2021] DELETE /identity/v3/projects/d25dd7221e1f48e0a55a68ea0c35e199 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:18.763782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:18.773860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f746a-2ce3-41b4-ab43-21274440fa56 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:18.826668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:18.827595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:18.827869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:18.828142 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] PATH_INFO: `/v3/users/f148651c3fb44b25824048bdada6bcd8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:18.829608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f148651c3fb44b25824048bdada6bcd8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:18.832079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:18.877713 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f148651c3fb44b25824048bdada6bcd8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.884895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f148651c3fb44b25824048bdada6bcd8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.885492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f148651c3fb44b25824048bdada6bcd8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.897405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f148651c3fb44b25824048bdada6bcd8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.904383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-0f8bee24-ea86-446c-b7e3-58d5d1c41764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f148651c3fb44b25824048bdada6bcd8'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:18.910085 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4155/8281] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:18 2021] DELETE /identity/v3/users/f148651c3fb44b25824048bdada6bcd8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:19.171045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.172744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:19.189211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3f153-a223-4ef0-bcbb-14732567de3f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.243912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.244802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.245083 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.245354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] PATH_INFO: `/v3/projects/4683a9d005ab48c2aef3e202e65b25da` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.246527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4683a9d005ab48c2aef3e202e65b25da)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.248440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.292175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4683a9d005ab48c2aef3e202e65b25da', 'request_id': 'req-be453438-9dd3-44f5-a794-c555bc9f40a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:19.297731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4683a9d005ab48c2aef3e202e65b25da', 'request_id': 'req-be453438-9dd3-44f5-a794-c555bc9f40a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:19.304154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4683a9d005ab48c2aef3e202e65b25da', 'request_id': 'req-be453438-9dd3-44f5-a794-c555bc9f40a5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:19.316470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] The token cache is being invalidate because project 4683a9d005ab48c2aef3e202e65b25da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:19.316786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:19.317409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-be453438-9dd3-44f5-a794-c555bc9f40a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:19.319185 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4127/8282] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:19 2021] DELETE /identity/v3/projects/4683a9d005ab48c2aef3e202e65b25da => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:19.324542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.325012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.325123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.342400 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:19.343589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:19.401270 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4156/8283] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:19.409699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.409985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.410283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.429356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:19.430461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:19.438356 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4128/8284] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:19.443110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.454690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc9ce8-bfe4-4cc0-9307-e02409406345 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.459414 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.460076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.460336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.460628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.461355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:19.461656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.463254 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.474512 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4157/8285] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:19.478866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.488688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb3e0-2b2a-4f0d-918d-b816055ce682 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.493267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.493909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.494232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.494459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.495563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.497649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.528124 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4129/8286] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:19 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:19.529675 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.541098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f32de-9289-441c-bab4-72c245c655ff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.596194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.596890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.597705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.597982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.598780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.600911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.622076 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4158/8287] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:19 2021] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:19.627125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.638140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5f29-f156-4200-a593-9d61cc6793fc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.643368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.644237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.644644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.645025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.645871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.647436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.659242 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4130/8288] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:19.664198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.674543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08d6e-fc1d-4186-9db0-e27bf517172a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.680129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.680769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.681048 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.681321 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.682081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.683701 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1a5f7-8031-4645-8678-d99c06944c0f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.693908 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4159/8289] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:19.698296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.708539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6539f-2c3c-412c-aaec-818d79fc5f5b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.714023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.715044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.715390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.715733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] PATH_INFO: `/v3/projects/31212df533824799b286b2a87f74488d/users/253511447f6345a48561b562dcd60f42/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.732268 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31212df533824799b286b2a87f74488d, user_id=253511447f6345a48561b562dcd60f42, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.734878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.748101 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4131/8290] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:19 2021] PUT /identity/v3/projects/31212df533824799b286b2a87f74488d/users/253511447f6345a48561b562dcd60f42/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:19.758866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.759144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.759417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.785821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] MFA Rules not processed for user `253511447f6345a48561b562dcd60f42`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:19.787050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:19.849214 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4160/8291] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:19.860350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:19.862065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:19.920674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253213fa-684b-48aa-8b94-42bf51b7fc16 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:19.924303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:19.924969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:19.925286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:19.925560 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:19.933855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:19.935195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a030-f282-4e3d-b621-20367ffc8b8b service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:19.943876 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4132/8292] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:19.963731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.021314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870112e6-c638-4af5-bccf-80c02c86ce63 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.025922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.026764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.027075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.027306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] PATH_INFO: `/v3/users/253511447f6345a48561b562dcd60f42` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.028482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253511447f6345a48561b562dcd60f42)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.030393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.075771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253511447f6345a48561b562dcd60f42'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.083214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253511447f6345a48561b562dcd60f42'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.083877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253511447f6345a48561b562dcd60f42'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.095070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253511447f6345a48561b562dcd60f42'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.102532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253511447f6345a48561b562dcd60f42'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.108652 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4161/8293] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:19 2021] DELETE /identity/v3/users/253511447f6345a48561b562dcd60f42 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:20.113325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.113605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.113911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.130334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:20.131529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:20.186740 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4133/8294] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:20.196408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.197835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:20.256384 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75bb8-8f6a-4121-880d-58be35cdd426 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.260044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.260709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.260990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.261265 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.271297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.272732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7760e-de22-49e5-8bd7-9a6b7ff2d23b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.282087 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4162/8295] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:20.537497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.538943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:20.552903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12107291-6c31-43d1-acea-9d4aae9ca4a5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.557585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.558532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.558806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.559074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] PATH_INFO: `/v3/projects/31212df533824799b286b2a87f74488d` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.560992 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31212df533824799b286b2a87f74488d)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.563195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.609767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31212df533824799b286b2a87f74488d', 'request_id': 'req-7eba5fd5-0844-4636-a5ad-81438e4a900f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.615391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31212df533824799b286b2a87f74488d', 'request_id': 'req-7eba5fd5-0844-4636-a5ad-81438e4a900f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.621301 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31212df533824799b286b2a87f74488d', 'request_id': 'req-7eba5fd5-0844-4636-a5ad-81438e4a900f'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.633772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] The token cache is being invalidate because project 31212df533824799b286b2a87f74488d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:20.634057 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.634667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7eba5fd5-0844-4636-a5ad-81438e4a900f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:20.636200 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4134/8296] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:20 2021] DELETE /identity/v3/projects/31212df533824799b286b2a87f74488d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:20.642111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.642517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.642743 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.660240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:20.661494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:20.720403 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4163/8297] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:20.730086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.730493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.730771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.753286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:20.755071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:20.763022 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4135/8298] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:20.767096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.777090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aef34-23c0-4ba8-b63e-a9fba580fa21 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.781725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.782376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.782642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.782915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.783691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:20.783992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.785609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.796925 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4164/8299] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:20.802148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.813234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b29c68-23b4-429c-b966-2b0322c2c69d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.819194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.819929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.820275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.820666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.821462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.824035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.855233 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4136/8300] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:20 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:20.860043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.871441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca414-7443-4c88-aff9-9803cf09a796 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.926775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.927435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.927712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.927986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.928707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.930590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.950000 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4165/8301] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:20 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:20.954484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.964534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8514e-6d06-4ebd-a0f0-99859de5d2c5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:20.969155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:20.969720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:20.970005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:20.970276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:20.971001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:20.972596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:20.982737 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4137/8302] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:20.986611 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:20.996995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd319b-242a-4942-8fe6-067ffc985b66 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:21.001650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:21.002297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:21.002576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:21.002850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:21.004170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:21.006047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301fc6-fc20-4f1f-b4e3-03528e4f7f4a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:21.015774 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4166/8303] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:21.019814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:21.029529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa6aff-1e13-455f-9a9e-5d08e6b4667b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:21.034038 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:21.035470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:21.035741 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:21.036006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] PATH_INFO: `/v3/projects/76cd374865df4bfca5328af93dee89eb/users/8df8815ae5ea461692190a95baf2ccce/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:21.049889 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cd374865df4bfca5328af93dee89eb, user_id=8df8815ae5ea461692190a95baf2ccce, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:21.053055 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:21.066154 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4138/8304] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:21 2021] PUT /identity/v3/projects/76cd374865df4bfca5328af93dee89eb/users/8df8815ae5ea461692190a95baf2ccce/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:21.075971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:21.076291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:21.076568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:21.103061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] MFA Rules not processed for user `8df8815ae5ea461692190a95baf2ccce`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:21.104266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:21.166243 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4167/8305] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:21 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:21.177195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:21.178864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:21.235019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f5c9-1886-4713-8ecd-abe470df7a69 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:21.239173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:21.239818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:21.240075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:21.240345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:21.248447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:21.249882 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa50f4d-2edc-4237-9a1f-0912ff6f2f3c service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:21.258469 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4139/8306] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:21 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:25.124542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:25.126045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:25.187857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef263571-bf2b-4b53-8e84-b41b81ad9d76 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:25.192424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:25.193306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:25.193589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:25.193889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] PATH_INFO: `/v3/users/42a088840e30422680a094a10829bf4c` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:25.195072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a088840e30422680a094a10829bf4c)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:25.197051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:25.240279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a088840e30422680a094a10829bf4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.246941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a088840e30422680a094a10829bf4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.247591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a088840e30422680a094a10829bf4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.258727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a088840e30422680a094a10829bf4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.265689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a088840e30422680a094a10829bf4c'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.272050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4168/8307] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:25 2021] DELETE /identity/v3/users/42a088840e30422680a094a10829bf4c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:25.276783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:25.277267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:25.277358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:25.294398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:25.295580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:25.351125 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4140/8308] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:25.361192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:25.362559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:25.419632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396fa5-67a6-4924-8c89-351ca368e72f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:25.423237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:25.423858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:25.424134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:25.424403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:25.433222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:25.434617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:25.444004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4169/8309] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:25.718597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:25.720369 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:25.752745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a032727-9de6-42c5-9982-93a7e688effa None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:25.758942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:25.759850 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:25.760252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:25.760541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] PATH_INFO: `/v3/projects/eb2bec88ac5a4e3fa172314f7affc087` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:25.762031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2bec88ac5a4e3fa172314f7affc087)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:25.763971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:25.812578 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2bec88ac5a4e3fa172314f7affc087', 'request_id': 'req-a88fe141-8730-40a1-b23a-c509590764b7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.818375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2bec88ac5a4e3fa172314f7affc087', 'request_id': 'req-a88fe141-8730-40a1-b23a-c509590764b7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.824469 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2bec88ac5a4e3fa172314f7affc087', 'request_id': 'req-a88fe141-8730-40a1-b23a-c509590764b7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.837796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] The token cache is being invalidate because project eb2bec88ac5a4e3fa172314f7affc087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:25.838085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.838711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.840260 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4141/8310] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:25 2021] DELETE /identity/v3/projects/eb2bec88ac5a4e3fa172314f7affc087 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:25.844187 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:25.853678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7099d42-4e06-41e0-8766-5fea0a907619 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:25.907627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:25.908401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:25.908784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:25.909306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] PATH_INFO: `/v3/users/11bac3dbe32444a599cc3929b59eee6e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:25.910720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bac3dbe32444a599cc3929b59eee6e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:25.912626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:25.955498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bac3dbe32444a599cc3929b59eee6e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.962856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bac3dbe32444a599cc3929b59eee6e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.963501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bac3dbe32444a599cc3929b59eee6e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.975380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bac3dbe32444a599cc3929b59eee6e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.982754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-3a77942b-36cf-43ad-bbac-754fb1e0180d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bac3dbe32444a599cc3929b59eee6e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:25.988669 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4170/8311] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:25 2021] DELETE /identity/v3/users/11bac3dbe32444a599cc3929b59eee6e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:26.247277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.248897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:26.264993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe141-8730-40a1-b23a-c509590764b7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.320522 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.321451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.321729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.322004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] PATH_INFO: `/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.323191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6d90e9ae1d4b5cbfb8f176e785da71)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.325105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.369010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6d90e9ae1d4b5cbfb8f176e785da71', 'request_id': 'req-b2b92580-4b8e-4db1-abba-3b18f9c0da36'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:26.374258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6d90e9ae1d4b5cbfb8f176e785da71', 'request_id': 'req-b2b92580-4b8e-4db1-abba-3b18f9c0da36'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:26.380897 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6d90e9ae1d4b5cbfb8f176e785da71', 'request_id': 'req-b2b92580-4b8e-4db1-abba-3b18f9c0da36'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:26.392343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] The token cache is being invalidate because project 8d6d90e9ae1d4b5cbfb8f176e785da71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:26.392651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:26.393253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b2b92580-4b8e-4db1-abba-3b18f9c0da36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:26.395921 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4142/8312] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:26 2021] DELETE /identity/v3/projects/8d6d90e9ae1d4b5cbfb8f176e785da71 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:26.401603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.402050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.402278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.420520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:26.421735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:26.478236 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4171/8313] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:26.486144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.486473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.486760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.504940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:26.506180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:26.514089 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4143/8314] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:26.517973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.527915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9b65-8ba9-4eec-a8ce-00fe2199b28f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.532337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.533012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.533286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.533555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.534268 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:26.534585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.536175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.547060 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4172/8315] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:26.551384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.560440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4a0b8-3779-48d4-b5bb-476723926b72 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.565102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.566245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.566529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.566797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.567530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.569429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.594448 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4144/8316] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:26 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:26.599290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.609394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d3d1-a103-4f02-97a1-0564456ccae2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.662732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.663393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.663678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.663954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.664775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.666658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.686494 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4173/8317] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:26 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:26.690609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.701199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c05e7-473a-40e9-adbb-391b66f85921 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.706433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.707110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.707391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.707656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.708379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.710115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.721585 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4145/8318] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:26.725359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.734951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05556f-e6e0-4ed1-887e-423c6bb3eeab admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.739914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.740552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.740860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.741130 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.741849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.743404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504a82-a366-4cdb-ba36-334b3daa4af1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.753067 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4174/8319] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:26 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:26.757644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.767342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80805692-2ce7-4db0-8c43-95262d6ed8a7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:26.772058 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:26.772963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.773240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.773519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] PATH_INFO: `/v3/projects/8d6a4f5c910c47a78a079f3112b9b520/users/ba3fd7c1194445508e397cfce2a32096/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.787403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6a4f5c910c47a78a079f3112b9b520, user_id=ba3fd7c1194445508e397cfce2a32096, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:26.790281 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:26.804363 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4146/8320] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:26 2021] PUT /identity/v3/projects/8d6a4f5c910c47a78a079f3112b9b520/users/ba3fd7c1194445508e397cfce2a32096/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:26.814571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:26.814853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:26.815147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:26.842859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] MFA Rules not processed for user `ba3fd7c1194445508e397cfce2a32096`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:26.844179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:26.919234 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4175/8321] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:26.929956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:26.932137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:27.004467 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118bf0b-44a0-4c86-9ab8-398e4a6d9d23 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:27.009096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:27.009840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:27.010180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:27.010472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:27.019745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:27.021440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbe0b9-10ed-44bf-bd51-6565a21608f6 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:27.030693 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4147/8322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:30.172832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:30.174348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:30.243395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f4edd-efc4-43e7-9da5-672f4f90d6bb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:30.248337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:30.249240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:30.249528 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:30.249848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] PATH_INFO: `/v3/users/8df8815ae5ea461692190a95baf2ccce` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:30.251052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df8815ae5ea461692190a95baf2ccce)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:30.253051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:30.298350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df8815ae5ea461692190a95baf2ccce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.306031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df8815ae5ea461692190a95baf2ccce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.306800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df8815ae5ea461692190a95baf2ccce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.318657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df8815ae5ea461692190a95baf2ccce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.326166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df8815ae5ea461692190a95baf2ccce'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.333608 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4176/8323] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:30 2021] DELETE /identity/v3/users/8df8815ae5ea461692190a95baf2ccce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:30.338245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:30.338747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:30.338839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:30.356546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:30.357745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:30.420468 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4148/8324] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:30.430576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:30.432021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:30.493612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df529535-b565-4727-b986-89b6899e7142 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:30.497870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:30.498628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:30.498936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:30.499208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:30.513258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:30.516928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8737-002b-490c-8f0c-b01e206adb0a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:30.528431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4177/8325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:30.849950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:30.851736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:30.866020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff5bc-26b1-40b8-879f-92d74bdac6b1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:30.873642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:30.874718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:30.875276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:30.875719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] PATH_INFO: `/v3/projects/76cd374865df4bfca5328af93dee89eb` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:30.877546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cd374865df4bfca5328af93dee89eb)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:30.880070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:30.932912 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cd374865df4bfca5328af93dee89eb', 'request_id': 'req-31589d1e-53cf-40a0-860a-6559d4c6ef81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.939192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cd374865df4bfca5328af93dee89eb', 'request_id': 'req-31589d1e-53cf-40a0-860a-6559d4c6ef81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.947274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cd374865df4bfca5328af93dee89eb', 'request_id': 'req-31589d1e-53cf-40a0-860a-6559d4c6ef81'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.964641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] The token cache is being invalidate because project 76cd374865df4bfca5328af93dee89eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:30.965102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.965806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-31589d1e-53cf-40a0-860a-6559d4c6ef81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:30.967778 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4149/8326] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:30 2021] DELETE /identity/v3/projects/76cd374865df4bfca5328af93dee89eb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:30.973746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:30.974286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:30.974596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:30.992966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:30.994311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:31.066160 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4178/8327] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:31.075041 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.075427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.075830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.098916 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:31.100454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:31.109994 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4150/8328] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:31.115869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.125927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae58da-8c56-46c1-b6d8-7ff60f8dcd6d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.132327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.133056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.133313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.133576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.134319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:31.134624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.136664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.149986 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4179/8329] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:31.154664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.165456 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085174-e39d-4f46-8386-419e65c19be4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.173395 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.174266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.174551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.174820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.175806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.178976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.209806 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4151/8330] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:31 2021] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:31.214121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.224974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeca88-5239-4540-ac7d-56ba677926e9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.282867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.283544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.283884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.284247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.285418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.287230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.309432 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4180/8331] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:31 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:31.313793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.325152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566282-d6b1-409b-b77d-2bad9cdf8d2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.330968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.331641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.331926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.332203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.333000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.334610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.348466 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4152/8332] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:31.349910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.360063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09718152-b2e0-4ed6-a620-c89ea97033e1 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.365762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.366554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.367029 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.367311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.368052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.369695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f248d7-e645-4aba-9e50-0b17817197bb admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.381440 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4181/8333] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:31.386118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.396383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf495-35b6-49ed-879c-f47608066f2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.402162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.403141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.403483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.403795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] PATH_INFO: `/v3/projects/bcf26cf8350845fa91d1839425f258c1/users/b60b9a8345b940259e7173693a956516/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.421701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf26cf8350845fa91d1839425f258c1, user_id=b60b9a8345b940259e7173693a956516, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.424424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.438855 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4153/8334] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:31 2021] PUT /identity/v3/projects/bcf26cf8350845fa91d1839425f258c1/users/b60b9a8345b940259e7173693a956516/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:31.445162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.445543 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.445892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.463972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:31.465245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:31.523004 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4182/8335] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:31.532954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:31.534617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:31.591260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9dac-36fe-4b56-b52d-701930c0b2a8 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:31.594914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:31.595548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:31.595826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:31.596097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:31.605446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:31.606856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2169bf-9d9d-4518-872d-9077dd776189 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:31.616701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4154/8336] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:33.498740 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:33.500232 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:33.513566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b285-0726-4a91-b03b-386052f1fda7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:33.519565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:33.521094 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:33.521376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:33.521646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] PATH_INFO: `/v3/users/ba3fd7c1194445508e397cfce2a32096` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:33.522895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3fd7c1194445508e397cfce2a32096)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:33.524962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:33.572896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3fd7c1194445508e397cfce2a32096'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:33.581169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3fd7c1194445508e397cfce2a32096'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:33.581961 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3fd7c1194445508e397cfce2a32096'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:33.596969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3fd7c1194445508e397cfce2a32096'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:33.606166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3fd7c1194445508e397cfce2a32096'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:33.613781 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4183/8337] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:33 2021] DELETE /identity/v3/users/ba3fd7c1194445508e397cfce2a32096 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:33.618539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:33.619145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:33.619457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:33.648685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:33.650161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:33.773257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4155/8338] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:33.784290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:33.786044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:33.905487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc474fc-f42b-41b5-957d-9bcdfc390d5c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:33.911374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:33.912035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:33.912315 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:33.912589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:33.923705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:33.925446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e5b-b8ba-494a-a198-e66268724b53 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:33.939915 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4184/8339] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:34.277825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.279751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:34.307197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517854-a790-4651-82a7-6a05bd087b9a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.312303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.313325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.313839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.314267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] PATH_INFO: `/v3/projects/8d6a4f5c910c47a78a079f3112b9b520` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.315807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6a4f5c910c47a78a079f3112b9b520)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.318381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.409502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6a4f5c910c47a78a079f3112b9b520', 'request_id': 'req-68b81059-b82d-4861-aadb-b117b75b36eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:34.419630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6a4f5c910c47a78a079f3112b9b520', 'request_id': 'req-68b81059-b82d-4861-aadb-b117b75b36eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:34.430376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6a4f5c910c47a78a079f3112b9b520', 'request_id': 'req-68b81059-b82d-4861-aadb-b117b75b36eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:34.456248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] The token cache is being invalidate because project 8d6a4f5c910c47a78a079f3112b9b520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:34.457794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:34.458629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-68b81059-b82d-4861-aadb-b117b75b36eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:34.462701 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4156/8340] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:34 2021] DELETE /identity/v3/projects/8d6a4f5c910c47a78a079f3112b9b520 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:34.471491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.471780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.472062 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.493413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:34.494792 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:34.562463 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4185/8341] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:34.570589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.571237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.571515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.595123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:34.596382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:34.607502 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4157/8342] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:34.612255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.632281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946521-ca7e-4cfb-b594-3ad54d337fb1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.638343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.639947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.640423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.640906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.641817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:34.642284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.644874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.672029 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4186/8343] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:34.674426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.686843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87664db7-c13b-4a58-8698-eacf1207d874 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.691917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.692680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.692971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.693244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.694069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.696265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.724494 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4158/8344] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:34 2021] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:34.728935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.742816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d55726-b288-49d3-a98f-47421f16b45f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.806134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.806810 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.807177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.807454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.808322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.811087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.842681 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4187/8345] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:34 2021] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:34.847437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.861866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787b7de-218c-448e-8e7f-a9d29ffb3599 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.869694 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.870645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.871307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.871818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.872699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.874348 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.888148 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4159/8346] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:34.892437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.905465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485970e3-bdcb-4e35-ac9b-c0af0ca4e26c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.914768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.915544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.915889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.916168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.917385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.919826 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce2e4a-b608-484e-95a9-c4d798bd0927 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:34.932877 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4188/8347] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:34.936982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:34.948443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f77693-b7db-45c1-902e-c112c5f28cde admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:34.955231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:34.956130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:34.956408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:34.956724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] PATH_INFO: `/v3/projects/df94cc43bcf34df381226e883347dd40/users/a617cbb1b2e74e1b990689a3c5e774fb/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:34.979752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df94cc43bcf34df381226e883347dd40, user_id=a617cbb1b2e74e1b990689a3c5e774fb, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:34.983796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.014343 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4160/8348] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:34 2021] PUT /identity/v3/projects/df94cc43bcf34df381226e883347dd40/users/a617cbb1b2e74e1b990689a3c5e774fb/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:35.018152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.018737 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.019162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.056591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] MFA Rules not processed for user `a617cbb1b2e74e1b990689a3c5e774fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:35.057920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:35.175631 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4189/8349] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:35.180534 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.278846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac271d-88cc-4b61-9330-e7e6804d24f4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.284584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.285957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.286393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.287413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.288159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.290535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.327818 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4161/8350] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:35.328398 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.348736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b520-73f2-4158-a72b-14e23ac5b175 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.437193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.438081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.438554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.438919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.439727 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.443073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.500069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4190/8351] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:35.501960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.518557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1058d-095e-475c-934c-85249dbeb8c5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.526945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.527843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.528241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.528640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.529727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.531590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.555249 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4162/8352] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:35 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:35.556569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.572936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14f6fa-d42f-449c-8ec6-89987fc0c3d8 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.578386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.579549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.579918 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.580418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.581433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.584095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1b771-b2d6-49c8-b0bc-7a66f7775413 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.596155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4191/8353] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:35 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:35.600723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.611189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624374e-f7bc-4521-984a-438bbd0c01fd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.620660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.621586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.621857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.622124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] PATH_INFO: `/v3/projects/384ef032eba04e789aa0197f0cfec3dc/users/b6c5091b78344a4197e3b51219403e8e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.641649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384ef032eba04e789aa0197f0cfec3dc, user_id=b6c5091b78344a4197e3b51219403e8e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.644780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.661077 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4163/8354] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:35 2021] PUT /identity/v3/projects/384ef032eba04e789aa0197f0cfec3dc/users/b6c5091b78344a4197e3b51219403e8e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:35.672134 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.672416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.672787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.712193 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] MFA Rules not processed for user `b6c5091b78344a4197e3b51219403e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:35.713797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:35.807783 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4192/8355] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:35.812261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.909370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0eb02-f392-43dc-8c31-1c38e0e53555 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:35.914811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:35.915471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:35.915747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:35.916017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:35.916759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:35.918661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:35.950612 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4164/8356] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:35.954920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:35.966913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8b5fa-3a58-4a44-ab5f-85c81f322d70 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.037328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.038151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.038509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.038853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.039803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.042033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.064672 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4193/8357] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:35 2021] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:36.068531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.079273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239bac3-931a-412e-a07c-785b14369815 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.084795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.085479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.085761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.086040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.086788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.088420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.101714 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4165/8358] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:36.105888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.118004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c569c-5676-416b-84a2-8c3a9354280f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.124848 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.125711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.125991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.126269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] PATH_INFO: `/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3/users/e00cf75299ba4313928024457d9b9d1a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.147995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aa64f2fcb846d2a08bb8fedeb658a3, user_id=e00cf75299ba4313928024457d9b9d1a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.150721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.171271 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4194/8359] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:36 2021] PUT /identity/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3/users/e00cf75299ba4313928024457d9b9d1a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:36.175234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.187880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a4418-a73a-4797-b0c9-398a210a7ccc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.254943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.255781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.256220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.256596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.257526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.259230 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87fd5b-665f-4a1b-b40d-343d1ed3dc68 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.271255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4166/8360] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:36 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:36.275535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.298969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903ed5-d334-4955-b1f8-dd426932e827 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.307895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.308836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.309116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.309939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] PATH_INFO: `/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3/users/e00cf75299ba4313928024457d9b9d1a/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.312813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aa64f2fcb846d2a08bb8fedeb658a3, user_id=e00cf75299ba4313928024457d9b9d1a, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.317191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616fa99-bf4c-43fe-957d-f66648b5396b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.332033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4195/8361] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:36 2021] PUT /identity/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3/users/e00cf75299ba4313928024457d9b9d1a/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:36.342866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.343176 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.343461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.392733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] MFA Rules not processed for user `e00cf75299ba4313928024457d9b9d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:36.394025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:36.492810 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4167/8362] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:36 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:36.496300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.496880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.497560 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.504875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.506795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:36.530541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] MFA Rules not processed for user `b60b9a8345b940259e7173693a956516`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:36.532074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:36.591386 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97e50-b34f-4b8b-a9bf-ebf5a04628be None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.601510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.602198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.602478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.602776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.605607 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4196/8363] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:36.610245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.611630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:36.658034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.659629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.669438 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4168/8364] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:36 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:36.675530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf4ab3-41de-46f9-b46f-2a6893d0586e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.680192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.680942 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.681245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.681499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.682352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.684343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.711232 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4197/8365] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:36 2021] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:36.715511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.726437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684bdd-6ae0-4f0d-b903-25f8e78e873f service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.782884 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.783637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.783923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.784198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.784957 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.786926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.812593 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4169/8366] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:36 2021] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:36.817217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.827623 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5939-f93b-4091-a83a-f4a0751e40fa admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.834383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.835107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.835325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.835596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.836332 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.838098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.849610 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4198/8367] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:36.853724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.864858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f1d9-1310-4665-b82d-b010e5e55b34 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.869566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.870565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.870840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.871143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] PATH_INFO: `/v3/projects/81710f059d9d4e9cbe3b51402f9b1461/users/f7abb914b1b4488c84666ef4db3e2f15/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.885764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81710f059d9d4e9cbe3b51402f9b1461, user_id=f7abb914b1b4488c84666ef4db3e2f15, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.888367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.902189 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4170/8368] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:36 2021] PUT /identity/v3/projects/81710f059d9d4e9cbe3b51402f9b1461/users/f7abb914b1b4488c84666ef4db3e2f15/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:36.906065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:36.916985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9847c-7267-40b9-9417-aba6dd5234ef admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:36.978820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:36.979491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:36.979772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:36.980053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:36.981030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:36.982735 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:36.993675 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4199/8369] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:36 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:36.997790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:37.010520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920fd6-5cec-48d2-a592-9979684ccbe7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:37.016340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:37.017339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:37.017559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:37.017835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] PATH_INFO: `/v3/projects/81710f059d9d4e9cbe3b51402f9b1461/users/f7abb914b1b4488c84666ef4db3e2f15/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:37.020464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81710f059d9d4e9cbe3b51402f9b1461, user_id=f7abb914b1b4488c84666ef4db3e2f15, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:37.023423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b8fe4-a1d9-47cb-8276-b82766dc0dd1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:37.034388 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4171/8370] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:36 2021] PUT /identity/v3/projects/81710f059d9d4e9cbe3b51402f9b1461/users/f7abb914b1b4488c84666ef4db3e2f15/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:39.087172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:39.089234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:39.190307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c17a90-d1b7-4d6f-ac5d-88b0717addf2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:39.298891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:39.302511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:39.304017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:39.304594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:39.430093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:39.432085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:39.462891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4200/8371] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:39 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:42.613061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:42.616594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:42.616947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:42.681859 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] MFA Rules not processed for user `f7abb914b1b4488c84666ef4db3e2f15`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:42.683398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:42.832840 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4172/8372] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:42 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:42.845596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:42.848648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:43.065631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0cd2-8265-4429-a8c4-361093e5fe30 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:43.075530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:43.076262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:43.076480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:43.076801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:43.112637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:43.115907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:43.133293 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4201/8373] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:42 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:43.518411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:43.519966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:43.642698 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353da7d1-fd6a-413f-b719-7e7625f27e0e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:43.668296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:43.669257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:43.669692 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:43.670732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:43.676906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:43.705849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:43.707898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046afd7-1d5d-4493-9846-0624f5a0e5ae service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:43.742001 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4173/8374] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:44.280097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:44.281634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:44.299003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2bfb-0aba-4500-bf41-bd1e2e9264a1 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:44.311339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:44.311896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:44.312180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:44.312492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:44.317488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:44.339898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:44.342005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e813-e763-4430-8ca7-be29cccd5574 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:44.371868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4202/8375] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:45.574927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:45.575458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:45.575458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:45.601581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] MFA Rules not processed for user `a617cbb1b2e74e1b990689a3c5e774fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:45.605907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:45.701616 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4174/8376] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:45 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:52.702567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:52.703390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:52.703816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:52.739563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:52.741457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:52.843307 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4203/8377] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:53.369198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:53.397026 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d63a7-de68-41af-bb05-7ec1000aea2f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:53.401572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:53.402633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:53.403062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:53.403481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:53.405661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:53.421934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:53.431157 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:53.450455 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4175/8378] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:56.406874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:56.597832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d106333-be4e-40e9-858c-1da82aee3778 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:56.604470 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:56.605818 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:56.606275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:56.606706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] PATH_INFO: `/v3/users/b60b9a8345b940259e7173693a956516` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:56.608181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60b9a8345b940259e7173693a956516)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:56.610348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:56.689449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60b9a8345b940259e7173693a956516'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:56.699474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60b9a8345b940259e7173693a956516'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:56.700539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60b9a8345b940259e7173693a956516'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:56.715512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60b9a8345b940259e7173693a956516'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:56.723120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60b9a8345b940259e7173693a956516'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:56.729325 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4204/8379] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:56 2021] DELETE /identity/v3/users/b60b9a8345b940259e7173693a956516 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:56.937582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:56.954309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ea79-78cb-4b46-9bf7-eefa057b283c service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:57.020729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:57.021910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:57.022257 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:57.022600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] PATH_INFO: `/v3/projects/bcf26cf8350845fa91d1839425f258c1` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:57.025352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf26cf8350845fa91d1839425f258c1)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:57.027408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:57.088949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf26cf8350845fa91d1839425f258c1', 'request_id': 'req-388063fb-e02d-4b32-8ec1-0ece257feec4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.097530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf26cf8350845fa91d1839425f258c1', 'request_id': 'req-388063fb-e02d-4b32-8ec1-0ece257feec4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.107091 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf26cf8350845fa91d1839425f258c1', 'request_id': 'req-388063fb-e02d-4b32-8ec1-0ece257feec4'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.126357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] The token cache is being invalidate because project bcf26cf8350845fa91d1839425f258c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:57.126729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.127592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.130179 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4176/8380] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:56 2021] DELETE /identity/v3/projects/bcf26cf8350845fa91d1839425f258c1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:57.133816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:57.135547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:57.153771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b15e-bde4-405e-ab7a-68b6738a7e7c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:57.252999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:57.254337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:57.254633 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:57.255061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] PATH_INFO: `/v3/users/f7abb914b1b4488c84666ef4db3e2f15` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:57.256634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7abb914b1b4488c84666ef4db3e2f15)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:57.258760 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:57.351325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7abb914b1b4488c84666ef4db3e2f15'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.360360 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7abb914b1b4488c84666ef4db3e2f15'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.361467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7abb914b1b4488c84666ef4db3e2f15'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.389987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7abb914b1b4488c84666ef4db3e2f15'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.402249 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-457a19ff-285c-424d-b099-83a0ef50e651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7abb914b1b4488c84666ef4db3e2f15'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.418221 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4205/8381] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:27:57 2021] DELETE /identity/v3/users/f7abb914b1b4488c84666ef4db3e2f15 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:57.710825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:57.712463 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:57.735854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388063fb-e02d-4b32-8ec1-0ece257feec4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:57.798941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:57.799793 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:57.800102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:57.800390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] PATH_INFO: `/v3/projects/81710f059d9d4e9cbe3b51402f9b1461` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:57.801651 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81710f059d9d4e9cbe3b51402f9b1461)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:57.803552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:57.851910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81710f059d9d4e9cbe3b51402f9b1461', 'request_id': 'req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.857795 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81710f059d9d4e9cbe3b51402f9b1461', 'request_id': 'req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.866306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81710f059d9d4e9cbe3b51402f9b1461', 'request_id': 'req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.883476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] The token cache is being invalidate because project 81710f059d9d4e9cbe3b51402f9b1461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:27:57.883813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.884480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-603540dd-37f3-45a6-bd63-d9eeba4f3a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:27:57.886496 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4177/8382] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:27:57 2021] DELETE /identity/v3/projects/81710f059d9d4e9cbe3b51402f9b1461 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:27:57.892399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:57.892814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:57.893091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:57.911657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:57.912868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:57.972104 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4206/8383] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:57.979655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:57.980109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:57.980235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:57.998212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:57.999397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:58.008103 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4178/8384] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:58.012126 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.023035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560066-b9fb-496a-b660-537db3f984a7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.030389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.031051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.031327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.031593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.032324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:27:58.032647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.034236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.045766 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4207/8385] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:27:58.050282 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.059983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0818-857e-4691-8fde-98af87884c2d None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.064951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.065610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.066394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.066685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.067381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.069341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.095927 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4179/8386] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:58.100006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.110031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676a2c-7852-4be8-b48c-af37b3179ac2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.164924 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.165742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.165883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.166144 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.166827 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.168817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.188968 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4208/8387] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:58.193819 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.204418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a31fd5-6d56-4929-bf39-e6bc1f90a27f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.209090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.209743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.210017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.210283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.211004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.212562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.223256 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4180/8388] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:58.227167 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.237231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50122c9-2ff8-4064-8d12-3859a9789176 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.242415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.243278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.243558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.243948 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.244712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.246395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d279-fe80-49ae-b28e-168bf594c478 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.257148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4209/8389] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:58.261341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.271551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dea7a-920b-4386-a717-01909cce2c44 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.276311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.277317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.277665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.278037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] PATH_INFO: `/v3/projects/8eaca4756c864f17bdf2e0b388c2ffca/users/48ed644cf0644a6685d7d8b73f15a5f0/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.293972 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eaca4756c864f17bdf2e0b388c2ffca, user_id=48ed644cf0644a6685d7d8b73f15a5f0, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.296688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.309708 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4181/8390] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:58 2021] PUT /identity/v3/projects/8eaca4756c864f17bdf2e0b388c2ffca/users/48ed644cf0644a6685d7d8b73f15a5f0/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:58.323547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.323951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.324359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.350689 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] MFA Rules not processed for user `48ed644cf0644a6685d7d8b73f15a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:58.351893 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:58.412904 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4210/8391] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:58.417402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.478758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5089102-2ce5-4154-8e1d-ad97ff0fdfba admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.484010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.484734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.485013 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.485285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.486010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.488546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.516191 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4182/8392] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:27:58.517880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.529145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0d2a-54a6-4ba1-af1d-eadc2d753fe7 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.597530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.598199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.598477 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.598752 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.599446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.601381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.620827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4211/8393] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:27:58.624846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.635755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8da6-6078-4b55-a8b1-65e5145e0320 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.640447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.641271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.641552 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.641825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.642556 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.644163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.654584 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4183/8394] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:27:58.658705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.674542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab304f-37fc-42ac-abca-bd51ab8c5b9f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.679795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.680698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.680999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.681273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] PATH_INFO: `/v3/projects/0e6bcb66707f4785a90a07cbeeda425b/users/f3e0aa3a04c743fe84a413b802dc9b28/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.695316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6bcb66707f4785a90a07cbeeda425b, user_id=f3e0aa3a04c743fe84a413b802dc9b28, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.697939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.711106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4212/8395] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:58 2021] PUT /identity/v3/projects/0e6bcb66707f4785a90a07cbeeda425b/users/f3e0aa3a04c743fe84a413b802dc9b28/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:58.715093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.725506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874583-35fc-4fe7-8a6f-261fc97e501a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.781820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.782474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.782753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.783022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.783748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.785014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.785858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.786710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:58.795941 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4184/8396] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:27:58.799887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.810903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57df23-58ef-4071-9ded-c9ec21089dd4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.816486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.817454 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.817797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.819381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] PATH_INFO: `/v3/projects/0e6bcb66707f4785a90a07cbeeda425b/users/f3e0aa3a04c743fe84a413b802dc9b28/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.820685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6bcb66707f4785a90a07cbeeda425b, user_id=f3e0aa3a04c743fe84a413b802dc9b28, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:58.823448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f30b2-b94d-4a21-8fec-13099b3807cf admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:58.835392 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4185/8397] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:27:58 2021] PUT /identity/v3/projects/0e6bcb66707f4785a90a07cbeeda425b/users/f3e0aa3a04c743fe84a413b802dc9b28/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:27:58.845525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.845802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.846074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.868262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a34-5fc1-4e4b-b15d-7316b1da49a7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:58.875577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] MFA Rules not processed for user `f3e0aa3a04c743fe84a413b802dc9b28`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:27:58.876929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:58.923351 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:58.924303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:58.925112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:58.925397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:58.927569 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:58.955873 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4186/8398] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:27:58 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:27:58.979907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:27:58.981336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:27:59.003707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:59.005229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:59.018656 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4213/8399] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:27:59.053536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3d237-19e8-4ff1-a1e0-1abdc4ba24df None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:27:59.058967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:27:59.059596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:27:59.059877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:27:59.060141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:27:59.114036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:27:59.115788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:27:59.124687 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4187/8400] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:27:58 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:00.051513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:00.053179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:00.067431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61253835-d112-4821-8149-3c233e10e99d service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:00.071595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:00.072394 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:00.073077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:00.073514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:00.075347 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:00.092486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:00.094322 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:00.109911 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4214/8401] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:02.803394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:02.822255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68426-d721-49db-8e0c-967a01481476 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:02.831382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:02.831983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:02.832265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:02.832536 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:02.843367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:02.845743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939992f-7d4e-4951-bc34-6ffe3bf64921 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:02.858180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4188/8402] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:02 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:28:05.562702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:05.581879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f7c6-2b82-4e8f-80f5-95baf958f425 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:05.585892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:05.586532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:05.586815 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:05.587137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:05.588971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:05.605343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:05.607009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:05.618924 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4215/8403] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:05 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:06.223167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:06.223688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:06.223688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:06.250707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] MFA Rules not processed for user `48ed644cf0644a6685d7d8b73f15a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:28:06.251948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:06.259852 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4189/8404] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:28:06 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:28:07.302816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:07.310475 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:07.312903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:07.320745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc84e-5c3b-40e3-9b79-28f9893143f9 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:07.328814 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:07.329984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:07.330493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:07.331024 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:07.333303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:07.403781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:07.405455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:07.425602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf375a8-8812-4b1e-a863-fa945fe61bc1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:07.427676 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4216/8405] 10.222.0.13 () {60 vars in 1396 bytes} [Wed Nov 10 04:28:07 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:07.434003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:07.435244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:07.435691 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:07.436243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:07.438385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:07.459305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:07.461646 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:07.477461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4190/8406] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:07 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:28:09.760911 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:09.762109 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:09.804366 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e6da6-01e7-4a3a-8087-290151dcdb0a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:09.822878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:09.824902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:09.826129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:09.826639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:09.828868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:09.849311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:09.851080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:09.866533 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4217/8407] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:17.342539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:17.357724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755361ba-b09d-46cb-9eff-7250f17aba4f service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:17.363102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:17.363762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:17.364042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:17.364309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:17.366090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:17.381238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:17.382907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f67e9-9c51-4551-b413-826d4b5105f3 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:17.397105 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4191/8408] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:17.496120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:17.511141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078df56d-305b-4723-9bde-1636aad1e092 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:17.515793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:17.516650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:17.516938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:17.517401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:17.520217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:17.534374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:17.535854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:17.546509 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4218/8409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:40.467071 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:40.467685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:40.467685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:40.499659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] MFA Rules not processed for user `a617cbb1b2e74e1b990689a3c5e774fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:28:40.501173 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:40.575536 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4192/8410] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:28:40 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:28:55.904336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:55.906000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:55.927842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0acd2b-1a1a-4759-9fdf-7f9454b829b1 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:55.933960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:55.934702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:55.935092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:55.935387 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:55.937294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:55.953147 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:55.955222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64c16-80fc-4c80-bf52-71bc9d976416 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:55.969932 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4219/8411] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:56.194515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:56.226153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44605ca-80e4-46ba-ad36-838951a51ec6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:56.240319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:56.241574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:56.242001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:56.242482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:56.249693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:56.308641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:56.312016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66003f-9e9c-4150-9b6c-ac11b603403b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:56.342275 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4193/8412] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:28:56.464101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b174-9f1b-4bdc-a82e-55518ea42dd1 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:56.464801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b174-9f1b-4bdc-a82e-55518ea42dd1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:56.465291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b174-9f1b-4bdc-a82e-55518ea42dd1 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:56.468190 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4220/8413] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:28:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:28:56.475735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:56.476371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:56.476840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:56.559918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:28:56.561704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:28:56.574227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4194/8414] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:28:56 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:28:56.634317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b174-9f1b-4bdc-a82e-55518ea42dd1 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:28:56.654868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b174-9f1b-4bdc-a82e-55518ea42dd1 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:28:56.663363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:28:56.664197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:28:56.664819 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:28:56.665218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:28:56.677181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:28:56.679195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:28:56.691814 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4221/8415] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:28:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:29:01.763700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:01.789497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd18c4-e2f5-4e91-9520-5c3edcea56a4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:01.795788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:01.796541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:01.797006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:01.797529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:01.801516 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:01.821037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:01.823226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e8bf-318e-4aba-b963-c22e616c6eef service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:01.840112 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4195/8416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:29:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:29:06.926867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:06.928291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:07.012767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d774-c85a-4376-be9d-9ab92e284e20 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:07.017409 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:07.018293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:07.018564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:07.018832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] PATH_INFO: `/v3/users/a617cbb1b2e74e1b990689a3c5e774fb` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:07.020037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a617cbb1b2e74e1b990689a3c5e774fb)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:07.021956 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:07.067622 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a617cbb1b2e74e1b990689a3c5e774fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.074139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a617cbb1b2e74e1b990689a3c5e774fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.074789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a617cbb1b2e74e1b990689a3c5e774fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.086558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a617cbb1b2e74e1b990689a3c5e774fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.093944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a617cbb1b2e74e1b990689a3c5e774fb'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.100476 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4222/8417] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:29:06 2021] DELETE /identity/v3/users/a617cbb1b2e74e1b990689a3c5e774fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:07.105045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:07.105548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:07.105657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:07.132711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:29:07.133923 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:07.189602 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4196/8418] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:29:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:29:07.199317 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:07.200729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:07.258173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e203e9-d5da-4b28-9f37-a425fd12b8df admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:07.261820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:07.262454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:07.262732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:07.263051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:07.271959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:07.273407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:07.282569 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4223/8419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:29:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:29:07.475163 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:07.476670 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:07.488633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00451cda-7ddd-4e27-bf96-ad514b7ca76f None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:07.493492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:07.494296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:07.494574 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:07.495051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] PATH_INFO: `/v3/projects/df94cc43bcf34df381226e883347dd40` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:07.496269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df94cc43bcf34df381226e883347dd40)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:07.498218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:07.549376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df94cc43bcf34df381226e883347dd40', 'request_id': 'req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.555144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df94cc43bcf34df381226e883347dd40', 'request_id': 'req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.561497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df94cc43bcf34df381226e883347dd40', 'request_id': 'req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.573595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] The token cache is being invalidate because project df94cc43bcf34df381226e883347dd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:29:07.573876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.574511 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.576033 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4197/8420] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:29:07 2021] DELETE /identity/v3/projects/df94cc43bcf34df381226e883347dd40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:07.580757 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:07.590337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad7ae-69cb-4247-b5fd-277015edce87 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:07.644008 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:07.644894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:07.645169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:07.645443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] PATH_INFO: `/v3/users/b6c5091b78344a4197e3b51219403e8e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:07.646631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c5091b78344a4197e3b51219403e8e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:07.648507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:07.691847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c5091b78344a4197e3b51219403e8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.698284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c5091b78344a4197e3b51219403e8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.698929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c5091b78344a4197e3b51219403e8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.710854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c5091b78344a4197e3b51219403e8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.718015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c5091b78344a4197e3b51219403e8e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:07.724333 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4224/8421] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:29:07 2021] DELETE /identity/v3/users/b6c5091b78344a4197e3b51219403e8e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:07.992909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:07.994327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:08.007855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea61b-f0b3-48cb-9533-eea11f3c6ba7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:08.062915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:08.063766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:08.064047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:08.064322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] PATH_INFO: `/v3/projects/384ef032eba04e789aa0197f0cfec3dc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:08.066053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384ef032eba04e789aa0197f0cfec3dc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:08.067938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:08.117128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384ef032eba04e789aa0197f0cfec3dc', 'request_id': 'req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.122196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384ef032eba04e789aa0197f0cfec3dc', 'request_id': 'req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.128088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384ef032eba04e789aa0197f0cfec3dc', 'request_id': 'req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.139816 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] The token cache is being invalidate because project 384ef032eba04e789aa0197f0cfec3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:29:08.140215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.140904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.142483 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4198/8422] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:29:07 2021] DELETE /identity/v3/projects/384ef032eba04e789aa0197f0cfec3dc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:08.146636 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:08.148042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:08.161141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ce18-a055-43a2-8dc4-bd25d997eae6 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:08.215141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:08.216001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:08.216279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:08.216558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] PATH_INFO: `/v3/users/e00cf75299ba4313928024457d9b9d1a` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:08.217778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00cf75299ba4313928024457d9b9d1a)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:08.219673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:08.266219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00cf75299ba4313928024457d9b9d1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.273554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00cf75299ba4313928024457d9b9d1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.274367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00cf75299ba4313928024457d9b9d1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.286385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00cf75299ba4313928024457d9b9d1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.293595 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7cf989db-0203-4853-ac95-9b097b21e48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00cf75299ba4313928024457d9b9d1a'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.299755 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4225/8423] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:29:08 2021] DELETE /identity/v3/users/e00cf75299ba4313928024457d9b9d1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:08.468379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:08.469832 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:08.483061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87ff1-e269-4dc1-a2af-87ce0c01d388 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:08.538218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:08.539067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:08.539352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:08.539629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] PATH_INFO: `/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:08.540852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21aa64f2fcb846d2a08bb8fedeb658a3)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:08.542735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:08.590051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21aa64f2fcb846d2a08bb8fedeb658a3', 'request_id': 'req-664dfd1d-f3b6-4a90-9247-515afb360a8d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.595292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21aa64f2fcb846d2a08bb8fedeb658a3', 'request_id': 'req-664dfd1d-f3b6-4a90-9247-515afb360a8d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.601756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21aa64f2fcb846d2a08bb8fedeb658a3', 'request_id': 'req-664dfd1d-f3b6-4a90-9247-515afb360a8d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.614458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] The token cache is being invalidate because project 21aa64f2fcb846d2a08bb8fedeb658a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:29:08.614732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.615362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:29:08.617043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4199/8424] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:29:08 2021] DELETE /identity/v3/projects/21aa64f2fcb846d2a08bb8fedeb658a3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:29:53.658065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd0a2-4d77-4ec0-8c76-fedc1bc79139 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:53.658576 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd0a2-4d77-4ec0-8c76-fedc1bc79139 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:53.658784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd0a2-4d77-4ec0-8c76-fedc1bc79139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:53.677101 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-244fd0a2-4d77-4ec0-8c76-fedc1bc79139 None None] MFA Rules not processed for user `0ab02363def54c2baaf0c83f5377e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:29:53.678340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-244fd0a2-4d77-4ec0-8c76-fedc1bc79139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:53.748379 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4226/8425] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:29:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:29:54.091716 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:29:54.093272 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:54.151334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dfd1d-f3b6-4a90-9247-515afb360a8d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:29:54.154949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:29:54.155807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:54.156087 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:54.156359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:54.158179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:54.170839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:29:54.172277 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:29:54.183310 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4200/8426] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:29:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:29:59.276694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:29:59.277158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:29:59.277274 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:29:59.295011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] MFA Rules not processed for user `48ed644cf0644a6685d7d8b73f15a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:29:59.296210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:29:59.354497 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4227/8427] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:29:59 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:30:20.051658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:30:20.053113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:20.137564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579ce1-bff2-4c7c-a13c-d82dff7f092a service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:30:20.142603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:30:20.143238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:20.143529 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:20.143828 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:20.146167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:20.160662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:30:20.162261 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:30:20.175312 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4201/8428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:30:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:30:31.379609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:30:31.381112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:31.401552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ddbe-19e0-4306-9768-da7cf822b3e6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:30:31.407181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:30:31.407825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:31.408110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:31.408391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:31.410338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:31.425053 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:30:31.426632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d803f3-130a-4158-96bd-5632a0fa769b service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:30:31.439005 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4228/8429] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:30:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:30:47.803210 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:30:47.804815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:47.818975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2a1a-2265-4918-ae1a-9eccb096751a service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:30:47.822521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:30:47.823160 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:47.823444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:47.823720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:47.825561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:47.840944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:30:47.842376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849abe5-4a17-4d37-8c61-e4b2e1ffb29b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:30:47.853778 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4202/8430] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:30:47 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:30:47.980511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccdab-c305-4e23-acc4-921d04407a93 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:47.981662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccdab-c305-4e23-acc4-921d04407a93 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:47.981821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccdab-c305-4e23-acc4-921d04407a93 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:47.983685 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4229/8431] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:30:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:30:47.988744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b58-2b12-4088-8372-17c33d525e40 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:47.989033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b58-2b12-4088-8372-17c33d525e40 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:47.989311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b58-2b12-4088-8372-17c33d525e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:48.016807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2d680b58-2b12-4088-8372-17c33d525e40 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:30:48.017917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2d680b58-2b12-4088-8372-17c33d525e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:30:48.029203 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4203/8432] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:30:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:30:48.049567 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ccdab-c305-4e23-acc4-921d04407a93 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:30:48.065290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ccdab-c305-4e23-acc4-921d04407a93 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:30:48.070226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:30:48.070849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:30:48.071128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:30:48.071405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:30:48.080355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:30:48.081947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:30:48.091997 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4230/8433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:30:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:32:00.798755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:00.799346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:00.799346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:00.819739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] MFA Rules not processed for user `48ed644cf0644a6685d7d8b73f15a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:32:00.822704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:00.836376 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4204/8434] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:32:00 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:32:30.945255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:30.966328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b687-cb4f-4844-a597-2e7cd0b77963 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:30.970566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:30.971137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:30.971420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:30.971696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:30.973465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:31.033424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:31.034877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:31.053727 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4231/8435] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:32:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:32:37.508203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:37.510546 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:37.526028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be37a-8d26-49b7-8ad2-5f74de0d136a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:37.530803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:37.531680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:37.531963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:37.532237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] PATH_INFO: `/v3/users/0ab02363def54c2baaf0c83f5377e46b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:37.533683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab02363def54c2baaf0c83f5377e46b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:37.535628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:37.583265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab02363def54c2baaf0c83f5377e46b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.589852 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab02363def54c2baaf0c83f5377e46b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.590515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab02363def54c2baaf0c83f5377e46b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.591116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab02363def54c2baaf0c83f5377e46b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.598014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab02363def54c2baaf0c83f5377e46b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.615452 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4205/8436] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:32:37 2021] DELETE /identity/v3/users/0ab02363def54c2baaf0c83f5377e46b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:32:37.788442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:37.800922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae696-27df-4701-939a-0fde9c149bc5 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:37.871798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:37.872660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:37.872939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:37.873206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] PATH_INFO: `/v3/projects/4be6c4098d8d4e41954d19a88075cd96` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:37.874401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be6c4098d8d4e41954d19a88075cd96)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:37.876320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:37.919628 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be6c4098d8d4e41954d19a88075cd96', 'request_id': 'req-1196b5e9-0a04-4a72-b055-372d8ad86d41'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.925509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be6c4098d8d4e41954d19a88075cd96', 'request_id': 'req-1196b5e9-0a04-4a72-b055-372d8ad86d41'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.931692 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be6c4098d8d4e41954d19a88075cd96', 'request_id': 'req-1196b5e9-0a04-4a72-b055-372d8ad86d41'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.943281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] The token cache is being invalidate because project 4be6c4098d8d4e41954d19a88075cd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:32:37.943564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.944169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:37.945699 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4232/8437] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:32:37 2021] DELETE /identity/v3/projects/4be6c4098d8d4e41954d19a88075cd96 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:32:37.949776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:37.951159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:37.966458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2c46-3271-46a4-80f2-c0e817ae96ad admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:38.023447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:38.024311 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:38.024591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:38.025339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] PATH_INFO: `/v3/users/e4efc887205a45c2bb91fe2d16ae156e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:38.026321 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4efc887205a45c2bb91fe2d16ae156e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:38.028283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:38.071519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4efc887205a45c2bb91fe2d16ae156e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.077995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4efc887205a45c2bb91fe2d16ae156e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.078666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4efc887205a45c2bb91fe2d16ae156e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.080021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4efc887205a45c2bb91fe2d16ae156e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.087067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6f59f0cd-63e4-4677-9434-c5094aada65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4efc887205a45c2bb91fe2d16ae156e'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.104372 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4206/8438] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:32:37 2021] DELETE /identity/v3/users/e4efc887205a45c2bb91fe2d16ae156e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:32:38.273210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:38.274794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:38.288859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b5e9-0a04-4a72-b055-372d8ad86d41 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:38.342885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:38.343660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:38.343940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:38.344207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] PATH_INFO: `/v3/projects/3680a125dba7419089bebecd3a577d6d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:38.345975 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3680a125dba7419089bebecd3a577d6d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:38.347847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:38.392011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3680a125dba7419089bebecd3a577d6d', 'request_id': 'req-af91b01d-fda8-44b3-adb1-627f07fd5269'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.397196 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3680a125dba7419089bebecd3a577d6d', 'request_id': 'req-af91b01d-fda8-44b3-adb1-627f07fd5269'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.403014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3680a125dba7419089bebecd3a577d6d', 'request_id': 'req-af91b01d-fda8-44b3-adb1-627f07fd5269'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.414784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] The token cache is being invalidate because project 3680a125dba7419089bebecd3a577d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:32:38.415061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.415669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-af91b01d-fda8-44b3-adb1-627f07fd5269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:32:38.417223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4233/8439] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:32:38 2021] DELETE /identity/v3/projects/3680a125dba7419089bebecd3a577d6d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:32:47.208334 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152517f-9236-42b1-8099-c684408b1279 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:47.208940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152517f-9236-42b1-8099-c684408b1279 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:47.208940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152517f-9236-42b1-8099-c684408b1279 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:47.210721 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4207/8440] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:32:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:32:47.215637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:47.216082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:47.216199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:47.233881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:32:47.234992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:47.294950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4234/8441] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:32:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:32:47.316926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152517f-9236-42b1-8099-c684408b1279 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:47.318598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3152517f-9236-42b1-8099-c684408b1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:47.337388 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152517f-9236-42b1-8099-c684408b1279 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:47.342263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:47.342880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:47.343152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:47.343421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:47.351876 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:47.353445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:47.363255 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4208/8442] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:32:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:32:58.654573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:58.656020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:58.760996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de29cd3-becf-4522-a776-7e76114cff4a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:58.766722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:58.767390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:58.767658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:58.767934 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:58.769910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:58.835399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:58.837597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:58.850503 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4235/8443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:32:58 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:32:59.072159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:32:59.073785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:59.135216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23217b6d-b7eb-4b09-ab3a-8f4572d9f2a6 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:32:59.138930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:32:59.139710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:32:59.139999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:32:59.140270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:32:59.142316 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:32:59.158731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:32:59.160187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f59c2-5ab9-4d32-bee3-4b52fea7b724 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:32:59.173985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4209/8444] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:32:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:33:06.643552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:06.655530 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f72c5-0404-4930-aaba-55e1fce35e63 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:06.659812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:06.660519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:06.660889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:06.661227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:06.663059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:06.724189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:06.725646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:06.735155 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4236/8445] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:06 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:33:09.703988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:09.704839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:09.704839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:09.722266 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] MFA Rules not processed for user `48ed644cf0644a6685d7d8b73f15a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:33:09.723486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:09.730711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4210/8446] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:33:09 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:33:09.767303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:09.769363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:09.856032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe306-cce5-425a-8723-75e3fda9869d service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:09.859835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:09.860478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:09.861075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:09.861236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:09.863545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:09.883071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:09.884907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:09.901125 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4237/8447] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:33:10.587302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:10.640096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b29a0e-adcc-4eb3-a415-6780e3587da5 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:10.667898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:10.668584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:10.668947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:10.669232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:10.672809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:10.704273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:10.706498 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:10.721571 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4211/8448] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:33:12.842441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:12.855779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5deea-dc28-4401-a76a-a7ed7204b603 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:12.860873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:12.861791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:12.862250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:12.862664 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:12.869204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:12.883861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:12.885503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:12.900896 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4238/8449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:33:13.577336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:13.593785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db37d-eec6-4468-a612-f442a7f165dd service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:13.600309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:13.601404 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:13.601911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:13.603121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:13.605990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:13.623331 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:13.625031 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:13.640013 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4212/8450] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:33:18.530492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:33:18.531941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:18.553507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32553-55e3-4f2b-945d-dc27560f0773 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:33:18.559452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:33:18.560081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:33:18.560762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:33:18.560762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:33:18.562370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:33:18.577158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:33:18.578717 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:33:18.592259 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4239/8451] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:33:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:34:42.746052 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:42.760233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1f55-6ddd-4155-9596-68e266db0f80 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:42.765865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88910-a061-4211-847e-0bff80720ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:42.766510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88910-a061-4211-847e-0bff80720ada service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:42.766786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88910-a061-4211-847e-0bff80720ada service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:42.767059 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88910-a061-4211-847e-0bff80720ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:42.768866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-12a88910-a061-4211-847e-0bff80720ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:42.785323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a88910-a061-4211-847e-0bff80720ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:42.786997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a88910-a061-4211-847e-0bff80720ada service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:42.808934 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4213/8452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:34:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:34:48.603998 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:48.605511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:48.667583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5096c9b-97ce-437f-9487-13bc55660256 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:48.672082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:48.672963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:48.673243 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:48.673515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] PATH_INFO: `/v3/users/48ed644cf0644a6685d7d8b73f15a5f0` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:48.674707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ed644cf0644a6685d7d8b73f15a5f0)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:48.676588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:48.719456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ed644cf0644a6685d7d8b73f15a5f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:48.726291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ed644cf0644a6685d7d8b73f15a5f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:48.726938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ed644cf0644a6685d7d8b73f15a5f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:48.737823 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ed644cf0644a6685d7d8b73f15a5f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:48.745396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ed644cf0644a6685d7d8b73f15a5f0'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:48.751078 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4240/8453] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:34:48 2021] DELETE /identity/v3/users/48ed644cf0644a6685d7d8b73f15a5f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:48.755739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:48.756234 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:48.756340 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:48.774558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:48.775745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:48.858182 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4214/8454] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:34:48.869185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:48.870642 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:48.936425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942dd1-2b9d-4b6b-80b5-e6433ad08492 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:48.941771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:48.942412 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:48.942687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:48.942954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:48.954066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:48.955780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:48.966633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4241/8455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:34:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:34:49.136774 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.138387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:49.150930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d19a-c182-473d-bb72-1f345484c414 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.155438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.156283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.156562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.156871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] PATH_INFO: `/v3/projects/8eaca4756c864f17bdf2e0b388c2ffca` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.158067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eaca4756c864f17bdf2e0b388c2ffca)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.159937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:49.208592 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eaca4756c864f17bdf2e0b388c2ffca', 'request_id': 'req-280ec68c-bd9b-4226-b412-6f05fc798827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.214550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eaca4756c864f17bdf2e0b388c2ffca', 'request_id': 'req-280ec68c-bd9b-4226-b412-6f05fc798827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.220554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eaca4756c864f17bdf2e0b388c2ffca', 'request_id': 'req-280ec68c-bd9b-4226-b412-6f05fc798827'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.232983 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] The token cache is being invalidate because project 8eaca4756c864f17bdf2e0b388c2ffca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:34:49.233267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.233888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.235405 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4215/8456] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:34:49 2021] DELETE /identity/v3/projects/8eaca4756c864f17bdf2e0b388c2ffca => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:49.239441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.248851 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087767-5319-41ad-baa1-3379dd84f849 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.301729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.302498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.302770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.303037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] PATH_INFO: `/v3/users/f3e0aa3a04c743fe84a413b802dc9b28` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.304270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e0aa3a04c743fe84a413b802dc9b28)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.306226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:49.349603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e0aa3a04c743fe84a413b802dc9b28'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.356791 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e0aa3a04c743fe84a413b802dc9b28'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.357438 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e0aa3a04c743fe84a413b802dc9b28'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.368565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e0aa3a04c743fe84a413b802dc9b28'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.375472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-2b0219c1-2a56-474c-8d20-aa7edd3cd992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e0aa3a04c743fe84a413b802dc9b28'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.381169 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4242/8457] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:34:49 2021] DELETE /identity/v3/users/f3e0aa3a04c743fe84a413b802dc9b28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:49.550543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.552092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:49.565631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ec68c-bd9b-4226-b412-6f05fc798827 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.621123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.621967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.622246 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.622519 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] PATH_INFO: `/v3/projects/0e6bcb66707f4785a90a07cbeeda425b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.623720 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6bcb66707f4785a90a07cbeeda425b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.625600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:49.669337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6bcb66707f4785a90a07cbeeda425b', 'request_id': 'req-95857016-a240-4a32-82fa-53dd71005500'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.674600 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6bcb66707f4785a90a07cbeeda425b', 'request_id': 'req-95857016-a240-4a32-82fa-53dd71005500'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.681318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6bcb66707f4785a90a07cbeeda425b', 'request_id': 'req-95857016-a240-4a32-82fa-53dd71005500'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.692921 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] The token cache is being invalidate because project 0e6bcb66707f4785a90a07cbeeda425b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:34:49.693206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.693812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-95857016-a240-4a32-82fa-53dd71005500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:34:49.695306 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4216/8458] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:34:49 2021] DELETE /identity/v3/projects/0e6bcb66707f4785a90a07cbeeda425b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:49.701676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.702131 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.702239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.739220 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:49.740402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:49.798037 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4243/8459] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:34:49.807550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.808023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.808023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.826928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:49.828120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:49.836227 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4217/8460] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:34:49.840389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.849834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabe569-fe3f-48af-bd4d-2400ea86c6e3 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.854439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.855077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.855349 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.855617 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.856337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:34:49.856662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.858233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:49.869923 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4244/8461] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:34:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:34:49.874085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.883830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a09f5-7c1c-4beb-92bc-67b42a265c94 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.888427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.889104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.889387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.889664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.890373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.892306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:49.925440 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4218/8462] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:34:49 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:34:49.930640 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:49.940586 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3853-3842-4a93-848f-16727d84adb0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:49.993607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:49.994260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:49.994614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:49.994995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:49.995716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:49.997655 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:50.020974 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4245/8463] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:34:49 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:34:50.025231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:50.035379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1d76-f852-4b91-9617-968edc6e5d32 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:50.040253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:50.040936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:50.041218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:50.041491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:50.042227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:50.043788 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:50.053985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4219/8464] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:34:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:34:50.057970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:50.067991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae626c13-2d31-44c5-a573-fbe7c187a671 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:50.073609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:50.074289 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:50.074593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:50.074863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:50.075590 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:50.077198 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723eb21-f015-4589-be7c-1678030fd4cd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:50.088182 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4246/8465] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:34:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:34:50.092581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:50.103158 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae1f1-0f1d-4977-9cac-73db8725cd9f admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:50.107737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:50.108596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:50.108899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:50.109167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] PATH_INFO: `/v3/projects/73b343a78d0c4ae09069280e6c0c1698/users/9bf378f2d3af4d91a0398bc9704590c4/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:50.123243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b343a78d0c4ae09069280e6c0c1698, user_id=9bf378f2d3af4d91a0398bc9704590c4, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:50.126218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:50.139447 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4220/8466] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:34:50 2021] PUT /identity/v3/projects/73b343a78d0c4ae09069280e6c0c1698/users/9bf378f2d3af4d91a0398bc9704590c4/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:50.144585 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202790da-21fb-4b98-8be6-584347676cb8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:50.144907 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202790da-21fb-4b98-8be6-584347676cb8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:50.145184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202790da-21fb-4b98-8be6-584347676cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:50.163442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-202790da-21fb-4b98-8be6-584347676cb8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:50.164644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-202790da-21fb-4b98-8be6-584347676cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:50.220996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4247/8467] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:34:50.230666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:50.232374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:50.288868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2c22-f4d7-4524-810c-9ea4d2589f92 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:50.292429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:50.293090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:50.293367 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:50.293635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:50.302259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:50.303648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:50.312870 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4221/8468] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:34:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:34:54.423437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.423899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.423993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.453756 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] MFA Rules not processed for user `9bf378f2d3af4d91a0398bc9704590c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:54.455245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:34:54.522836 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4248/8469] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:34:54.527379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.537308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb0b9-a64b-4512-ba10-d4e49395f41f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.542483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.543136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.543418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.543790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.544513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.546486 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.580491 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4222/8470] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:34:54 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:34:54.584977 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.598529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6371-e0ad-422d-9fed-5e01cdb99fd4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.658133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.658940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.659293 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.659763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.660698 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.663379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.689199 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4249/8471] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:34:54 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:34:54.693151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.705772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de92c-17f2-4b14-8477-08aaaaa2d6cd admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.711408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.712078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.712359 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.712742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.713411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.715093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.728758 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4223/8472] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:34:54.732651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.743114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afc3af-00b5-4b91-8bc0-1fec1d3a4046 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.750252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.751160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.751439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.751883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] PATH_INFO: `/v3/projects/4bca763c225b4fea8666ea9b62bc5f47/users/5c138b8103e343bd9e5684ae972cf505/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.770797 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bca763c225b4fea8666ea9b62bc5f47, user_id=5c138b8103e343bd9e5684ae972cf505, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.774739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.790423 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4250/8473] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:34:54 2021] PUT /identity/v3/projects/4bca763c225b4fea8666ea9b62bc5f47/users/5c138b8103e343bd9e5684ae972cf505/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:54.794783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.805625 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb688-566f-4fac-bc8c-a642f140c4d9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.860947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.861631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.861906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.862175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.862896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.864462 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa53cd-dd7d-4cc1-ba6c-5e7f20f1271a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.874750 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4224/8474] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:34:54.878922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:34:54.889652 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6acfc-7d8d-418a-8897-e4b2607d1b97 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:34:54.894807 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:34:54.895845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:54.896214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:54.896559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] PATH_INFO: `/v3/projects/4bca763c225b4fea8666ea9b62bc5f47/users/5c138b8103e343bd9e5684ae972cf505/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:54.898748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bca763c225b4fea8666ea9b62bc5f47, user_id=5c138b8103e343bd9e5684ae972cf505, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:34:54.901466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:34:54.911906 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4251/8475] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:34:54 2021] PUT /identity/v3/projects/4bca763c225b4fea8666ea9b62bc5f47/users/5c138b8103e343bd9e5684ae972cf505/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:34:59.957349 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed4a59-6dcd-456b-9d85-7f129b317a1e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:34:59.958242 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed4a59-6dcd-456b-9d85-7f129b317a1e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:34:59.958714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed4a59-6dcd-456b-9d85-7f129b317a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:34:59.987869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6eed4a59-6dcd-456b-9d85-7f129b317a1e None None] MFA Rules not processed for user `5c138b8103e343bd9e5684ae972cf505`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:34:59.989115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6eed4a59-6dcd-456b-9d85-7f129b317a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:00.064746 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4225/8476] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:34:59 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:35:00.077000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:00.078912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:00.163508 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e0f5-306b-42c2-9c3b-d824af931629 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:00.169183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:00.169890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:00.170165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:00.170435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:00.227151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:00.228779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:00.238113 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4252/8477] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:00 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:35:01.813903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:01.814431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:01.814431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:01.834337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] MFA Rules not processed for user `9bf378f2d3af4d91a0398bc9704590c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:35:01.835524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:01.842646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4226/8478] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:35:01 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:35:02.163769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:02.165237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:02.231793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661837-5c84-49cb-bc86-98d4d3e1cd33 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:02.235704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:02.236407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:02.236715 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:02.236987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:02.238832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:02.252577 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:02.254150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:02.267735 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4253/8479] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:02 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:35:04.329318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:04.342707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab354f0-a15b-424d-b6dc-d67f489d3202 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:04.352642 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:04.353674 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:04.354204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:04.354490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:04.356455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:04.372731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:04.374325 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:04.387296 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4227/8480] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:04 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:35:13.522030 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:13.533645 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e971e-7d79-4fd9-8dbe-af5432afb83a service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:13.537482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:13.538270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:13.538726 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:13.539115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:13.549767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:13.551230 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:13.562253 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4254/8481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:13 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:35:28.027457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:28.029339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:28.099778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e4e8-ccc3-4e7d-8224-400d51c8bb24 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:28.105604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:28.106251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:28.106525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:28.106802 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:28.108690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:28.123036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:28.124704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:28.139188 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4228/8482] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:35:34.324878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:34.326314 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:34.343003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e331-4298-4772-af41-636580e2a3f3 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:34.347993 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:34.348598 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:34.348906 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:34.349176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:34.350880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:34.365190 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:34.366682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:34.380793 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4255/8483] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:35:49.984733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:35:49.996808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650664c-66c3-437a-80dc-41bd21ab2356 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:35:50.000353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:35:50.001019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:35:50.001300 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:35:50.001601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:35:50.003351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:35:50.015421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:35:50.016856 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:35:50.028651 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4229/8484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:35:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:39:54.639461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:39:54.660853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebf1c-a7c7-4845-ba36-fc0292331eea service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:39:54.664417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:39:54.665073 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:39:54.665348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:39:54.665618 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:39:54.667324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:39:54.726340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:39:54.727682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:39:54.741176 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4256/8485] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:39:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:39:55.946106 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:39:55.967903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5fe64-cc11-497e-9acb-479a4067bdf9 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:39:55.971503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:39:55.972149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:39:55.972430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:39:55.972733 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:39:55.974485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:39:55.990290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:39:55.991703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:39:56.005289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4230/8486] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:39:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:39:57.097950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:39:57.100105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:39:57.127165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314befc8-bb05-4abc-acea-0a4c99c3ceda service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:39:57.133159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:39:57.133806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:39:57.134080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:39:57.134363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:39:57.136338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:39:57.151995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:39:57.154665 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:39:57.185409 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4257/8487] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:39:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:39:59.017854 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:39:59.029708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e684a9-cb97-474b-9576-504b7599a4c1 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:39:59.033329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:39:59.033960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:39:59.034236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:39:59.034507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:39:59.101749 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:39:59.103204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:39:59.112547 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4231/8488] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:39:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:05.327358 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:05.339019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e7d5-7bd7-43bd-b6a5-770216893bc0 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:05.345709 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:05.346596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:05.346874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:05.347143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] PATH_INFO: `/v3/users/9bf378f2d3af4d91a0398bc9704590c4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:05.348378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf378f2d3af4d91a0398bc9704590c4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:05.350522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:05.399359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf378f2d3af4d91a0398bc9704590c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.406584 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf378f2d3af4d91a0398bc9704590c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.407242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf378f2d3af4d91a0398bc9704590c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.418500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf378f2d3af4d91a0398bc9704590c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.425847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf378f2d3af4d91a0398bc9704590c4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.431739 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4258/8489] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:40:05 2021] DELETE /identity/v3/users/9bf378f2d3af4d91a0398bc9704590c4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:05.601994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:05.614385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8320-cd3a-4130-895f-0a2065f9dccd service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:05.669122 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:05.669965 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:05.670240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:05.670538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] PATH_INFO: `/v3/projects/73b343a78d0c4ae09069280e6c0c1698` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:05.671727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b343a78d0c4ae09069280e6c0c1698)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:05.673618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:05.718337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b343a78d0c4ae09069280e6c0c1698', 'request_id': 'req-f78945c6-38fe-4dc0-97a4-56fc4a54877a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.723609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b343a78d0c4ae09069280e6c0c1698', 'request_id': 'req-f78945c6-38fe-4dc0-97a4-56fc4a54877a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.729543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b343a78d0c4ae09069280e6c0c1698', 'request_id': 'req-f78945c6-38fe-4dc0-97a4-56fc4a54877a'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.752181 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] The token cache is being invalidate because project 73b343a78d0c4ae09069280e6c0c1698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:40:05.752470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.753128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.754647 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4232/8490] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:40:05 2021] DELETE /identity/v3/projects/73b343a78d0c4ae09069280e6c0c1698 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:40:05.758798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:05.760227 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:05.773635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7668-2c62-47f2-a0bc-059463ce33ec admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:05.827710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:05.828568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:05.828879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:05.829156 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] PATH_INFO: `/v3/users/5c138b8103e343bd9e5684ae972cf505` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:05.830368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c138b8103e343bd9e5684ae972cf505)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:05.832534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:05.876520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c138b8103e343bd9e5684ae972cf505'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.882937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c138b8103e343bd9e5684ae972cf505'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.883854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c138b8103e343bd9e5684ae972cf505'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.895627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c138b8103e343bd9e5684ae972cf505'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.902609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-753c772e-cbd7-4a9b-9d62-746673731a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c138b8103e343bd9e5684ae972cf505'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:05.908411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4259/8491] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:40:05 2021] DELETE /identity/v3/users/5c138b8103e343bd9e5684ae972cf505 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:40:06.077968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:06.079402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:06.094701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78945c6-38fe-4dc0-97a4-56fc4a54877a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:06.148824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:06.149663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:06.149940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:06.150212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] PATH_INFO: `/v3/projects/4bca763c225b4fea8666ea9b62bc5f47` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:06.151376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bca763c225b4fea8666ea9b62bc5f47)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:06.153375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:06.198654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bca763c225b4fea8666ea9b62bc5f47', 'request_id': 'req-e1ec66df-fb07-4553-aef1-1e4964977ec3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:06.204531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bca763c225b4fea8666ea9b62bc5f47', 'request_id': 'req-e1ec66df-fb07-4553-aef1-1e4964977ec3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:06.210649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bca763c225b4fea8666ea9b62bc5f47', 'request_id': 'req-e1ec66df-fb07-4553-aef1-1e4964977ec3'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:06.222119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] The token cache is being invalidate because project 4bca763c225b4fea8666ea9b62bc5f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:40:06.222398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:06.223275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-e1ec66df-fb07-4553-aef1-1e4964977ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:06.225580 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4233/8492] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:40:06 2021] DELETE /identity/v3/projects/4bca763c225b4fea8666ea9b62bc5f47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:15.291003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.291573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.291573 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.327415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:15.328629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:15.385570 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4260/8493] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:15.394497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.394982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.395088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.413159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:15.414327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:15.421931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4234/8494] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:15.426425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.435899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63220fd6-c7f1-4a42-8175-f3eb86753fb8 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.440413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.441093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.441376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.441649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.442372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:40:15.442668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.444241 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.455646 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4261/8495] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:40:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:40:15.464235 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.473780 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40452cb5-57a5-454b-8045-1fcf0c5cd1e1 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.478309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.478936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.479208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.479502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.480171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.482036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.506020 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4235/8496] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:40:15.510189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.520372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e4b5-b5fb-405e-930a-5e73701090e7 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.573747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.574330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.574610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.574885 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.575711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.578169 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.602953 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4262/8497] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:40:15.604082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.614255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899359-d384-4e67-ba23-7ea785d36acb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.618869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.619520 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.620259 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.620542 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.621312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.622868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.633511 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4236/8498] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:40:15.637343 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.647730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531772fb-4014-4457-ad92-ca562ccff120 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.652353 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.653034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.653316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.653592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.654318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.655891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4d14-93b3-44f8-9fca-ddff5481ac6c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.666147 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4263/8499] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:40:15.670060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.679858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58873-d643-4ac5-af8f-ad62ff601d36 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.684405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.685299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.685576 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.685861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] PATH_INFO: `/v3/projects/2f578c1b89e941d5a7fdb1d858e95252/users/9708807ef97e46348d0f7e9ab57b17fa/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.700086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f578c1b89e941d5a7fdb1d858e95252, user_id=9708807ef97e46348d0f7e9ab57b17fa, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.703345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.715869 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4237/8500] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:40:15 2021] PUT /identity/v3/projects/2f578c1b89e941d5a7fdb1d858e95252/users/9708807ef97e46348d0f7e9ab57b17fa/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:40:15.727022 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.727330 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.727609 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.753478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] MFA Rules not processed for user `9708807ef97e46348d0f7e9ab57b17fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:15.754680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:15.816952 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4264/8501] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:15.821492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.880393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13e27e-0088-415b-a6bb-c547adb5294d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.885156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.885804 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.886088 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.886364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.887075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.888989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:15.913953 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4238/8502] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:40:15.918121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:15.928498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371e23-7130-47a8-89b2-848c50bb489c None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:15.983367 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:15.984034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:15.984483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:15.984793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:15.985498 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:15.987443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.006972 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4265/8503] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:40:15 2021] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:40:16.011035 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:16.021128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900cd9-c664-43fa-b681-53c877c3b8a9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:16.025724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:16.026375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.026684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.026958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.027688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:16.029299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.039495 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4239/8504] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:40:16.043521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:16.053643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c66b3-85ef-4f74-9262-f4fa837906bd admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:16.058306 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:16.059159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.059437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.059704 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] PATH_INFO: `/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe/users/926e76c3a013497ca3f3422a21ecaa02/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.074218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c13c758f7dc470eaa9784a2fe8fcebe, user_id=926e76c3a013497ca3f3422a21ecaa02, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:16.076933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.089068 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4266/8505] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:40:16 2021] PUT /identity/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe/users/926e76c3a013497ca3f3422a21ecaa02/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:16.092970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:16.102763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e1899-dd9f-4e6f-975c-c243448a5a79 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:16.155904 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:16.156550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.156867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.157143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.157871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:16.159439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008f54-b2eb-480d-9ae5-a426dd7bc21e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.168837 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4240/8506] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:16 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:40:16.173415 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:16.183417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15308-9f7e-4a88-9268-75ac6eb2bb99 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:16.188707 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:16.189580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.189836 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.190103 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] PATH_INFO: `/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe/users/926e76c3a013497ca3f3422a21ecaa02/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.192226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c13c758f7dc470eaa9784a2fe8fcebe, user_id=926e76c3a013497ca3f3422a21ecaa02, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:16.194811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8e910-c8a7-4759-a9ca-ce83edf910ba admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.204482 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4267/8507] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:40:16 2021] PUT /identity/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe/users/926e76c3a013497ca3f3422a21ecaa02/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:16.216346 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480c627-9558-441d-b5d3-659325181210 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.216740 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480c627-9558-441d-b5d3-659325181210 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.217152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480c627-9558-441d-b5d3-659325181210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.243628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a480c627-9558-441d-b5d3-659325181210 None None] MFA Rules not processed for user `926e76c3a013497ca3f3422a21ecaa02`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:16.245126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a480c627-9558-441d-b5d3-659325181210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:16.314870 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4241/8508] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:16 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:16.326599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.327081 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.327195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.344873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] MFA Rules not processed for user `9708807ef97e46348d0f7e9ab57b17fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:16.345985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:16.396902 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4268/8509] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:16 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:16.409421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480c627-9558-441d-b5d3-659325181210 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:16.410772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a480c627-9558-441d-b5d3-659325181210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:16.481025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480c627-9558-441d-b5d3-659325181210 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:16.487064 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:16.487690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:16.487967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:16.488237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:16.495932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:16.497572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:16.506490 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4242/8510] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:16 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:18.283627 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:18.285160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:18.355562 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a5fca-dbdb-4f24-9818-93b6b80c1cc6 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:18.360635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:18.361283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:18.361564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:18.361842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:18.363570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:18.376958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:18.378525 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:18.391140 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4269/8511] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:20.115650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:20.117104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:20.190427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e901-4fad-4da8-9093-e5489d66775f service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:20.194001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:20.194645 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:20.194930 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:20.195203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:20.197009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:20.209794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:20.211188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:20.221193 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4243/8512] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:20.893186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:20.909724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295f028-4a92-44c2-97bd-cc5bb3edb2cd service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:20.930184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:20.930855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:20.931311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:20.931938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:20.934376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:20.953497 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:20.955176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:20.971321 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4270/8513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:40:26.677662 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:26.693587 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de345-5451-4644-a2fc-3ec5c33e3677 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:26.699044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:26.699687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:26.699966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:26.700240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:26.702711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:26.718528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:26.720105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a30ab3-d9d5-4a01-ac45-5c886ab51921 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:26.733725 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4244/8514] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:28.887088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:28.888468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:28.904939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0d05-3170-4b01-bc6f-bc1122a37533 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:28.911716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:28.912354 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:28.912656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:28.912938 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:28.921052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:28.922614 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:28.932093 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4271/8515] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:28 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:28.948508 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acae2ce-1ed1-4a86-a245-fa248ae8ed2c None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:28.948998 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acae2ce-1ed1-4a86-a245-fa248ae8ed2c None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:28.949100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acae2ce-1ed1-4a86-a245-fa248ae8ed2c None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:28.950914 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4245/8516] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:40:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:40:28.956161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] Authenticating service token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:40:28.970515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:28.978503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5b5b-c3bc-4c15-b833-8bd197340b3f service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:28.983116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926e76c3a013497ca3f3422a21ecaa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c13c758f7dc470eaa9784a2fe8fcebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:28.983936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:28.984213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:28.984484 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] PATH_INFO: `/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:28.985696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: Authorizing `identity:get_project(project_id=2c13c758f7dc470eaa9784a2fe8fcebe)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:28.987435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973a3a4-1db2-4995-a56c-19cb50f2c34b tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:28.989125 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4272/8517] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:40:28 2021] GET /identity/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:40:29.132967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acae2ce-1ed1-4a86-a245-fa248ae8ed2c None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:29.146732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acae2ce-1ed1-4a86-a245-fa248ae8ed2c None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:29.150286 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:29.150911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:29.151198 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:29.151473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:29.153280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:29.164973 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:29.166606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:29.178082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4246/8518] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:29.320173 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:29.320754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:29.321035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:29.322838 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4273/8519] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 10 04:40:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:40:29.328376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] Authenticating service token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 10 04:40:29.343656 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:29.352668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f3fca-2550-4fdf-a68a-5fa8a1d717ae service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:29.357179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926e76c3a013497ca3f3422a21ecaa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c13c758f7dc470eaa9784a2fe8fcebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:29.358002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:29.358476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:29.358971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] PATH_INFO: `/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:29.360407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: Authorizing `identity:get_project(project_id=2c13c758f7dc470eaa9784a2fe8fcebe)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:29.362208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:29.363973 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4247/8520] 10.222.0.13 () {58 vars in 1443 bytes} [Wed Nov 10 04:40:29 2021] GET /identity/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe => generated 393 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:40:29.513754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:29.515365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:29.530738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d107ec6-5b7f-44f6-b19f-c8fcb14e8b09 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:29.534248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:29.534862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:29.535135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:29.535403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:29.537124 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:29.549266 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:29.550676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa9564-1497-4931-9993-a5571c11213b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:29.562137 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4274/8521] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:32.191842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:32.251123 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62a2e-3bd3-4f7d-9cbd-2e49fe1bbc90 tempest-ServersAdminNegativeTestJSON-1430030837 tempest-ServersAdminNegativeTestJSON-1430030837-project-admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:32.255591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:32.256433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:32.256743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:32.257011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] PATH_INFO: `/v3/users/9708807ef97e46348d0f7e9ab57b17fa` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:32.258189 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9708807ef97e46348d0f7e9ab57b17fa)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:32.260067 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:32.307785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9708807ef97e46348d0f7e9ab57b17fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.314623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9708807ef97e46348d0f7e9ab57b17fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.315393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9708807ef97e46348d0f7e9ab57b17fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.315988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9708807ef97e46348d0f7e9ab57b17fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.323528 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9708807ef97e46348d0f7e9ab57b17fa'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.341165 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4248/8522] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:40:32 2021] DELETE /identity/v3/users/9708807ef97e46348d0f7e9ab57b17fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:32.346416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:32.346894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:32.347253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:32.369613 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:32.370884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:32.427848 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4275/8523] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:32.437978 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:32.439356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:32.496892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb99f-2506-4711-a5d4-bc1ebfed5e70 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:32.500483 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:32.501172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:32.501451 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:32.501722 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:32.510436 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:32.511840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:32.521710 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4249/8524] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:32.683031 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:32.684784 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:32.705844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac43786-4e5a-46e9-82fd-782ddf3f21c4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:32.710947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:32.711789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:32.712064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:32.712328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] PATH_INFO: `/v3/projects/2f578c1b89e941d5a7fdb1d858e95252` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:32.713612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f578c1b89e941d5a7fdb1d858e95252)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:32.715564 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:32.761837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f578c1b89e941d5a7fdb1d858e95252', 'request_id': 'req-07b9f363-6b73-439a-8ec3-d05620ce4101'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.767734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f578c1b89e941d5a7fdb1d858e95252', 'request_id': 'req-07b9f363-6b73-439a-8ec3-d05620ce4101'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.774184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f578c1b89e941d5a7fdb1d858e95252', 'request_id': 'req-07b9f363-6b73-439a-8ec3-d05620ce4101'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.788542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] The token cache is being invalidate because project 2f578c1b89e941d5a7fdb1d858e95252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:40:32.788959 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.789660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.791213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4276/8525] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:40:32 2021] DELETE /identity/v3/projects/2f578c1b89e941d5a7fdb1d858e95252 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:32.795254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:32.804934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741448-da63-403c-9648-82a368e2b368 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:32.860861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:32.861980 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:32.862468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:32.862813 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] PATH_INFO: `/v3/users/926e76c3a013497ca3f3422a21ecaa02` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:32.864010 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926e76c3a013497ca3f3422a21ecaa02)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:32.866518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:32.910702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926e76c3a013497ca3f3422a21ecaa02'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.917292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926e76c3a013497ca3f3422a21ecaa02'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.917950 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926e76c3a013497ca3f3422a21ecaa02'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.918549 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926e76c3a013497ca3f3422a21ecaa02'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.925195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f6c516ee-6deb-4e82-ac3f-3865580b9013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926e76c3a013497ca3f3422a21ecaa02'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:32.942799 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4250/8526] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:40:32 2021] DELETE /identity/v3/users/926e76c3a013497ca3f3422a21ecaa02 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:33.205015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.206587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:33.220336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9f363-6b73-439a-8ec3-d05620ce4101 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.274593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.275436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.275712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.275980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] PATH_INFO: `/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.277186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c13c758f7dc470eaa9784a2fe8fcebe)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.279064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.323055 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c13c758f7dc470eaa9784a2fe8fcebe', 'request_id': 'req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:33.328182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c13c758f7dc470eaa9784a2fe8fcebe', 'request_id': 'req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:33.334255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c13c758f7dc470eaa9784a2fe8fcebe', 'request_id': 'req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:33.345630 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] The token cache is being invalidate because project 2c13c758f7dc470eaa9784a2fe8fcebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:40:33.345910 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:33.346534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-d9e09bfe-0aa5-409b-8a6a-f3abd18e3183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:40:33.348034 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4277/8527] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:40:33 2021] DELETE /identity/v3/projects/2c13c758f7dc470eaa9784a2fe8fcebe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:33.354814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.355245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.355368 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.373066 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:33.374878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:33.431524 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4251/8528] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:40:33.476184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.476401 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.476635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.495221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:33.496428 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:33.505651 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4278/8529] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:33.510390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.519883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757bdae-b776-4ad7-8a63-0ac7eb68e719 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.524458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.525155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.525433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.525702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.526426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:40:33.526727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.528291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.539395 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4252/8530] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:40:33.543658 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.553256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e79e-6abc-4fd0-b38d-25715e4e7b92 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.558092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.558734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.559009 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.559276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.559969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.562624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.590320 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4279/8531] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:40:33 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:40:33.591507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.601826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241561a-ea64-4e91-9e44-87a924c01941 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.654241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.655379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.655663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.655934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.656675 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.658580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.679587 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4253/8532] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:40:33 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:40:33.683110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.693329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0289-bc62-4ee6-972c-679fb7df43dc admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.698114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.698764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.699040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.699311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.700032 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.701656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.713425 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4280/8533] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:40:33.717314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.727482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366d78-58f3-4af9-8929-f569757b586e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.731903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.732538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.732847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.733710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.734464 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.736024 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b2cef-4137-449e-9d93-4c6ab81a8cff admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.745565 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4254/8534] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:40:33.749425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.759077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e50b-408e-4430-b2c2-71d2482b3ba5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.763607 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.764466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.764776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.765065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] PATH_INFO: `/v3/projects/3149a28129e04c6086c46367d53ed5af/users/22dc7ce62a5e4271be5d8e6be787868b/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.778647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3149a28129e04c6086c46367d53ed5af, user_id=22dc7ce62a5e4271be5d8e6be787868b, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.781764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.794387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4281/8535] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:40:33 2021] PUT /identity/v3/projects/3149a28129e04c6086c46367d53ed5af/users/22dc7ce62a5e4271be5d8e6be787868b/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:40:33.800131 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28217c5-3d27-4f9d-ac4b-dad1360a3eef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.800421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28217c5-3d27-4f9d-ac4b-dad1360a3eef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.800798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28217c5-3d27-4f9d-ac4b-dad1360a3eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.818117 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a28217c5-3d27-4f9d-ac4b-dad1360a3eef None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:33.819296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a28217c5-3d27-4f9d-ac4b-dad1360a3eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:33.876441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4255/8536] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:33.886363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:33.888019 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:33.947671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287cc9-72ac-480a-b654-3ae3ffb21a38 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:33.951494 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:33.952724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:33.953001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:33.953271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:33.962439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:33.963866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b74a4-12c3-45b6-b181-f07b0bd671c0 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:33.973905 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4282/8537] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:34.564688 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec41753-5763-4bed-946e-8e96832a273b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:34.565180 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec41753-5763-4bed-946e-8e96832a273b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:34.565410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec41753-5763-4bed-946e-8e96832a273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:34.591803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fec41753-5763-4bed-946e-8e96832a273b None None] MFA Rules not processed for user `22dc7ce62a5e4271be5d8e6be787868b`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:34.593136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fec41753-5763-4bed-946e-8e96832a273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:34.655935 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4256/8538] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:34 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:34.667045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:34.667615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:34.667615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:34.684487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] MFA Rules not processed for user `22dc7ce62a5e4271be5d8e6be787868b`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:34.685732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:34.693474 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4283/8539] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:40:34 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:34.706216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec41753-5763-4bed-946e-8e96832a273b None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:34.707907 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fec41753-5763-4bed-946e-8e96832a273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:34.790053 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec41753-5763-4bed-946e-8e96832a273b None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:34.796248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:34.796928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:34.797209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:34.797492 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:34.806113 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:34.807696 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:34.817301 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4257/8540] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:34 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:35.772405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:35.773876 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:35.863868 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44a31a-1d43-422e-9bfa-b1085bc5ad59 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:35.868979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:35.869616 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:35.869897 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:35.870172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:35.871968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:35.886476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:35.888080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:35.900756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4284/8541] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:36.090911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:36.092318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:36.109772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b0c6-dc90-4c28-b04e-fd6364817406 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:36.115136 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:36.115769 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:36.116047 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:36.116358 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:36.118255 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:36.133410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:36.134985 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427ca68-4e11-459e-be17-6e7f4ef8318f service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:36.147997 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4258/8542] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:45.005324 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:45.006782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:45.021099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b72d6-9133-4f94-a400-8e1f758aab0c service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:45.024596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:45.025258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:45.025534 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:45.025803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:45.027554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:45.040825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:45.042256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ea935-3da0-437d-803f-752954f15782 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:45.052889 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4285/8543] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:40:45.171611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77db49-894e-406b-ba2e-3fb89c377feb None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:45.172127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77db49-894e-406b-ba2e-3fb89c377feb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:45.172127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77db49-894e-406b-ba2e-3fb89c377feb None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:45.173956 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4259/8544] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:40:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:40:45.178951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:45.179233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:45.179505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:45.215350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:40:45.216447 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:40:45.225205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4286/8545] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:40:45 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:40:45.246223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77db49-894e-406b-ba2e-3fb89c377feb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:40:45.262553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77db49-894e-406b-ba2e-3fb89c377feb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:40:45.267432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:40:45.268051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:40:45.268330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:40:45.268622 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:40:45.276695 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:40:45.278240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:40:45.287724 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4260/8546] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:40:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:41:13.616781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:13.628962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8184e-3f4a-438f-b8fc-92b4abfa692e None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:13.632491 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:13.633168 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:13.633424 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:13.633693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:13.635416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:13.647634 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:13.649068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:13.659065 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4287/8547] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:41:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:41:21.092399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.102855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b43e-7290-40bc-8da5-d47cb14caa32 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.108641 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.109524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.109799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.110070 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] PATH_INFO: `/v3/users/22dc7ce62a5e4271be5d8e6be787868b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.111254 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dc7ce62a5e4271be5d8e6be787868b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.113168 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.158319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dc7ce62a5e4271be5d8e6be787868b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.164988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dc7ce62a5e4271be5d8e6be787868b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.165644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dc7ce62a5e4271be5d8e6be787868b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.166236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dc7ce62a5e4271be5d8e6be787868b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.175086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-b9772bbd-e61d-4c51-ae58-0aa664bbe5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dc7ce62a5e4271be5d8e6be787868b'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.191794 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4261/8548] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:41:21 2021] DELETE /identity/v3/users/22dc7ce62a5e4271be5d8e6be787868b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:41:21.360502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.373303 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a6d1-c44d-4fd3-b13a-2124063c0260 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.428931 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.429789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.430065 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.430336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] PATH_INFO: `/v3/projects/3149a28129e04c6086c46367d53ed5af` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.431568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3149a28129e04c6086c46367d53ed5af)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.433486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.477259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3149a28129e04c6086c46367d53ed5af', 'request_id': 'req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.482511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3149a28129e04c6086c46367d53ed5af', 'request_id': 'req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.489201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3149a28129e04c6086c46367d53ed5af', 'request_id': 'req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.501079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] The token cache is being invalidate because project 3149a28129e04c6086c46367d53ed5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:41:21.501359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.501974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-16a5ca6b-15e9-4ef8-923c-8fdd93eb9623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:41:21.503840 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4288/8549] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:41:21 2021] DELETE /identity/v3/projects/3149a28129e04c6086c46367d53ed5af => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:41:21.509676 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.509966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.510270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.529806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:21.531007 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:21.727686 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4262/8550] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:41:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:41:21.735987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.736272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.736545 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.755045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:21.756244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:21.764422 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4289/8551] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:41:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:41:21.768541 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.777906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef973f2-7ce1-40fd-a736-6d94292a9069 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.782900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.783535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.783839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.784111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.784868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:41:21.785167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.786718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.798493 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4263/8552] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:41:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:41:21.802813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.811856 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387323fc-30ae-4204-bada-735ca2e58ffc None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.816481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.817148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.817427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.817697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.818392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.820295 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.845452 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4290/8553] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:41:21 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:41:21.849632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.859855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce34b5-e77f-4884-87c2-585da81aca4c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.912986 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.913648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.913934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.914208 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.914932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.916846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.935996 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4264/8554] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:41:21 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:41:21.940749 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.951346 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d25027-a908-41a8-933b-7676a558d8b0 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.956515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.957208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.957490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.957802 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.958782 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.960361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:21.971211 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4291/8555] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:41:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:41:21.975278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:21.985054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e599ee-4f96-4892-955e-d31cabc073be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:21.989518 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:21.990167 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:21.990446 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:21.990744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:21.991497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:21.993086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859340e-99c1-4566-a938-b7ea3573baab admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:22.003087 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4265/8556] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:41:21 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:41:22.007042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:22.017150 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31193-0bbb-4d6c-b3db-e15f68b43ee4 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:22.021982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:22.022958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:22.023318 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:22.023669 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] PATH_INFO: `/v3/projects/3f452851936e4245976798068f8549b8/users/419edd26904b44dfa1e643493a16eff5/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:22.039486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f452851936e4245976798068f8549b8, user_id=419edd26904b44dfa1e643493a16eff5, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:22.042175 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:22.054542 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4292/8557] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:41:22 2021] PUT /identity/v3/projects/3f452851936e4245976798068f8549b8/users/419edd26904b44dfa1e643493a16eff5/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:41:22.060810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17239-b5cd-4d25-b408-7d7bc195122b None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:22.061090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17239-b5cd-4d25-b408-7d7bc195122b None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:22.061361 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17239-b5cd-4d25-b408-7d7bc195122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:22.078069 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-14c17239-b5cd-4d25-b408-7d7bc195122b None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:22.079228 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-14c17239-b5cd-4d25-b408-7d7bc195122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:22.134612 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4266/8558] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:41:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:41:22.144971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:22.146805 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:22.202949 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05136-ea1d-45ba-bab6-346072f53161 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:22.206559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:22.207185 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:22.207460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:22.207732 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:22.216589 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:22.218606 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f42075-94a9-4231-9454-e9d74829b263 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:22.227583 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4293/8559] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:41:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:41:22.827162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:22.827563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:22.827934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:22.853961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] MFA Rules not processed for user `419edd26904b44dfa1e643493a16eff5`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:22.855207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:22.917942 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4267/8560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:41:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:41:22.929967 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eea46-126f-41b7-a0c1-c67f9bdcc783 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:22.930490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eea46-126f-41b7-a0c1-c67f9bdcc783 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:22.930490 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eea46-126f-41b7-a0c1-c67f9bdcc783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:22.947950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a18eea46-126f-41b7-a0c1-c67f9bdcc783 None None] MFA Rules not processed for user `419edd26904b44dfa1e643493a16eff5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:22.949184 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a18eea46-126f-41b7-a0c1-c67f9bdcc783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:22.956367 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4294/8561] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:41:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:41:22.968770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:22.970328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:23.043922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba95f-1777-4ec5-8683-284f4224bc72 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:23.050012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:23.050658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:23.050936 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:23.051207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:23.058886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:23.060433 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f0cf-6210-4370-81b9-b48bf4551b89 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:23.069528 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4268/8562] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:41:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:41:33.709310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:33.709877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:33.709999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:33.711827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4295/8563] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:41:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:41:33.717601 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198287-7f69-4b97-b189-471d7a0e6ca3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:33.718022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198287-7f69-4b97-b189-471d7a0e6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:33.718159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198287-7f69-4b97-b189-471d7a0e6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:33.746747 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ae198287-7f69-4b97-b189-471d7a0e6ca3 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:41:33.747934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ae198287-7f69-4b97-b189-471d7a0e6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:33.806857 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4269/8564] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:41:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:41:33.827118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:41:33.828811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:41:33.848191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aabef-5b18-4375-93f2-97a0ffa8cf4d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:41:33.853123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:41:33.853748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:41:33.854025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:41:33.854298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:41:33.862985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:41:33.864523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c870140-b12a-45e0-a838-284e22e71b8b service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:41:33.873920 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4296/8565] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:41:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:42:07.213572 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afee46-52d0-4dd4-bdf2-bd74eb77b9ea None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:07.214155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afee46-52d0-4dd4-bdf2-bd74eb77b9ea None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:07.214155 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afee46-52d0-4dd4-bdf2-bd74eb77b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:07.233807 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-40afee46-52d0-4dd4-bdf2-bd74eb77b9ea None None] MFA Rules not processed for user `419edd26904b44dfa1e643493a16eff5`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:42:07.234988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-40afee46-52d0-4dd4-bdf2-bd74eb77b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:07.242091 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4270/8566] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:42:07 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:42:17.921307 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:17.921875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:17.922091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:17.924345 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4297/8567] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:42:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:42:17.929553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:17.930115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:17.930115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:17.949732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:42:17.950919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:17.960325 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4271/8568] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:42:17 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:42:17.981671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:17.983541 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:18.005183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb810b28-101c-417c-b486-1366f3e51bff None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:18.010286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:18.010922 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:18.011204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:18.011478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:18.020955 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:18.022527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:18.033991 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4298/8569] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:42:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:42:55.846989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:55.867223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70854cb9-758f-4fde-a1f6-cf49cb185416 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:55.872076 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:55.873411 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:55.873719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:55.873990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] PATH_INFO: `/v3/users/419edd26904b44dfa1e643493a16eff5` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:55.875192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=419edd26904b44dfa1e643493a16eff5)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:55.877144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:55.921875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419edd26904b44dfa1e643493a16eff5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:55.928337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419edd26904b44dfa1e643493a16eff5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:55.929018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419edd26904b44dfa1e643493a16eff5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:55.929618 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419edd26904b44dfa1e643493a16eff5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:55.936829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-7c06ec76-d480-4fe7-a306-56fe5545f7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419edd26904b44dfa1e643493a16eff5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:55.953576 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4272/8570] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:42:55 2021] DELETE /identity/v3/users/419edd26904b44dfa1e643493a16eff5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:42:56.120683 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.133896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690b99-745a-4d72-b565-e98d651ed691 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.195042 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.195873 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.196146 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.196418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] PATH_INFO: `/v3/projects/3f452851936e4245976798068f8549b8` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.197604 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f452851936e4245976798068f8549b8)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.199462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.243597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f452851936e4245976798068f8549b8', 'request_id': 'req-6d40872a-abc2-449b-8b12-8da531111dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:56.249635 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f452851936e4245976798068f8549b8', 'request_id': 'req-6d40872a-abc2-449b-8b12-8da531111dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:56.255377 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f452851936e4245976798068f8549b8', 'request_id': 'req-6d40872a-abc2-449b-8b12-8da531111dcd'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:56.266599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] The token cache is being invalidate because project 3f452851936e4245976798068f8549b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:42:56.266877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:56.267507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6d40872a-abc2-449b-8b12-8da531111dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:42:56.269033 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4299/8571] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:42:56 2021] DELETE /identity/v3/projects/3f452851936e4245976798068f8549b8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:42:56.275089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.275376 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.275685 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.292659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:42:56.293846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:56.350691 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4273/8572] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:42:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:42:56.359559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.359839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.360113 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.378427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:42:56.379612 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:56.387417 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4300/8573] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:42:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:42:56.391420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.400968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a42fe-6a1a-49ac-a388-795295617759 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.406127 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.406873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.407137 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.407402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.408118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:42:56.408413 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.410262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.421823 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4274/8574] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 04:42:56.425943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.435480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660fad3-cb08-4d26-ac0b-b4726c86a5e4 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.440123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.440787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.441066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.441335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.442015 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.443894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.468596 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4301/8575] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:42:56 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:42:56.472810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.483141 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950cf3c-f3ac-4348-8779-16057205aec5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.535606 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.536252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.536527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.536825 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.537523 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.539350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.559528 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4275/8576] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:42:56 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:42:56.563720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.573832 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4931-7f34-435b-8524-8b20e1c66072 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.578364 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.579003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.579276 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.579544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.580262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.581860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.592659 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4302/8577] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:42:56.596728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.606402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475713e-0fe4-45af-b07a-37b8a8683741 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.611632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.612271 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.612551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.612863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.613582 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.615132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb74a-114c-4bb9-a1cf-620ef986b1a2 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.624921 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4276/8578] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:42:56.628976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.638781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31cdc-f6cb-4af6-8f5b-52f0b4cb7a05 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.643570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.644422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.644747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.645020 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] PATH_INFO: `/v3/projects/6ea459cc609a4ddfb7aa6bce971b1e6e/users/446f631ace834e75b1d9fae5240f76b5/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.659238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea459cc609a4ddfb7aa6bce971b1e6e, user_id=446f631ace834e75b1d9fae5240f76b5, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.661850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.674740 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4303/8579] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:42:56 2021] PUT /identity/v3/projects/6ea459cc609a4ddfb7aa6bce971b1e6e/users/446f631ace834e75b1d9fae5240f76b5/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:42:56.679734 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d09-e379-4d89-b90c-74c74ab3b788 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.680140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d09-e379-4d89-b90c-74c74ab3b788 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.680491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d09-e379-4d89-b90c-74c74ab3b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.697686 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c2e7d09-e379-4d89-b90c-74c74ab3b788 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:42:56.698866 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c2e7d09-e379-4d89-b90c-74c74ab3b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:56.754300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4277/8580] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:42:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:42:56.764090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:42:56.765800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:42:56.833483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ec919-979d-4047-bc7b-6e285fc8486b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:42:56.837459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:42:56.838097 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:42:56.838374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:42:56.838646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:42:56.848270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:42:56.849724 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:42:56.859131 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4304/8581] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:42:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:43:00.755906 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d427f8-b8b6-4fea-bf5c-f117209b0b35 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:43:00.756760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d427f8-b8b6-4fea-bf5c-f117209b0b35 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:43:00.757274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d427f8-b8b6-4fea-bf5c-f117209b0b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:43:00.787940 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a3d427f8-b8b6-4fea-bf5c-f117209b0b35 None None] MFA Rules not processed for user `446f631ace834e75b1d9fae5240f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:43:00.789196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a3d427f8-b8b6-4fea-bf5c-f117209b0b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:43:00.867722 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4278/8582] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:43:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:43:00.880397 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:43:00.881886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:43:01.001177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0defdf2-1dc7-45e0-9a91-1e2e63880355 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:43:01.007837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:43:01.008507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:43:01.008950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:43:01.009439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:43:01.018863 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:43:01.020473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be536607-2879-4a95-91b4-8a33bceac221 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:43:01.032494 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4305/8583] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:43:00 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:43:02.636385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63bda-2ced-421c-b17f-7034ff94982e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:43:02.636939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63bda-2ced-421c-b17f-7034ff94982e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:43:02.636939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63bda-2ced-421c-b17f-7034ff94982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:43:02.654264 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-b2b63bda-2ced-421c-b17f-7034ff94982e None None] MFA Rules not processed for user `446f631ace834e75b1d9fae5240f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:43:02.655481 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b2b63bda-2ced-421c-b17f-7034ff94982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:43:02.662840 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4279/8584] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:43:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:44:50.621725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753776b-ca97-4192-9571-94e31e33241f None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:44:50.622310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753776b-ca97-4192-9571-94e31e33241f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:44:50.622310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753776b-ca97-4192-9571-94e31e33241f None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:44:50.624077 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4306/8585] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:44:50.629378 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:44:50.629833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:44:50.629941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:44:50.649110 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:44:50.650445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:44:50.718441 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4280/8586] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:44:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:44:50.739902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753776b-ca97-4192-9571-94e31e33241f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:44:50.741668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8753776b-ca97-4192-9571-94e31e33241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:44:50.760390 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753776b-ca97-4192-9571-94e31e33241f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:44:50.765378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:44:50.766021 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:44:50.766297 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:44:50.766566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:44:50.775258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:44:50.776839 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:44:50.786671 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4307/8587] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:44:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:44:55.229224 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:44:55.241143 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff13fa-5401-4f25-8233-a51cbf73d101 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:44:55.244693 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:44:55.245323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:44:55.245604 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:44:55.245880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:44:55.247683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:44:55.263455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:44:55.264887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:44:55.277680 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4281/8588] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:44:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:44:56.452462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:44:56.453997 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:44:56.468874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f350c-b8e4-4c9a-8d92-ccc1de65c32f service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:44:56.472423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:44:56.473105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:44:56.473379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:44:56.473650 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:44:56.475320 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:44:56.490502 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:44:56.491905 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eeafa-f70c-47a2-93b5-1dab332d3812 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:44:56.505485 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4308/8589] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:44:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:45:04.562379 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:45:04.576790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a32a6-0071-41ed-a43e-e31ca562629a service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:45:04.582352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:45:04.583705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:45:04.583999 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:45:04.584273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:45:04.586515 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:45:04.602938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:45:04.604513 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:45:04.623985 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4282/8590] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:45:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:45:14.249657 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:45:14.250122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:45:14.250239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:45:14.267994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] MFA Rules not processed for user `446f631ace834e75b1d9fae5240f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:45:14.269215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:45:14.276064 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4309/8591] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:45:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:45:37.997901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:45:38.011920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358501ac-a79c-4748-95d6-56084dc135f4 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:45:38.017154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:45:38.017791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:45:38.018092 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:45:38.018362 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:45:38.020081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:45:38.038318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:45:38.038318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c19ce-f886-4730-8da7-326385b028aa service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:45:38.049507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4283/8592] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:45:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:45:47.337519 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:45:47.338903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:45:47.355888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03c091-0dd9-47ed-8bea-35aa86ae6745 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:45:47.360845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:45:47.361467 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:45:47.361742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:45:47.362013 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:45:47.363693 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:45:47.376766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:45:47.378309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:45:47.390545 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4310/8593] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:45:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:46:40.246318 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130751c-2059-44a5-ac5f-d7d0325c5700 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:46:40.246925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130751c-2059-44a5-ac5f-d7d0325c5700 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:46:40.246925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130751c-2059-44a5-ac5f-d7d0325c5700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:46:40.284764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-0130751c-2059-44a5-ac5f-d7d0325c5700 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:46:40.287065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0130751c-2059-44a5-ac5f-d7d0325c5700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:46:40.293563 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4284/8594] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Nov 10 04:46:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:46:40.299960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:46:40.309507 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb274c-b128-499b-8713-ac5959879431 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:46:40.313098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:46:40.313721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:46:40.314004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:46:40.314279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:46:40.316002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:46:40.328546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:46:40.329979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:46:40.340431 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4311/8595] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:46:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:11.185270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e308-0344-4fee-b9b2-85865ae8cb09 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:11.185874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e308-0344-4fee-b9b2-85865ae8cb09 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:11.185874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e308-0344-4fee-b9b2-85865ae8cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:11.205139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-6101e308-0344-4fee-b9b2-85865ae8cb09 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:47:11.206345 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6101e308-0344-4fee-b9b2-85865ae8cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:11.213637 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4285/8596] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Nov 10 04:47:11 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:47:11.219988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:11.229245 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908ea5-3f50-4d30-8b90-c93d4c9fd335 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:11.232933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:11.233570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:11.233858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:11.234136 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:11.235917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:11.248619 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:11.250083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653b63a-e3ca-49e5-ad41-221bef0144c4 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:11.260661 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4312/8597] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:11.360371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d430d2-1da3-45af-ac63-03572f1f4deb None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:11.360684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d430d2-1da3-45af-ac63-03572f1f4deb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:11.360959 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d430d2-1da3-45af-ac63-03572f1f4deb None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:11.362745 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4286/8598] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:47:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:47:11.367789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb369-6cc1-4f23-be2c-be3ce5da98ce None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:11.368070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb369-6cc1-4f23-be2c-be3ce5da98ce None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:11.368436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb369-6cc1-4f23-be2c-be3ce5da98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:11.386121 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-7e8eb369-6cc1-4f23-be2c-be3ce5da98ce None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:47:11.387255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-7e8eb369-6cc1-4f23-be2c-be3ce5da98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:11.395679 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4313/8599] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:47:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:47:11.417584 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d430d2-1da3-45af-ac63-03572f1f4deb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:11.433227 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d430d2-1da3-45af-ac63-03572f1f4deb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:11.438236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:11.438865 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:11.439146 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:11.439421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:11.448153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:11.449727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:11.459080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4287/8600] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:11 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:12.631118 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:12.631527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:12.631674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:12.650006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:47:12.651183 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:12.659624 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4314/8601] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:47:12 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:47:12.671934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:12.685082 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302462fc-af26-4e7f-9223-ad52f9359572 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:12.690105 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:12.690721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:12.690994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:12.691263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:12.700119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:12.701710 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:12.711451 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4288/8602] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:18.908455 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:18.917783 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7765e-88a9-4bee-9507-205ea841f408 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:18.921374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:18.922004 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:18.922281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:18.922554 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:18.924382 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:18.936950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:18.938348 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bec0b7-d047-4b55-b6b2-c13f3d1c38c8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:18.949386 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4315/8603] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:26.759441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:26.775797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343a06d-3e75-469f-ab9a-8eabf323ffdd service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:26.781442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:26.782086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:26.782477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:26.782759 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:26.784842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:26.799891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:26.801517 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:26.815104 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4289/8604] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:47:28.118217 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9bde-bd1b-45a0-8196-68f20698a166 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:28.118722 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9bde-bd1b-45a0-8196-68f20698a166 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:28.119046 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9bde-bd1b-45a0-8196-68f20698a166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:28.136787 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-022f9bde-bd1b-45a0-8196-68f20698a166 None None] MFA Rules not processed for user `446f631ace834e75b1d9fae5240f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:47:28.138068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-022f9bde-bd1b-45a0-8196-68f20698a166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:28.145007 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4316/8605] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:47:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:47:28.451577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:28.460848 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001070d-b984-4872-90af-6910be9b0fcc service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:28.464742 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:28.465383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:28.465663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:28.465934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:28.467833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:28.480478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:28.481547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:28.494204 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4290/8606] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:47:28.817518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:28.817821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:28.818074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:28.837285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:47:28.838895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:47:28.848128 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4317/8607] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:47:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:47:28.860791 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:47:28.877072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62043a1-a1f8-4fb9-a574-6908ff30c66d service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:47:28.881269 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:47:28.882054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:47:28.882344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:47:28.882723 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:47:28.891328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:47:28.892905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dca5d-c947-4ed2-8c03-4e66202624bb service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:47:28.902291 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4291/8608] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:47:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:48:01.604087 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:48:01.618472 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d8928-44a5-4f09-b733-719a73ec7927 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:48:01.623813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:48:01.624431 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:48:01.624739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:48:01.625012 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:48:01.632474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:48:01.634080 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cabc-d584-41d9-9dba-8f9dcac4cb25 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:48:01.642526 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4318/8609] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:48:01 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:49:15.347496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bae71-b934-4d36-9a0f-6b5f12167e79 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:15.348128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bae71-b934-4d36-9a0f-6b5f12167e79 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:15.348128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bae71-b934-4d36-9a0f-6b5f12167e79 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:15.350268 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4292/8610] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:49:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:49:15.355336 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c56e-d6c7-46cb-af0f-b6826a782c02 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:15.355838 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c56e-d6c7-46cb-af0f-b6826a782c02 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:15.355941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c56e-d6c7-46cb-af0f-b6826a782c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:15.375464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-caf9c56e-d6c7-46cb-af0f-b6826a782c02 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:49:15.376895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-caf9c56e-d6c7-46cb-af0f-b6826a782c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:49:15.385618 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4319/8611] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:49:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:49:15.406139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bae71-b934-4d36-9a0f-6b5f12167e79 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:49:15.422207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bae71-b934-4d36-9a0f-6b5f12167e79 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:49:15.427701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:49:15.428324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:15.428602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:15.428903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:15.436918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:49:15.438450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:49:15.447763 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4293/8612] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:49:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:49:42.615990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:42.616510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:42.616510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:42.634236 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] MFA Rules not processed for user `446f631ace834e75b1d9fae5240f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:49:42.635403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:49:42.642113 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4320/8613] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:49:42 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:49:42.949903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:49:42.958781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f0e2-f801-4fe9-b65d-419b02ed60c0 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:49:42.962329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:49:42.962955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:42.963232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:42.963507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:42.965535 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:49:42.977489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:49:42.978879 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:49:42.988786 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4294/8614] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:49:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:49:54.581059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:49:54.591056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84be9d-f78d-4f1d-a283-df665f0d3e78 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:49:54.594535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:49:54.595160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:54.595435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:54.595703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:54.608465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:49:54.609884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:49:54.622728 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4321/8615] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:49:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:49:56.968387 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:49:56.986251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256d92-f9d1-4482-84cd-ef34ed4d7d30 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:49:56.990326 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:49:56.990949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:49:56.991229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:49:56.991495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:49:57.029151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:49:57.030563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:49:57.043508 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4295/8616] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:49:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:50:40.987731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:50:41.030389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b696ca-92ef-437b-a116-90a9d22d4c0f service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:50:41.035439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:50:41.036095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:50:41.036375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:50:41.036672 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:50:41.047799 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:50:41.049445 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6635946-577e-44ee-9dc1-4a6e161f315e service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:50:41.062332 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4322/8617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:50:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:50:51.307125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:50:51.320888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7381fb-d93a-4f73-89e8-d10cfaaaa885 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:50:51.325961 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:50:51.326594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:50:51.326880 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:50:51.327152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:50:51.338991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:50:51.341023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc4cc3-37c4-46e2-8cbe-64e42d855fb8 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:50:51.353713 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4296/8618] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:50:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:51:39.141399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959dce-08a9-409b-8202-c61662cd59b9 None None] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:51:39.142000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959dce-08a9-409b-8202-c61662cd59b9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:51:39.142000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959dce-08a9-409b-8202-c61662cd59b9 None None] PATH_INFO: `/` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:51:39.144279 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4323/8619] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:51:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:51:39.150065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:51:39.150512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:51:39.150512 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:51:39.226260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:51:39.227447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:51:39.245155 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4297/8620] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:51:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:51:39.265793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b959dce-08a9-409b-8202-c61662cd59b9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:51:39.281475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b959dce-08a9-409b-8202-c61662cd59b9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:51:39.286898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:51:39.287516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:51:39.287794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:51:39.288066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:51:39.296171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:51:39.297751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:51:39.307870 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4324/8621] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:51:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:51:54.542893 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:51:54.552139 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d19e1-9afa-4696-a2d8-3c2f925f4cf4 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:51:54.555948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:51:54.556588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:51:54.556896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:51:54.557164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:51:54.566611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:51:54.568017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:51:54.578078 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4298/8622] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:51:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:51:54.982512 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:51:54.984067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:51:55.002833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24972d75-7601-4b11-b448-68bf5d23b301 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:51:55.008877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:51:55.009513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:51:55.009789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:51:55.010063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:51:55.022393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:51:55.024099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:51:55.037879 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4325/8623] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:51:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:14.959927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:14.968911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96e2c9-29a8-47e2-a671-1768d08e4689 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:14.972442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:14.973102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:14.973381 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:14.973655 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:14.982772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:14.984171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:14.993305 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4299/8624] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:18.243299 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:18.254837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa5ef-2b82-4225-9e9b-ea7e01fe3688 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:18.263718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:18.264720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.265157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.265257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] PATH_INFO: `/v3/users/446f631ace834e75b1d9fae5240f76b5` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.266440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=446f631ace834e75b1d9fae5240f76b5)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:18.268328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:18.314166 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446f631ace834e75b1d9fae5240f76b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.320945 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446f631ace834e75b1d9fae5240f76b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.321592 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446f631ace834e75b1d9fae5240f76b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.333083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446f631ace834e75b1d9fae5240f76b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.340889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f07a26f1-3acf-4bb5-8da4-30e82c66ca4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446f631ace834e75b1d9fae5240f76b5'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.346568 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4326/8625] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:52:18 2021] DELETE /identity/v3/users/446f631ace834e75b1d9fae5240f76b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:18.513620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:18.523767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc80ea-1b9f-4ff8-b045-7a43be3f42e1 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:18.587497 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:18.588339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.588638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.588908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] PATH_INFO: `/v3/projects/6ea459cc609a4ddfb7aa6bce971b1e6e` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.590073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea459cc609a4ddfb7aa6bce971b1e6e)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:18.592197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:18.635161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea459cc609a4ddfb7aa6bce971b1e6e', 'request_id': 'req-f03ff959-7982-49a9-acd8-e2a8c818e448'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.640635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea459cc609a4ddfb7aa6bce971b1e6e', 'request_id': 'req-f03ff959-7982-49a9-acd8-e2a8c818e448'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.646423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea459cc609a4ddfb7aa6bce971b1e6e', 'request_id': 'req-f03ff959-7982-49a9-acd8-e2a8c818e448'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.671421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] The token cache is being invalidate because project 6ea459cc609a4ddfb7aa6bce971b1e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:52:18.671703 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.672317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f03ff959-7982-49a9-acd8-e2a8c818e448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:18.673849 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4300/8626] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:52:18 2021] DELETE /identity/v3/projects/6ea459cc609a4ddfb7aa6bce971b1e6e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:18.679661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.679972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.680244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.729579 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:18.730710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:18.786416 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4327/8627] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:18.795050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.795351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.795624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.813185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:18.814393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:18.822660 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4301/8628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:18.826820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:18.837120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad8a4e-82a7-4ccb-8ec0-fa073abc0feb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:18.841969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:18.842615 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.842902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.843170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.843899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:52:18.844203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:18.845821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:18.856962 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4328/8629] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:52:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:52:18.861237 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:18.870342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2402-2bc8-4bd9-816d-706c1f71f694 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:18.874960 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:18.875589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.875862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.876129 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.876855 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:18.878689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:18.912085 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4302/8630] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:52:18 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:52:18.916429 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:18.926308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2657c2-e703-4076-baa0-cd1957085612 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:18.981937 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:18.982518 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:18.982796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:18.983063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:18.983754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:18.985763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:19.004698 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4329/8631] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:52:18 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:52:19.009324 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:19.019370 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055bc1d-f7c2-4f9e-a870-c12ee61c6064 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:19.024527 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:19.025192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.025468 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.025760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.026482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:19.028056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:19.037740 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4303/8632] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:52:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:52:19.041443 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:19.051207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6e8-812f-43ab-bb1b-502373cd438b admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:19.055835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:19.056475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.056796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.057091 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.057844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:19.059446 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d4c3b-6522-44ff-88d4-816d5f54d1ab admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:19.069205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4330/8633] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:52:19 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:52:19.073735 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:19.083937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4703cd-8a51-45b8-86d6-5d729766cbb6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:19.089366 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:19.090249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.090908 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.091184 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] PATH_INFO: `/v3/projects/46862a330ff94a8fb8b40770ae09cc08/users/2dab2368204f4324b9d6271b206c8a17/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.105956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46862a330ff94a8fb8b40770ae09cc08, user_id=2dab2368204f4324b9d6271b206c8a17, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:19.108684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:19.122931 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4304/8634] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:52:19 2021] PUT /identity/v3/projects/46862a330ff94a8fb8b40770ae09cc08/users/2dab2368204f4324b9d6271b206c8a17/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:19.128452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51463-0647-45e1-a83b-d1a391a6c894 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.128994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51463-0647-45e1-a83b-d1a391a6c894 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.129281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51463-0647-45e1-a83b-d1a391a6c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.150090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c3d51463-0647-45e1-a83b-d1a391a6c894 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:19.151287 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c3d51463-0647-45e1-a83b-d1a391a6c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:19.209178 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4331/8635] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 04:52:19.220068 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:19.221763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:19.287423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b0e3a-123b-45e7-8f77-6c39d1000f81 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:19.290927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:19.291559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.291839 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.292142 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.300920 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:19.302322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7862f2d-8305-44a1-884a-426c6e86edde service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:19.311998 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4305/8636] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:19.916325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:19.916912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:19.916912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:19.942505 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] MFA Rules not processed for user `2dab2368204f4324b9d6271b206c8a17`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:19.943730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:20.010387 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4332/8637] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:19 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:20.021575 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:20.022103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:20.022403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:20.040484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] MFA Rules not processed for user `2dab2368204f4324b9d6271b206c8a17`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:20.041818 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:20.049180 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4306/8638] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:20.061197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:20.062608 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:20.136247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3173778-da06-4aaa-83d9-f3c3ea603a9a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:20.141779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:20.142416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:20.142694 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:20.142969 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:20.151158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:20.152754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:20.161436 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4333/8639] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:22.211630 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:22.221507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f48dd-9299-40a6-9b2a-20f11611386e None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:22.225140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:22.225820 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:22.226100 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:22.226373 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:22.228075 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:22.239660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:22.241103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce7586-a8e2-45c8-8160-cda559caf41c service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:22.251674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4307/8640] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:52:28.083386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:28.085327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:28.103304 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4190-8e3c-4ad1-bbb8-8f2943fdcd20 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:28.109204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:28.109874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:28.110157 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:28.110434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:28.112205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:28.127459 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:28.129068 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:28.143111 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4334/8641] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:30.096459 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:30.096954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:30.096954 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:30.114056 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] MFA Rules not processed for user `2dab2368204f4324b9d6271b206c8a17`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:30.115231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:30.121988 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4308/8642] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:30.971340 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:30.972835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:31.044143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1453c-ab9d-4ca4-99b0-8f7892d4c658 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:31.049174 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:31.049820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:31.050098 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:31.050372 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:31.052111 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:31.063688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:31.065298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:31.074758 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4335/8643] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:44.580738 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:44.582187 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:44.594457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41074b4-606a-4df2-bcc3-2cdffa458e10 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:44.597967 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:44.598599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:44.598878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:44.599154 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:44.600989 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:44.613014 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:44.614419 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:44.624424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4309/8644] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:48.177362 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.188225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fa70-7ff6-48b9-a880-3c616253f123 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.193010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.193857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.194129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.195648 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] PATH_INFO: `/v3/users/2dab2368204f4324b9d6271b206c8a17` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.196145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dab2368204f4324b9d6271b206c8a17)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.198077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.243435 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dab2368204f4324b9d6271b206c8a17'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.250375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dab2368204f4324b9d6271b206c8a17'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.251045 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dab2368204f4324b9d6271b206c8a17'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.263172 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dab2368204f4324b9d6271b206c8a17'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.270135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-51049efc-1637-4107-8618-09acd2fca428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dab2368204f4324b9d6271b206c8a17'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.276091 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4336/8645] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:52:48 2021] DELETE /identity/v3/users/2dab2368204f4324b9d6271b206c8a17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:48.440875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.458932 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8496793-d832-4739-bdb8-4143b79c3e88 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.515778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.516632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.516922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.517191 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] PATH_INFO: `/v3/projects/46862a330ff94a8fb8b40770ae09cc08` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.518385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46862a330ff94a8fb8b40770ae09cc08)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.520240 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.564728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46862a330ff94a8fb8b40770ae09cc08', 'request_id': 'req-d0138350-5625-4590-9a19-30042f681dfd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.569984 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46862a330ff94a8fb8b40770ae09cc08', 'request_id': 'req-d0138350-5625-4590-9a19-30042f681dfd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.575969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46862a330ff94a8fb8b40770ae09cc08', 'request_id': 'req-d0138350-5625-4590-9a19-30042f681dfd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.587450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] The token cache is being invalidate because project 46862a330ff94a8fb8b40770ae09cc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:52:48.587737 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.588385 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-d0138350-5625-4590-9a19-30042f681dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:48.590093 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4310/8646] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:52:48 2021] DELETE /identity/v3/projects/46862a330ff94a8fb8b40770ae09cc08 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:48.596170 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.596453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.596754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.615035 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:48.616223 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:48.671950 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4337/8647] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:48.680278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.680565 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.680909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.699476 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:48.700683 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:48.708409 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4311/8648] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:48.712460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.722310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce425-1b61-4086-b20c-d85be447911a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.727386 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.728023 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.728301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.728575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.729329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:52:48.729632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.731216 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.744353 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4338/8649] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:52:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:52:48.748545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.757690 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46c4fb-1898-4ff2-b56a-e16a64ca3eee None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.762262 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.762895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.763170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.763438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.764124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.765988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.790703 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4312/8650] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:52:48 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:52:48.794736 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.808335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6720-7028-4056-8495-428a992da68d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.862597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.863255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.863532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.863801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.864489 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.866403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.885452 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4339/8651] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:52:48 2021] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:52:48.889577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.900022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9cefe-4a5a-429b-948b-a0ff09f5b972 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.904736 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.905392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.905671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.905943 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.906669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.908270 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.918982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4313/8652] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:52:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:52:48.922666 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.932430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978316a-013f-48dd-8251-d8393f11ecc9 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.937253 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.937899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.938199 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.938468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.939215 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.940841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc2313-5b9c-412c-9f6c-6e648bc06dba admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:48.950558 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4340/8653] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:52:48 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:52:48.954455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:48.964399 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04ac4-4bcd-492a-be5f-273344ff6dc7 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:48.969203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:48.970063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:48.970339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:48.970609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] PATH_INFO: `/v3/projects/0daba8c381d84576967a4680a17bad18/users/ffdd6473fdee42b9a6d5887bf164f0d9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:48.985162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daba8c381d84576967a4680a17bad18, user_id=ffdd6473fdee42b9a6d5887bf164f0d9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:48.987887 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:49.000268 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4314/8654] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:52:48 2021] PUT /identity/v3/projects/0daba8c381d84576967a4680a17bad18/users/ffdd6473fdee42b9a6d5887bf164f0d9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:49.011120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d769-04b2-4d8f-a43b-5e49350e7aa4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:49.011404 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d769-04b2-4d8f-a43b-5e49350e7aa4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:49.011673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d769-04b2-4d8f-a43b-5e49350e7aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:49.037964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-51d6d769-04b2-4d8f-a43b-5e49350e7aa4 None None] MFA Rules not processed for user `ffdd6473fdee42b9a6d5887bf164f0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:49.039793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-51d6d769-04b2-4d8f-a43b-5e49350e7aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:49.100756 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4341/8655] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:49 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:49.111108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:49.112886 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:49.168317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30262e-3b60-47b8-b126-face8be7564d admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:49.172336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:49.173061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:49.173363 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:49.173669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:49.182430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:49.183821 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef35b4-5093-45b1-9fac-77968d81146f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:49.192294 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4315/8656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:49 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:52:54.319503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:54.321316 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:54.321755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:54.345781 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:54.347141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:54.422481 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4342/8657] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 10 04:52:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:54.437185 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:54.437739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:54.437739 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:54.456276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:54.457602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:54.468153 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4316/8658] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 04:52:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:54.475284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:54.488049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6ba1-d83c-4629-afce-0db4831c562a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:54.494205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:54.494877 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:54.495151 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:54.495426 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:54.505662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:54.507461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeb386-7f5d-4d61-ba02-a0b4f3106dc3 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:54.518496 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4343/8659] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:52:59.694524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:59.763550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251198da-3ea4-4c20-9ad3-bc524e7657e8 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:52:59.768305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:52:59.769192 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:59.769473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:59.769744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] PATH_INFO: `/v3/users/ffdd6473fdee42b9a6d5887bf164f0d9` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:59.770927 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdd6473fdee42b9a6d5887bf164f0d9)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:52:59.773487 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:52:59.816963 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdd6473fdee42b9a6d5887bf164f0d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:59.824009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdd6473fdee42b9a6d5887bf164f0d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:59.824826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdd6473fdee42b9a6d5887bf164f0d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:59.825432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdd6473fdee42b9a6d5887bf164f0d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:59.833573 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdd6473fdee42b9a6d5887bf164f0d9'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:52:59.850878 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4317/8660] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:52:59 2021] DELETE /identity/v3/users/ffdd6473fdee42b9a6d5887bf164f0d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:52:59.855536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:52:59.855986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:52:59.856123 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:52:59.872954 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:52:59.874132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:52:59.930069 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4344/8661] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:52:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:52:59.939971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:52:59.941330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.005019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa960013-99d7-42b0-882f-b33bac5c8fc9 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.009296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.009931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.010212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.010485 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.019245 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.020708 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab443e-a9ee-4840-b280-14c3c96bfc0f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.029891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4318/8662] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:52:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:00.190419 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.191850 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.206963 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4998-2225-4117-9409-e6e6f0afb743 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.211759 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.212671 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.212958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.213205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] PATH_INFO: `/v3/projects/0daba8c381d84576967a4680a17bad18` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.214422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0daba8c381d84576967a4680a17bad18)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.216561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.262517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0daba8c381d84576967a4680a17bad18', 'request_id': 'req-7efb19b1-0af4-455c-a30e-faf181b92159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:00.267678 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0daba8c381d84576967a4680a17bad18', 'request_id': 'req-7efb19b1-0af4-455c-a30e-faf181b92159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:00.273516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0daba8c381d84576967a4680a17bad18', 'request_id': 'req-7efb19b1-0af4-455c-a30e-faf181b92159'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:00.285461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] The token cache is being invalidate because project 0daba8c381d84576967a4680a17bad18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:53:00.285745 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:00.286374 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-7efb19b1-0af4-455c-a30e-faf181b92159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:00.287893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4345/8663] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:53:00 2021] DELETE /identity/v3/projects/0daba8c381d84576967a4680a17bad18 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:53:00.294145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7571-1433-49a6-b108-b1102d591521 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.294430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7571-1433-49a6-b108-b1102d591521 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.294705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7571-1433-49a6-b108-b1102d591521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.312079 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-098c7571-1433-49a6-b108-b1102d591521 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:00.313303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-098c7571-1433-49a6-b108-b1102d591521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.368948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4319/8664] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:00.376833 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.377145 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.377425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.396246 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:00.397503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.405453 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4346/8665] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:00.409493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7571-1433-49a6-b108-b1102d591521 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.419314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7571-1433-49a6-b108-b1102d591521 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.423754 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.424393 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.424700 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.424971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.425684 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:53:00.425982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.427533 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.439004 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4320/8666] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:53:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:53:00.443040 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.452018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5751d9-95b8-4468-b8ac-8ee2536bf3c9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.456624 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.457267 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.457544 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.457813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.458511 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.460373 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.485453 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4347/8667] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:53:00 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:53:00.489632 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.500032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7690f1-cba8-4270-b472-ab4239def4c6 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.553609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.554860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.555140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.555418 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.556111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.558028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.577216 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4321/8668] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:53:00 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:53:00.581464 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.591912 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e879-972d-4681-b7a7-1573ccd78669 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.596515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.597189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.597466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.597739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.598460 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.600033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.611827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4348/8669] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:53:00.615729 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.626089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cecd3-fd14-4cbd-92bd-2f5a47c5c694 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.630638 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.631279 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.631562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.631841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.632596 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.634200 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332837-720c-461c-87f7-ca4a11d78131 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.643796 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4322/8670] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:00 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:53:00.647660 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.657492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28477670-688c-4ffe-be61-dcb7ecb0e337 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.662095 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.662947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.663228 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.664002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] PATH_INFO: `/v3/projects/31561211a221429f9fb4bc30316c6ace/users/a5ce6bb038f94912983c62270dd35477/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.677710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31561211a221429f9fb4bc30316c6ace, user_id=a5ce6bb038f94912983c62270dd35477, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.680939 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.693295 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4349/8671] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:53:00 2021] PUT /identity/v3/projects/31561211a221429f9fb4bc30316c6ace/users/a5ce6bb038f94912983c62270dd35477/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:53:00.702824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.703315 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.703415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.729732 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] MFA Rules not processed for user `a5ce6bb038f94912983c62270dd35477`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:00.730934 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.792414 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4323/8672] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:00.803039 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:00.804769 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:00.860762 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64680ec-2888-45c1-9f4a-df45149800c2 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:00.864439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:00.865110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:00.865389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:00.865662 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:00.873976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:00.875391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77dedb-b233-4a94-9741-9e890ff65d32 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:00.884118 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4350/8673] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:00 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:04.424532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:04.484288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384cf8-9729-4092-b6b3-03e859d96e43 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:04.489020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:04.489867 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:04.490138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:04.490410 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] PATH_INFO: `/v3/users/a5ce6bb038f94912983c62270dd35477` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:04.492133 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ce6bb038f94912983c62270dd35477)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:04.494062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:04.537203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ce6bb038f94912983c62270dd35477'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.543748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ce6bb038f94912983c62270dd35477'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.544336 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ce6bb038f94912983c62270dd35477'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.544953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ce6bb038f94912983c62270dd35477'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.551953 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ce6bb038f94912983c62270dd35477'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.568938 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4324/8674] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:53:04 2021] DELETE /identity/v3/users/a5ce6bb038f94912983c62270dd35477 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:53:04.574064 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:04.574527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:04.574821 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:04.592461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:04.593690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:04.649581 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4351/8675] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:04.659426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:04.660888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:04.716303 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ca32-53f5-4813-b72c-04f3d873d629 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:04.719922 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:04.720558 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:04.720874 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:04.721148 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:04.730022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:04.731420 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe16eb-6b7a-4730-88ef-7d24b3db429b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:04.740506 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4325/8676] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 04:53:04.911339 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:04.912917 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:04.926416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6adbb3-45f8-46d4-bf05-7b73f5866f27 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:04.932089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:04.933084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:04.933432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:04.933775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] PATH_INFO: `/v3/projects/31561211a221429f9fb4bc30316c6ace` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:04.935177 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31561211a221429f9fb4bc30316c6ace)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:04.937180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:04.984638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31561211a221429f9fb4bc30316c6ace', 'request_id': 'req-137ba015-a188-4f42-aa1f-7689fc92a1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.989880 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31561211a221429f9fb4bc30316c6ace', 'request_id': 'req-137ba015-a188-4f42-aa1f-7689fc92a1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:04.997054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31561211a221429f9fb4bc30316c6ace', 'request_id': 'req-137ba015-a188-4f42-aa1f-7689fc92a1d3'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:05.008936 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] The token cache is being invalidate because project 31561211a221429f9fb4bc30316c6ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:53:05.009214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:05.009828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-137ba015-a188-4f42-aa1f-7689fc92a1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:53:05.011343 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4352/8677] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:53:04 2021] DELETE /identity/v3/projects/31561211a221429f9fb4bc30316c6ace => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:53:05.018569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.018846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.019119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.035841 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:05.037045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:05.093875 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4326/8678] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:05.102688 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.102972 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.103242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.122517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:05.123712 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:05.131901 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4353/8679] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:05.135896 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.145401 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a5c9-d787-460b-b744-4a25802fefb9 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.154374 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.155048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.155329 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.155605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.156343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:53:05.156701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.158407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.170617 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4327/8680] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:53:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:53:05.175014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.185159 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4bd22-92b7-471a-845b-2bb603311eab None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.189840 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.190486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.190766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.191037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.191738 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.193639 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.217922 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4354/8681] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:53:05 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:53:05.222203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.232599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a9de-546d-44fd-a68c-eb3881c97e97 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.286111 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.286761 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.287045 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.287319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.289039 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.290933 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.309646 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4328/8682] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:53:05 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:53:05.313813 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.323984 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee3d44-2b2f-4157-8026-f47d23673083 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.328874 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.329571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.329966 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.330248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.330982 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.332593 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.345179 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4355/8683] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:53:05.348844 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.359287 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac063f7-7765-4a49-88ca-b00ad610a2a4 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.363808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.364455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.364766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.365043 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.365767 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.367357 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626022b-1ae6-43b8-8429-a1eb64fa06a5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.376982 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4329/8684] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:53:05.380902 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.390552 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ada1e-360c-4b76-8471-e89bc8585666 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.395212 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.396425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.396940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.397234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] PATH_INFO: `/v3/projects/1628fcd51131459d97e1cb64ae91fb90/users/0199eec8800e4332b3349660eac2da3e/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.411926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1628fcd51131459d97e1cb64ae91fb90, user_id=0199eec8800e4332b3349660eac2da3e, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.415186 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.427718 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4356/8685] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:53:05 2021] PUT /identity/v3/projects/1628fcd51131459d97e1cb64ae91fb90/users/0199eec8800e4332b3349660eac2da3e/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:53:05.432888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a28b-be73-4121-aacf-b432ecbb402d None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.433350 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a28b-be73-4121-aacf-b432ecbb402d None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.433514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a28b-be73-4121-aacf-b432ecbb402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.450785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-ca75a28b-be73-4121-aacf-b432ecbb402d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:05.451971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-ca75a28b-be73-4121-aacf-b432ecbb402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:05.508038 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4330/8686] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:05.518028 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:05.519703 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:05.576425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d065-1874-4438-8b9b-61d16c40e902 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:05.580125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:05.580795 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:05.581076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:05.581352 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:05.591083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:05.592478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:05.602403 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4357/8687] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:09.272422 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.273073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.273179 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.298951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] MFA Rules not processed for user `0199eec8800e4332b3349660eac2da3e`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:09.300074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:09.363482 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4331/8688] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:09.368509 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.378870 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5968e3-563b-44b7-b757-95189a9d602e service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.384037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.384721 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.385001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.385273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.385985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.387853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.413701 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4358/8689] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:53:09 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:53:09.417567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.428099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba8cb8-be61-4c79-b521-d3d5a6c9ad88 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.485114 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.485868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.486218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.486507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] PATH_INFO: `/v3/users` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.487220 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.489152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.510368 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4332/8690] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:53:09 2021] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:53:09.513708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.530486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0855c5-db0c-4f20-93b8-99a4894cb7a5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.535262 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.535928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.536201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.536466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.537222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.539301 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.550848 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4359/8691] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:09 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:53:09.555275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.566116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46849d-6388-4523-9fbd-c08659186dbc admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.570842 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.571717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.572000 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.572275 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] PATH_INFO: `/v3/projects/6754de7403544a3ca3f722ffae447730/users/6179a60ca1e84ab5adf8793e9ba1eb7d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.592351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6754de7403544a3ca3f722ffae447730, user_id=6179a60ca1e84ab5adf8793e9ba1eb7d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.595857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.613035 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4333/8692] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:53:09 2021] PUT /identity/v3/projects/6754de7403544a3ca3f722ffae447730/users/6179a60ca1e84ab5adf8793e9ba1eb7d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:53:09.617668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.627803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad621-cd8f-4b69-a388-ebda7249a869 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.693941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.694889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.696344 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.696853 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.697674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.699361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b7a4-c3fe-427c-b6c5-fb57e38cdf11 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.710575 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4360/8693] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:53:09 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:53:09.714539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:09.725274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afbad2-eac3-453b-9c2d-2b9d2897969a admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:09.730946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:09.731858 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:09.732140 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:09.732416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] PATH_INFO: `/v3/projects/6754de7403544a3ca3f722ffae447730/users/6179a60ca1e84ab5adf8793e9ba1eb7d/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:09.734668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6754de7403544a3ca3f722ffae447730, user_id=6179a60ca1e84ab5adf8793e9ba1eb7d, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:09.738421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6eaab-535f-413e-aebd-a2f400ae6350 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:09.751770 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4334/8694] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:53:09 2021] PUT /identity/v3/projects/6754de7403544a3ca3f722ffae447730/users/6179a60ca1e84ab5adf8793e9ba1eb7d/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:53:14.433812 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:14.434312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:14.434710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:14.462687 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] MFA Rules not processed for user `6179a60ca1e84ab5adf8793e9ba1eb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:14.463884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:14.540894 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4361/8695] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:14 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:14.566225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d76b9-dca8-4850-927d-df56afcfa2d4 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:14.566687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d76b9-dca8-4850-927d-df56afcfa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:14.567025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d76b9-dca8-4850-927d-df56afcfa2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:14.626429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-201d76b9-dca8-4850-927d-df56afcfa2d4 None None] MFA Rules not processed for user `b0e3e62850b34fe786eda1156be94f74`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:14.627653 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-201d76b9-dca8-4850-927d-df56afcfa2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:14.687741 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4335/8696] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 04:53:14 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:14.696112 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:14.708663 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909de7d3-9d08-4acb-8ef4-717ecc286c85 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:14.715529 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:14.716514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:14.716891 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:14.717162 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:14.773392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:14.774869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a4f78-ad4c-442d-8bf0-12f850b3aae3 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:14.783891 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4362/8697] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:14.903461 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:14.903756 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:14.904034 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:14.954495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:14.955878 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:15.025391 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4336/8698] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:53:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:15.077941 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd421c2-35bf-4b4b-a199-408c367977ae None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:15.078300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd421c2-35bf-4b4b-a199-408c367977ae None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:15.078649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd421c2-35bf-4b4b-a199-408c367977ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:15.131331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-dbd421c2-35bf-4b4b-a199-408c367977ae None None] MFA Rules not processed for user `525c6651aaa6451cbe1dd9f91e1c68ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:15.133350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-dbd421c2-35bf-4b4b-a199-408c367977ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:15.219337 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4363/8699] 10.222.0.13 () {58 vars in 1039 bytes} [Wed Nov 10 04:53:15 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:15.228080 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:15.244975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4d92-b9a8-4953-9231-e775362fbf3a None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:15.250256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:15.251016 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:15.251295 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:15.251561 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:15.261309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:15.263156 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdca988-f284-410c-8de7-dae30562ee1c service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:15.273352 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4337/8700] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:53:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 04:53:24.992408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:24.993014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:24.993014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:25.010739 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] MFA Rules not processed for user `0199eec8800e4332b3349660eac2da3e`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:25.011943 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:25.018849 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4364/8701] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:53:24 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:25.577623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32604d-11d9-4868-af13-aed178e76b36 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:25.578203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32604d-11d9-4868-af13-aed178e76b36 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:25.578203 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32604d-11d9-4868-af13-aed178e76b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:25.598273 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2c32604d-11d9-4868-af13-aed178e76b36 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:25.599493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2c32604d-11d9-4868-af13-aed178e76b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:25.661182 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4338/8702] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 04:53:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:25.668001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:25.679284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782f3c-e5ca-458c-9752-a4213f5c6136 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:25.684279 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:25.684933 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:25.685206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:25.685476 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:25.687211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:25.698214 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:25.699699 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:25.709304 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4365/8703] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:26.763341 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8220-8829-4317-83aa-0d2694968ece None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:26.763824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8220-8829-4317-83aa-0d2694968ece None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:26.763939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8220-8829-4317-83aa-0d2694968ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:26.781929 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-946b8220-8829-4317-83aa-0d2694968ece None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:26.783107 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-946b8220-8829-4317-83aa-0d2694968ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:26.790805 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4339/8704] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:53:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:26.805329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:26.817385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b257856-3304-4223-a268-4a55c42773e4 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:26.822361 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:26.823001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:26.823283 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:26.823555 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:26.837313 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:26.839278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:26.847969 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4366/8705] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:53:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:53:43.988037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:43.988701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:43.988701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:44.006115 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:53:44.007337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:53:44.015737 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4340/8706] 10.222.0.21 () {58 vars in 1015 bytes} [Wed Nov 10 04:53:43 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:53:44.029661 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:44.041132 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183a0a-e92a-45ec-8a35-a11da6773cc9 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:44.046882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:44.047515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:44.047788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:44.048058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:44.057010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:44.058575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7a054-3050-4275-b232-8ab96a99cc71 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:44.067957 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4367/8707] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:53:50.051687 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:53:50.102554 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e0d09-bb77-4c08-905f-d69f7a28c3b6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:53:50.106116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:53:50.106745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:53:50.107023 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:53:50.107296 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:53:50.115948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:53:50.117382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:53:50.126472 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4341/8708] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:53:50 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:07.483076 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988a28-3762-438c-be3e-347f4644d41c None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:07.483673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988a28-3762-438c-be3e-347f4644d41c None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:07.483673 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988a28-3762-438c-be3e-347f4644d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:07.530466 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-76988a28-3762-438c-be3e-347f4644d41c None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:07.531674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76988a28-3762-438c-be3e-347f4644d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:07.603138 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4368/8709] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 04:55:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:07.614633 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:07.616037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:07.627218 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a5e3-0ec8-4aa7-871f-eb088d94d763 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:07.630731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:07.631343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:07.631617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:07.631885 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:07.634172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:07.649204 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:07.650623 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:07.663530 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4342/8710] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:08.097779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238151c-2157-43e5-9485-a4888214972a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:08.098413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238151c-2157-43e5-9485-a4888214972a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:08.098916 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238151c-2157-43e5-9485-a4888214972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:08.134500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-4238151c-2157-43e5-9485-a4888214972a None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:08.136329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4238151c-2157-43e5-9485-a4888214972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:08.163416 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4369/8711] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Nov 10 04:55:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:08.171647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:08.182944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53983e1-9acd-491a-812b-349249c1c734 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:08.197074 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:08.197971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:08.198258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:08.198537 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:08.200482 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:08.218650 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:08.220288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:08.236262 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4343/8712] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:10.560513 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723841-c43f-45d9-9fad-b603763ec93b None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:10.561026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723841-c43f-45d9-9fad-b603763ec93b None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:10.561138 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723841-c43f-45d9-9fad-b603763ec93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:10.579440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5b723841-c43f-45d9-9fad-b603763ec93b None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:10.580653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5b723841-c43f-45d9-9fad-b603763ec93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:10.589982 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4370/8713] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:55:10 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:10.602040 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:10.603545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:10.681968 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46d9a7-4a0e-4f8b-872b-06226576a39b service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:10.685760 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e779dee8d114aa890e1725ef72b0ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:10.686484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:10.686763 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:10.687036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:10.697783 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:10.699188 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:10.709917 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4344/8714] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:13.213229 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693466e2-95fe-4827-b06c-caac5e7091c4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:13.213731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693466e2-95fe-4827-b06c-caac5e7091c4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:13.213859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693466e2-95fe-4827-b06c-caac5e7091c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:13.231789 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-693466e2-95fe-4827-b06c-caac5e7091c4 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:13.233002 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-693466e2-95fe-4827-b06c-caac5e7091c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:13.242405 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4371/8715] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:55:13 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:13.253442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:13.262928 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f984b-9cc1-4758-a2c7-1c0a8cf4acc4 service cinder] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:13.266563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:13.267195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:13.267470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:13.267744 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:13.278380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:13.279762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:13.290377 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4345/8716] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:16.653158 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:16.653668 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:16.653786 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:16.672240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:16.673465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:16.681148 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4372/8717] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 04:55:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:16.723101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:16.734046 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becd376-96cf-4277-851a-053dd5ba2f16 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:16.738914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:16.739540 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:16.739817 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:16.740116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:16.748344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:16.749914 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:16.757608 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4346/8718] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 04:55:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 04:55:23.637842 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:23.697755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff9b5a-5b59-4e54-8f03-c050b2fb7162 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:23.702258 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:23.703114 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:23.703747 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:23.704210 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] PATH_INFO: `/v3/users/0199eec8800e4332b3349660eac2da3e` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:23.705500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0199eec8800e4332b3349660eac2da3e)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:23.707423 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:23.751532 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0199eec8800e4332b3349660eac2da3e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:23.758603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0199eec8800e4332b3349660eac2da3e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:23.759244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0199eec8800e4332b3349660eac2da3e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:23.770499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0199eec8800e4332b3349660eac2da3e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:23.777862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0199eec8800e4332b3349660eac2da3e'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:23.783503 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4373/8719] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:55:23 2021] DELETE /identity/v3/users/0199eec8800e4332b3349660eac2da3e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:23.959843 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:23.975152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861c6a-8994-475e-8ea2-8723f8b5c85b service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.029581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.030425 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.030706 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.030982 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] PATH_INFO: `/v3/projects/1628fcd51131459d97e1cb64ae91fb90` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.032197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1628fcd51131459d97e1cb64ae91fb90)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.034104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.077473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1628fcd51131459d97e1cb64ae91fb90', 'request_id': 'req-5c70f115-04b8-4e59-9cbf-be49ce8239d5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.082752 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1628fcd51131459d97e1cb64ae91fb90', 'request_id': 'req-5c70f115-04b8-4e59-9cbf-be49ce8239d5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.088905 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1628fcd51131459d97e1cb64ae91fb90', 'request_id': 'req-5c70f115-04b8-4e59-9cbf-be49ce8239d5'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.100647 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] The token cache is being invalidate because project 1628fcd51131459d97e1cb64ae91fb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:55:24.101002 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.101563 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.103068 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4347/8720] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:55:23 2021] DELETE /identity/v3/projects/1628fcd51131459d97e1cb64ae91fb90 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 04:55:24.107051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.108468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:24.121700 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ba5f-122d-47a9-9c75-7f616561f323 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.174778 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.175571 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.175852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.176125 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] PATH_INFO: `/v3/users/6179a60ca1e84ab5adf8793e9ba1eb7d` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.177342 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6179a60ca1e84ab5adf8793e9ba1eb7d)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.179255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.223682 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6179a60ca1e84ab5adf8793e9ba1eb7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.230376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6179a60ca1e84ab5adf8793e9ba1eb7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.231033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6179a60ca1e84ab5adf8793e9ba1eb7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.242861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6179a60ca1e84ab5adf8793e9ba1eb7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.250591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-85b66624-c6e3-4ce9-81b0-62f519e53fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6179a60ca1e84ab5adf8793e9ba1eb7d'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.256717 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4374/8721] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 04:55:24 2021] DELETE /identity/v3/users/6179a60ca1e84ab5adf8793e9ba1eb7d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:24.420098 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.421611 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:24.437409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f115-04b8-4e59-9cbf-be49ce8239d5 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.492786 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.493640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.493917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.494190 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] PATH_INFO: `/v3/projects/6754de7403544a3ca3f722ffae447730` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.495384 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6754de7403544a3ca3f722ffae447730)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.497297 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.540665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6754de7403544a3ca3f722ffae447730', 'request_id': 'req-f60e9806-d23f-4841-8889-886660d031eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.545809 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6754de7403544a3ca3f722ffae447730', 'request_id': 'req-f60e9806-d23f-4841-8889-886660d031eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.551770 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6754de7403544a3ca3f722ffae447730', 'request_id': 'req-f60e9806-d23f-4841-8889-886660d031eb'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.564494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] The token cache is being invalidate because project 6754de7403544a3ca3f722ffae447730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 04:55:24.564803 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.565423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-f60e9806-d23f-4841-8889-886660d031eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 04:55:24.566958 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4348/8722] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 04:55:24 2021] DELETE /identity/v3/projects/6754de7403544a3ca3f722ffae447730 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:24.573139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.573425 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.573702 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.590926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:24.592427 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:24.649354 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4375/8723] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:55:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:24.657104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.657390 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.657666 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.677328 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:24.678577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:24.686974 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4349/8724] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:55:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:24.691133 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.700695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c867ad-689b-4486-b877-fda81d69b77d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.705176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.705817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.706096 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.706370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.707092 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 04:55:24.707393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.709018 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.721050 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4376/8725] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 04:55:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 04:55:24.724863 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.734493 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c5d3-1975-4a5e-8963-6b6350612f00 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.739032 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.739665 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.739941 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.740212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.740958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.742810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.766831 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4350/8726] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:55:24 2021] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 04:55:24.770867 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.782201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182773d9-f0c8-4097-94a2-7d5768fba7bf admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.837533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.838200 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.838478 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.838779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.839473 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.841456 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.865450 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4377/8727] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:55:24 2021] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:55:24.866555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.876524 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd810e-779e-4dc1-83e1-f53ade324370 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.881103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.881750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.882029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.882304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.883063 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.884648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.894771 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4351/8728] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:55:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 04:55:24.899058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.908771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada444-fd43-47e7-b704-c275ee73e04f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.914720 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.915370 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.915649 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.915923 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.916681 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.918255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b1e15-6dcd-4e25-9ff8-0894291887af admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.928022 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4378/8729] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:55:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:55:24.932078 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:24.941672 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764c4bc-6ab4-46a8-9e28-8e7ec8ab5270 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:24.946429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:24.947274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.947557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.948439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] PATH_INFO: `/v3/projects/bb888d7f1ef6460ebe084784cac4d5a2/users/370699bdc9154f46a66106ec6db331f9/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:24.963353 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb888d7f1ef6460ebe084784cac4d5a2, user_id=370699bdc9154f46a66106ec6db331f9, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:24.966332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:24.979422 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4352/8730] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:55:24 2021] PUT /identity/v3/projects/bb888d7f1ef6460ebe084784cac4d5a2/users/370699bdc9154f46a66106ec6db331f9/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:24.990376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:24.990656 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:24.990929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.017235 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:25.018433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:25.079038 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4379/8731] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:55:24 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:25.083503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.142743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec638-2b58-4cf6-a04c-051a2a2370f0 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.147426 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.148072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.148991 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.149274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.149971 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.151840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.175527 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4353/8732] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 04:55:25 2021] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:55:25.179596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.191034 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b3b97-140d-4ab6-87ca-eb95e1f81e30 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.246973 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.247643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.247926 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.248204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.248950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.250866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.271110 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4380/8733] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 04:55:25 2021] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 04:55:25.275489 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.285719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946b413-18f9-40f0-900a-fc8c10c0ae2c admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.290888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.291547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.291899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.292177 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.293072 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.294681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.305082 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4354/8734] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:55:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:55:25.309383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.319471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da83a58-da45-4a4e-8979-e6b05aecf290 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.324728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.325594 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.325871 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.326141 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] PATH_INFO: `/v3/projects/ce31c33522c4447299e86da22656bdac/users/66b113a48cb8437fa61c263f12bc6bea/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.343264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce31c33522c4447299e86da22656bdac, user_id=66b113a48cb8437fa61c263f12bc6bea, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.345978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.359080 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4381/8735] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:55:25 2021] PUT /identity/v3/projects/ce31c33522c4447299e86da22656bdac/users/66b113a48cb8437fa61c263f12bc6bea/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:25.363138 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.372794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14351fb-9ecf-45fd-8357-68fe900a90fa admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.426238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.426891 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.427172 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.427445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.428169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.430322 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660b567-786e-4f21-826e-1aa7a00c8797 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.439815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4355/8736] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 04:55:25 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 04:55:25.443901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.454901 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a44a0-e715-4785-ad4b-176604b8f865 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.459575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.460452 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.460779 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.461058 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] PATH_INFO: `/v3/projects/ce31c33522c4447299e86da22656bdac/users/66b113a48cb8437fa61c263f12bc6bea/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.463078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce31c33522c4447299e86da22656bdac, user_id=66b113a48cb8437fa61c263f12bc6bea, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.465730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.475968 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4382/8737] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 04:55:25 2021] PUT /identity/v3/projects/ce31c33522c4447299e86da22656bdac/users/66b113a48cb8437fa61c263f12bc6bea/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 04:55:25.485323 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.485608 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.485883 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.511797 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] MFA Rules not processed for user `66b113a48cb8437fa61c263f12bc6bea`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:25.513018 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:25.577507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4356/8738] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:55:25 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:25.589231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:25.590947 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:25.661742 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824cf6-a0cf-4467-95bb-c89a65aef662 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:25.667292 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:25.667929 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:25.668204 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:25.668475 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:25.722932 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:25.724408 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45d95-84cc-4a0b-9dfe-06515989ca66 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:25.732969 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4383/8739] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:25 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:28.446937 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:28.448375 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:28.503021 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1193-cc35-4858-abce-7bd3c5c81c93 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:28.506594 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:28.507241 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:28.507567 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:28.508354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:28.517718 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:28.519126 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:28.528674 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4357/8740] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:28 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:31.178033 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829840-24a2-4b46-a6da-058d218411ad None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:31.178457 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829840-24a2-4b46-a6da-058d218411ad None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:31.178980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829840-24a2-4b46-a6da-058d218411ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:31.201036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31829840-24a2-4b46-a6da-058d218411ad None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:31.202225 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31829840-24a2-4b46-a6da-058d218411ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:31.215219 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4384/8741] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:55:31 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:31.608206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:31.619149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293be072-cbd1-4896-ab77-cec36d4e389f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:31.624360 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:31.625525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:31.626569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:31.627012 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:31.629081 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:31.646020 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:31.647745 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:31.661711 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4358/8742] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:31 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:37.715875 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4265d-e432-44b0-a654-1f64ab541c50 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:37.716434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4265d-e432-44b0-a654-1f64ab541c50 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:37.716434 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4265d-e432-44b0-a654-1f64ab541c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:37.735793 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-0bd4265d-e432-44b0-a654-1f64ab541c50 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:37.737049 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0bd4265d-e432-44b0-a654-1f64ab541c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:37.744686 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4385/8743] 10.222.0.21 () {58 vars in 1015 bytes} [Wed Nov 10 04:55:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:37.759948 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:37.768589 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750f1a-fc60-4e48-9a18-a381d147f592 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:37.772421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:37.773423 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:37.773704 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:37.773976 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:37.781801 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:37.783221 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:37.791976 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4359/8744] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:38.391824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f091ea-8d52-4313-9018-0a9e927658c1 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:38.392393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f091ea-8d52-4313-9018-0a9e927658c1 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:38.396328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f091ea-8d52-4313-9018-0a9e927658c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:38.423646 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d4f091ea-8d52-4313-9018-0a9e927658c1 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:38.425644 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d4f091ea-8d52-4313-9018-0a9e927658c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:38.437289 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4386/8745] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:55:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:38.451577 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:38.465827 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222a78-45c7-45f0-8b65-ee3a6309b1c4 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:38.471899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:38.473001 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:38.473290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:38.473743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:38.483835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:38.485432 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:38.497226 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4360/8746] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:44.639754 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542f8f-8f8c-4587-90e1-1bb4dabc1230 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:44.640281 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542f8f-8f8c-4587-90e1-1bb4dabc1230 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:44.640391 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542f8f-8f8c-4587-90e1-1bb4dabc1230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:44.658531 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-c3542f8f-8f8c-4587-90e1-1bb4dabc1230 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:44.659773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c3542f8f-8f8c-4587-90e1-1bb4dabc1230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:44.669528 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4387/8747] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:55:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:44.685757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:44.697543 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d687-844b-4a4d-bb40-679c3a95efb8 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:44.704280 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:44.704994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:44.705274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:44.705545 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:44.714919 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:44.716790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:44.727707 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4361/8748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:44 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:55:49.265953 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41143cd-4f60-4980-9aa2-781bccb9ed76 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:49.267407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41143cd-4f60-4980-9aa2-781bccb9ed76 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:49.267684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41143cd-4f60-4980-9aa2-781bccb9ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:49.286331 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-a41143cd-4f60-4980-9aa2-781bccb9ed76 None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:55:49.287588 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a41143cd-4f60-4980-9aa2-781bccb9ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:55:49.297075 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4388/8749] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:55:49 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:55:49.311727 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:55:49.323151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9d45-633a-407c-9464-d2c7255095a0 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:55:49.331603 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:55:49.332250 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:55:49.332525 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:55:49.332942 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:55:49.342776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:55:49.344458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c80b2-ee31-4ed2-a113-34517e6eac51 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:55:49.355590 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4362/8750] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:55:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:56:34.799181 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:56:34.799719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:56:34.799719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:56:34.817568 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:56:34.818777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:56:34.827859 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4389/8751] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:56:34 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:56:35.183895 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:56:35.184352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:56:35.184526 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:56:35.206771 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:56:35.208347 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:56:35.218336 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4363/8752] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 04:56:35 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:56:35.231396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:56:35.232920 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:56:35.246458 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f009359-3735-481c-adc1-e04ebda7561a None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:56:35.252043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:56:35.252830 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:56:35.253323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:56:35.253808 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:56:35.263192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:56:35.265796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a057b-23ff-43c5-bc30-551ce95f5ba5 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:56:35.284881 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4390/8753] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:56:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:58:01.346307 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:58:01.347794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:01.422605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725a015-b0ad-4039-91ba-bdb8d43a5c04 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:58:01.427532 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:58:01.428164 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:01.428450 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:01.428755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:01.430491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:01.441951 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:58:01.443507 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:58:01.452965 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4364/8754] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:58:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:58:20.932865 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02053-e217-4e4a-9768-ac9cc691722d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:20.933430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02053-e217-4e4a-9768-ac9cc691722d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:20.933430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02053-e217-4e4a-9768-ac9cc691722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:20.952234 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-31c02053-e217-4e4a-9768-ac9cc691722d None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:58:20.953561 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-31c02053-e217-4e4a-9768-ac9cc691722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:20.961157 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4391/8755] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 04:58:20 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:58:21.695593 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:58:21.709330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037edc-de3c-4571-9f4d-0dcfa6f8eb04 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:58:21.716298 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:58:21.717415 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:21.717903 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:21.718631 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:21.722405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:21.741153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:58:21.743291 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:58:21.773145 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4365/8756] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:58:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:58:23.577310 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:23.578207 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:23.578651 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:23.630088 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:58:23.631857 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:23.640055 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4392/8757] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 10 04:58:23 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:58:23.655231 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:58:23.666392 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5ed6-3ab8-4a25-99fc-c4d4934545ea service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:58:23.672103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:58:23.673699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:23.674170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:23.674654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:23.684452 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:58:23.686955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511d097-6a7f-416e-a45f-d9584fbac681 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:58:23.698024 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4366/8758] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:58:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:58:49.974481 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:58:49.986898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f24d-4809-4c96-86f2-d31f446a4471 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:58:49.992356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:58:49.993052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:58:49.993325 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:58:49.993596 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:58:49.995365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:58:50.006418 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:58:50.007957 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:58:50.017442 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4393/8759] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:58:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:59:06.022247 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8daf6-9693-4763-8f0d-7cf239e00879 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.022860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8daf6-9693-4763-8f0d-7cf239e00879 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.022860 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8daf6-9693-4763-8f0d-7cf239e00879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.041785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e5e8daf6-9693-4763-8f0d-7cf239e00879 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:59:06.043197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e5e8daf6-9693-4763-8f0d-7cf239e00879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:59:06.049694 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4367/8760] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:59:06.062710 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:59:06.072043 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf0136-772b-4bd0-a97c-cb5ce8401d28 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:59:06.075755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:59:06.076442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.076767 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.077051 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.084994 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:59:06.086437 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdeedd-c823-4726-8980-fc5e6a463821 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:59:06.095024 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4394/8761] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:59:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:59:06.188890 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.189174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.189480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] PATH_INFO: `/` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.191300 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4368/8762] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 10 04:59:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 04:59:06.196441 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.196741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.197016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.215226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] MFA Rules not processed for user `a4345bdda5c3489084a72f2bb5f18707`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 04:59:06.216410 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:59:06.226443 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4395/8763] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 04:59:06.246962 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:59:06.248835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:59:06.264956 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eedcb-c856-4744-9795-c1501dbe5ec2 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:59:06.270383 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:59:06.271011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.271288 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.271562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.279605 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:59:06.281777 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a9210-c97c-43a9-b855-9b885618fd9d service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:59:06.291123 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4369/8764] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:59:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 04:59:06.444951 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 04:59:06.455849 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f503ea0-b5ba-45d7-bf70-75d00d62e7b9 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 04:59:06.461143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 04:59:06.461773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 04:59:06.462054 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 04:59:06.462328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 04:59:06.464085 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 04:59:06.475719 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 04:59:06.477319 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a818-bf7a-49ff-8d46-fb011531de53 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 04:59:06.486956 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4396/8765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 04:59:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:00:11.981251 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:00:11.981778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:00:11.981778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:00:11.999835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:00:12.001229 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:00:12.008366 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4370/8766] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:00:11 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:00:12.048748 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:00:12.049269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:00:12.049269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:00:12.068705 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] MFA Rules not processed for user `b0e3e62850b34fe786eda1156be94f74`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:00:12.070278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:00:12.128223 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4397/8767] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 10 05:00:12 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:00:12.134955 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:00:12.144762 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc988a83-cd5e-4209-9ca1-6b44f88d4719 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:00:12.149306 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:00:12.150215 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:00:12.150581 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:00:12.151118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:00:12.153317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:00:12.176135 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:00:12.177658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:00:12.190487 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4371/8768] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:00:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:00:15.090275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:00:15.102824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdf1d-3cbb-4920-adeb-0010080b1470 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:00:15.106670 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:00:15.107570 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:00:15.107811 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:00:15.108152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:00:15.110309 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:00:15.126940 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:00:15.128766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:00:15.140515 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4398/8769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:00:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:00:24.976258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:00:24.985620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9617-1cbd-427d-a26c-e6d3bb0fd609 service glance] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:00:24.990093 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:00:24.992011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:00:24.992562 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:00:24.993101 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:00:25.004174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:00:25.005857 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:00:25.015793 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4372/8770] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:00:24 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:01:37.351385 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:01:37.353536 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:01:37.405449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68f87-c4fb-44a1-bc8c-fefc32cccfe6 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:01:37.411860 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:01:37.412798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:37.412798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:37.413060 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:37.424179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:01:37.426082 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:01:37.436720 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4399/8771] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:01:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:01:39.425939 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:01:39.463099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239594a9-6400-456e-bfc1-5f19b42b0ce4 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:01:39.468993 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:01:39.469925 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:39.470212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:39.470478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:39.480044 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:01:39.481648 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305fbca-246c-4170-a4ee-e41cd577df9e service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:01:39.492289 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4373/8772] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:01:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:01:47.003105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:01:47.012226 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6298e0-ee1c-4204-ac6b-acf58a84e54a service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:01:47.015866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:01:47.016557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:47.016925 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:47.017260 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:47.026803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:01:47.028326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d381f9-9eb9-4868-ac49-99b69d7cdb7f service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:01:47.037893 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4400/8773] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:01:47 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:01:50.112873 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:50.113445 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:50.113659 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:50.142440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] MFA Rules not processed for user `370699bdc9154f46a66106ec6db331f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:01:50.143743 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:01:50.150984 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4374/8774] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:01:50 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:01:50.478695 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:50.479271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:50.479271 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:50.520436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] MFA Rules not processed for user `5d487008cbef426790f5b2e475643ade`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:01:50.522137 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:01:50.540171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4401/8775] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:01:50 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:01:50.552564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:01:50.561938 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca1ef-69ca-4d53-92b4-30f4f1a30582 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:01:50.566033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:01:50.567539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:50.567822 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:50.568102 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:50.576207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:01:50.578901 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:01:50.589257 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4375/8776] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:01:50 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:01:57.643886 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:01:57.653115 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eea59-da22-413a-8d3d-7f3db1c58f73 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:01:57.656894 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:01:57.657580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:01:57.657862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:01:57.658152 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:01:57.666566 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:01:57.668027 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:01:57.677472 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4402/8777] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:01:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:02:04.250338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:04.263847 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18babb1-e4c7-4ab1-9487-9ffff2f6a29f service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:04.269343 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:04.269979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:04.270267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:04.270538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:04.279310 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:04.281253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f72bcb-63ee-484c-bd31-7c47d4dc10f4 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:04.291544 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4376/8778] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:02:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 05:02:53.622252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:53.703501 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372dbb-940b-4952-8d41-1f81a65ad4a6 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:53.708329 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:53.709240 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:53.709520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:53.709785 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] PATH_INFO: `/v3/users/370699bdc9154f46a66106ec6db331f9` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:53.711050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=370699bdc9154f46a66106ec6db331f9)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:53.712971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:53.765211 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370699bdc9154f46a66106ec6db331f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:53.771843 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370699bdc9154f46a66106ec6db331f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:53.772486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370699bdc9154f46a66106ec6db331f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:53.784242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370699bdc9154f46a66106ec6db331f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:53.791542 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370699bdc9154f46a66106ec6db331f9'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:53.797556 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4403/8779] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:02:53 2021] DELETE /identity/v3/users/370699bdc9154f46a66106ec6db331f9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:53.802233 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:53.802755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:53.802869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:53.839794 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:02:53.841037 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:53.896891 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4377/8780] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:02:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:02:53.906751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:53.908128 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:53.973908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76d8f-a22d-4f97-9dfb-720bd06ea74a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:53.978105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:53.978768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:53.979050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:53.979326 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:53.988889 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:53.990308 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:54.000567 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4404/8781] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:02:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:02:54.177799 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:54.179354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:54.192702 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02322b-ec7e-4fa1-bb78-b3a213d23dd7 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:54.197949 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:54.198798 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:54.199073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:54.199344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] PATH_INFO: `/v3/projects/bb888d7f1ef6460ebe084784cac4d5a2` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:54.200755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb888d7f1ef6460ebe084784cac4d5a2)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:54.204145 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:54.251265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb888d7f1ef6460ebe084784cac4d5a2', 'request_id': 'req-6ff8709f-5426-4d12-9386-172ea1d079be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.256790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb888d7f1ef6460ebe084784cac4d5a2', 'request_id': 'req-6ff8709f-5426-4d12-9386-172ea1d079be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.262877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb888d7f1ef6460ebe084784cac4d5a2', 'request_id': 'req-6ff8709f-5426-4d12-9386-172ea1d079be'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.275505 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] The token cache is being invalidate because project bb888d7f1ef6460ebe084784cac4d5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:02:54.275787 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.276408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.277987 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4378/8782] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:02:54 2021] DELETE /identity/v3/projects/bb888d7f1ef6460ebe084784cac4d5a2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:54.282192 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:54.292407 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56666f-3236-4712-a8eb-f04505074024 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:54.346449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:54.347461 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:54.347878 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:54.348154 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] PATH_INFO: `/v3/users/66b113a48cb8437fa61c263f12bc6bea` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:54.349402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b113a48cb8437fa61c263f12bc6bea)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:54.351294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:54.394679 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b113a48cb8437fa61c263f12bc6bea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.401647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b113a48cb8437fa61c263f12bc6bea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.402286 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b113a48cb8437fa61c263f12bc6bea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.415056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b113a48cb8437fa61c263f12bc6bea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.421996 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-f6f14658-6f12-4d55-8559-f9c5fa868ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b113a48cb8437fa61c263f12bc6bea'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.427714 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4405/8783] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:02:54 2021] DELETE /identity/v3/users/66b113a48cb8437fa61c263f12bc6bea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:54.689036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:54.694132 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:54.710314 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8709f-5426-4d12-9386-172ea1d079be admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:54.764766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:54.765701 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:54.765979 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:54.766249 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] PATH_INFO: `/v3/projects/ce31c33522c4447299e86da22656bdac` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:54.767428 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce31c33522c4447299e86da22656bdac)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:54.769339 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:54.814434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce31c33522c4447299e86da22656bdac', 'request_id': 'req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.819649 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce31c33522c4447299e86da22656bdac', 'request_id': 'req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.826337 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce31c33522c4447299e86da22656bdac', 'request_id': 'req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.838391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] The token cache is being invalidate because project ce31c33522c4447299e86da22656bdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:02:54.838680 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.839312 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-af2c2dbe-1fa9-4757-b08a-cb96a4fa065d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:02:54.840889 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4379/8784] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:02:54 2021] DELETE /identity/v3/projects/ce31c33522c4447299e86da22656bdac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:54.847750 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:54.848238 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:54.848357 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:54.885239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:02:54.886433 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:54.943304 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4406/8785] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:02:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:02:54.952917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:54.953274 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:54.953619 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:54.972407 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:02:54.973635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:54.982461 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4380/8786] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:02:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 05:02:54.986515 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:54.996563 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02195b-52c8-4653-850c-1d788f092d2d None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.001135 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.001776 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.002056 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.002328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.003084 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 05:02:55.003383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.005005 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.018868 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4407/8787] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 05:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 05:02:55.023408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.032586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c164be-62f7-41e4-ad5d-b01df5f64b28 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.037186 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.037824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.038099 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.038380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.039060 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.040947 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.077058 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4381/8788] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 05:02:55 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:02:55.081179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.090855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb69f-a120-4c96-aee3-61d0b23c159c admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.144278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.144908 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.145189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.145503 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.146413 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.148335 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.167301 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4408/8789] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 05:02:55 2021] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:02:55.171417 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.182248 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ab00-784d-49eb-9dec-6404b549209e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.186918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.187570 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.187853 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.188130 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.188899 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.190465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.200141 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4382/8790] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:02:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:02:55.204061 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.214006 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c639-3d2e-44dc-8815-7491bf384261 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.218775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.219421 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.219964 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.220237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.221007 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.222582 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c373a-0666-4571-a274-eff4c285e6ec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.233048 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4409/8791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:02:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:02:55.237317 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.247990 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f861-a25e-4c57-b47a-76ab9628d07e admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.252539 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.253434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.253746 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.254022 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] PATH_INFO: `/v3/projects/c1c447bf3c2843d4bd6d9124a9054dc0/users/e2c40d4e29fb49fab90f2da6f01a8e83/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.268089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c447bf3c2843d4bd6d9124a9054dc0, user_id=e2c40d4e29fb49fab90f2da6f01a8e83, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.270697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.283080 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4383/8792] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:02:55 2021] PUT /identity/v3/projects/c1c447bf3c2843d4bd6d9124a9054dc0/users/e2c40d4e29fb49fab90f2da6f01a8e83/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:55.288482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633809c-3503-4aa5-9f7d-98a137c77642 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.288798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633809c-3503-4aa5-9f7d-98a137c77642 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.289075 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633809c-3503-4aa5-9f7d-98a137c77642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.307734 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1633809c-3503-4aa5-9f7d-98a137c77642 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:02:55.309182 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1633809c-3503-4aa5-9f7d-98a137c77642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:55.365984 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4410/8793] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:02:55.376458 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:55.378209 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:55.431975 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025697c-e8ec-4111-b813-40e22dab6798 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:55.435586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:55.436223 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:55.436504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:55.436812 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:55.445591 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:55.447030 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:55.456260 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4384/8794] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:02:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:02:59.544847 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:59.545375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:59.545375 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:59.589256 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] MFA Rules not processed for user `e2c40d4e29fb49fab90f2da6f01a8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:02:59.590780 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:02:59.679836 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4411/8795] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:02:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:02:59.684663 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:59.695226 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0f9c-2330-4bbd-80e3-c844449d404a service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:59.701449 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:59.702548 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:59.702830 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:59.703104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:59.703815 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:59.705753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:59.741175 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4385/8796] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 05:02:59 2021] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 05:02:59.745899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:59.757176 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da076fca-e7f3-449d-9195-999b47e35ddb None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:59.836927 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:59.837647 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:59.838070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:59.839474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:59.839474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:59.840974 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:59.866171 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4412/8797] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 05:02:59 2021] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:02:59.870437 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:59.894194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c87a-44fd-4349-80c2-8a293a8a4e23 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:59.900408 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:59.901144 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:59.901429 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:59.901772 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:59.902521 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:59.904124 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:59.916980 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4386/8798] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:02:59 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 05:02:59.920770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:59.931063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad30b-e238-4a34-859f-31f1d563017f admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:02:59.935846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:02:59.936768 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:02:59.937044 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:02:59.937312 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] PATH_INFO: `/v3/projects/939946051c8e44e198cee86012c7b20f/users/618c202caaef46c491a831aef27a53e4/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:02:59.954078 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=939946051c8e44e198cee86012c7b20f, user_id=618c202caaef46c491a831aef27a53e4, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:02:59.956773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:02:59.972521 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4413/8799] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:02:59 2021] PUT /identity/v3/projects/939946051c8e44e198cee86012c7b20f/users/618c202caaef46c491a831aef27a53e4/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:02:59.976430 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:02:59.986699 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011da7-e573-4b47-9e7f-88aa6c15ce82 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:00.046652 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:00.047354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:00.047636 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:00.047911 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:00.048719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:00.050302 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a25e98-b4a8-4e3c-a4b7-7a2ad352c28f admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:00.064362 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4387/8800] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:02:59 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:03:00.065990 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:03:00.077540 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ae82-a73d-4d60-9976-5649241a3d4e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:00.082252 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:00.083140 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:00.083420 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:00.083696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] PATH_INFO: `/v3/projects/939946051c8e44e198cee86012c7b20f/users/618c202caaef46c491a831aef27a53e4/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:00.085862 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] RBAC: Authorizing `identity:create_grant(project_id=939946051c8e44e198cee86012c7b20f, user_id=618c202caaef46c491a831aef27a53e4, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:00.088486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:00.102395 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4414/8801] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:03:00 2021] PUT /identity/v3/projects/939946051c8e44e198cee86012c7b20f/users/618c202caaef46c491a831aef27a53e4/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:03:04.845371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ceed2-0261-4e0b-bb6c-610480e27aef None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:04.845862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ceed2-0261-4e0b-bb6c-610480e27aef None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:04.845958 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ceed2-0261-4e0b-bb6c-610480e27aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:04.876033 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e81ceed2-0261-4e0b-bb6c-610480e27aef None None] MFA Rules not processed for user `618c202caaef46c491a831aef27a53e4`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:03:04.877435 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e81ceed2-0261-4e0b-bb6c-610480e27aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:04.949145 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4388/8802] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:03:04 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:03:04.960859 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:03:04.964067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:05.040180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c6b7-3035-4e8c-82c8-5375adcd484d admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:05.045796 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:05.046514 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:05.046858 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:05.047195 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:05.107074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:05.108697 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:05.117961 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4415/8803] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:03:04 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:03:06.399902 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:06.400421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:06.400555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:06.418431 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] MFA Rules not processed for user `e2c40d4e29fb49fab90f2da6f01a8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:03:06.420151 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:06.426796 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4389/8804] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:03:06 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 05:03:08.333976 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:03:08.335493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:08.433690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7abfc2-95ba-4eac-8f49-6700458ca38d service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:08.439378 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:08.440257 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:08.440765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:08.441052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:08.442995 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:08.456402 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:08.460233 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:08.472205 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4416/8805] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:03:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:03:16.608494 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:03:16.609910 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:16.672402 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc2312-33fd-4128-aff6-b4b74ad84fbb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:16.675988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:16.676640 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:16.676931 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:16.677211 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:16.686051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:16.687455 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:16.696841 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4390/8806] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:03:16 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:03:56.624052 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:03:56.625500 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:56.638486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2571-1f0e-42ec-ab36-e199f5c07c3c service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:03:56.643395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:03:56.644010 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:03:56.644284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:03:56.644551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:03:56.646239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:03:56.656895 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:03:56.658436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:03:56.668414 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4417/8807] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:03:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:13.757970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:13.766707 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a89b67-ec8c-4fe4-a2b9-2c69cbe6904e service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:13.770457 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:13.771121 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:13.771424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:13.771697 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:13.774086 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:13.798566 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:13.799997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fce9-b055-4a2d-a9a4-d6aa60a26fb3 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:13.820135 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4391/8808] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:17.367011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:17.375915 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e634596-f247-41fe-a3a1-5e68816d31dd service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:17.379516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:17.380139 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:17.380416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:17.380718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:17.382440 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:17.396480 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:17.397980 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:17.408760 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4418/8809] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:25.841944 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a2bb-3d58-498b-9bef-cd82f6516596 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:25.842434 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a2bb-3d58-498b-9bef-cd82f6516596 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:25.842555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a2bb-3d58-498b-9bef-cd82f6516596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:25.890256 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-e3c6a2bb-3d58-498b-9bef-cd82f6516596 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:05:25.891453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-e3c6a2bb-3d58-498b-9bef-cd82f6516596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:25.952103 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4392/8810] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:05:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:05:25.998794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:26.000219 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:26.085899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76422dac-9b2e-4c45-80d3-65f172446a25 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:26.090730 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:26.091356 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:26.091631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:26.091899 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:26.099968 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:26.101549 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:26.109266 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4419/8811] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:05:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:05:38.883871 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:38.884424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:38.884424 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:38.920628 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] MFA Rules not processed for user `d1d98a52e85d40a5b77f40d833837869`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:05:38.939620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:38.949221 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4393/8812] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 10 05:05:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:05:38.961493 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:38.962898 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:39.037919 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ba80-18dc-40cc-b882-5f7191b4b431 service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:39.041539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e3e62850b34fe786eda1156be94f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:39.042708 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:39.042981 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:39.043248 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:39.053127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:39.054535 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:39.065545 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4420/8813] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:39.129634 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:39.138551 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67694c-1f4f-4d0d-93d2-3f85640371ed None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:39.142097 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:39.142731 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:39.143004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:39.143276 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:39.145004 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:39.153988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:39.155380 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:39.162815 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4394/8814] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:39.237798 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:39.249359 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cff9-462c-4532-8f8c-1a9b28782355 service glance] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:39.254365 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:39.254991 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:39.255272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:39.255546 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:39.257300 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:39.268290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:39.269883 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b248e-b0a9-4691-9cd4-1360817a55a0 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:39.279996 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4421/8815] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:39.949785 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:39.957924 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448121-d630-4075-bd42-0640d61dff29 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:39.961490 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:39.962108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:39.962403 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:39.962658 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:39.965090 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:39.974206 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:39.975588 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:39.983043 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4395/8816] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:05:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:05:41.498363 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934cfa-0ab7-45df-876e-ada29490c688 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:41.498844 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934cfa-0ab7-45df-876e-ada29490c688 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:41.498950 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934cfa-0ab7-45df-876e-ada29490c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:41.517129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-92934cfa-0ab7-45df-876e-ada29490c688 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:05:41.518436 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-92934cfa-0ab7-45df-876e-ada29490c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:41.525674 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4422/8817] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:05:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:05:41.537970 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:41.549500 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb296-b0d7-4fcf-b4fb-cab6fe6c2745 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:41.554409 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:41.555027 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:41.555299 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:41.555568 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:41.564170 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:41.565764 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:41.574143 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4396/8818] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:05:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:05:57.091191 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:57.091728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:57.091728 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:57.111057 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:05:57.112269 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:05:57.119705 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4423/8819] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 05:05:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:05:57.132969 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:05:57.143826 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2511d3-ad42-4f7d-ad9c-98eaeb07a9ad service swift] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:05:57.148877 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:05:57.149504 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:05:57.149781 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:05:57.150054 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:05:57.157909 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:05:57.159480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440a76b-95c8-40f9-a524-15f9d3bca16f service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:05:57.167370 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4397/8820] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:05:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:07:10.695958 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:10.709800 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fbadf-01f3-41fa-8bae-c727d430de1f None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:10.715825 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:10.716474 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:10.716788 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:10.717071 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:10.718861 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:10.732155 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:10.733772 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:10.750122 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4424/8821] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:07:14.582721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:14.583263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:14.583263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:14.601439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] MFA Rules not processed for user `e2c40d4e29fb49fab90f2da6f01a8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:07:14.602644 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:14.609549 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4398/8822] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:07:14 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:07:16.357417 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:16.366960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2328-1dce-4009-bb87-aadb6fbfb9cd service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:16.370580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:16.371208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:16.371487 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:16.371764 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:16.373533 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:16.383263 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:16.384706 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:16.392632 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4425/8823] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:07:16.824159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:16.837466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ba86-8db2-45e9-9859-3831144ce1db None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:16.842514 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:16.843162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:16.843441 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:16.843714 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:16.845495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:16.857995 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:16.859569 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:16.871424 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4399/8824] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:07:18.444381 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:18.453221 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe213531-2146-4c47-a5e3-5bbbe055af3d service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:18.457090 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:18.457744 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:18.458025 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:18.458380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:18.460197 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:18.471654 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:18.474816 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:18.486159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4426/8825] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:07:25.575643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:25.577444 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:25.593006 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e0ee0-9b18-4373-b3bb-d83eff80fef4 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:25.599477 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:25.600161 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:25.600439 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:25.600751 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:25.602491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:25.615149 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:25.616846 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:25.628271 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4400/8826] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:07:29.505350 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:07:29.518201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291fbe5-de3d-4080-9882-be0fc4e66c7b service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:07:29.523834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:07:29.524523 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:07:29.524835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:07:29.525110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:07:29.526882 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:07:29.540016 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:07:29.541626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:07:29.551936 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4427/8827] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:07:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:08:15.315484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:08:15.335868 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f374-7d32-4756-a28e-4915ceb760c0 service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:08:15.341559 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:08:15.342196 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:08:15.342478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:08:15.342757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:08:15.351267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:08:15.352862 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:08:15.362354 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4401/8828] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:08:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:08:58.977454 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:08:58.988971 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c62155-15b1-42be-8b30-aa00f18136ba service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:08:58.993935 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:08:58.994558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:08:58.994837 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:08:58.995110 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:08:59.003244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:08:59.004820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:08:59.014802 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4428/8829] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:08:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:09:34.443017 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:09:34.456654 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48dfb2-ce04-4bd2-8c92-23a832a4ff1d service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:09:34.462506 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:09:34.463153 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:09:34.463443 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:09:34.463719 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:09:34.474304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:09:34.475900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:09:34.485218 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4402/8830] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:09:34 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:11.041208 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:11.051396 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca237d-6ff6-4b53-a662-8ee643531b43 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:11.055771 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:11.056580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:11.056892 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:11.057171 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:11.064822 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:11.066237 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:11.076478 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4429/8831] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:18.957994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:18.967669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421d58-d117-441a-b50d-2f698c0b199a service nova] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:18.972065 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:18.973005 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:18.973283 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:18.973926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:18.993474 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:18.995174 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:19.008287 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4403/8832] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:20.196079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:20.204488 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ed32-ba87-4698-840d-3597fb490747 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:20.208179 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:20.208845 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:20.209120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:20.209392 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:20.219284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:20.220741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:20.231506 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4430/8833] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:22.725617 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:22.736292 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14278e-d7b8-4753-b7a8-187d1bc4e077 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:22.740108 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:22.740711 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:22.740988 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:22.741278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:22.798994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:22.800479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:22.810610 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4404/8834] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:29.022603 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:29.036751 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9f3e-787e-4d10-8c12-1674f18e6720 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:29.042108 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:29.043000 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:29.043272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:29.043572 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] PATH_INFO: `/v3/users/e2c40d4e29fb49fab90f2da6f01a8e83` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:29.046063 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c40d4e29fb49fab90f2da6f01a8e83)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:29.048444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:29.096913 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c40d4e29fb49fab90f2da6f01a8e83'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.104680 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c40d4e29fb49fab90f2da6f01a8e83'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.105405 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c40d4e29fb49fab90f2da6f01a8e83'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.118904 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c40d4e29fb49fab90f2da6f01a8e83'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.126250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c40d4e29fb49fab90f2da6f01a8e83'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.133149 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4431/8835] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:11:29 2021] DELETE /identity/v3/users/e2c40d4e29fb49fab90f2da6f01a8e83 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:29.313265 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:29.326620 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09449125-6d06-4763-a35f-714f626c7bc4 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:29.383473 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:29.384319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:29.384595 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:29.384898 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] PATH_INFO: `/v3/projects/c1c447bf3c2843d4bd6d9124a9054dc0` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:29.386073 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c447bf3c2843d4bd6d9124a9054dc0)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:29.388003 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:29.431643 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c447bf3c2843d4bd6d9124a9054dc0', 'request_id': 'req-9439b003-4947-4447-97a8-75e505983674'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.436806 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c447bf3c2843d4bd6d9124a9054dc0', 'request_id': 'req-9439b003-4947-4447-97a8-75e505983674'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.443478 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c447bf3c2843d4bd6d9124a9054dc0', 'request_id': 'req-9439b003-4947-4447-97a8-75e505983674'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.456036 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] The token cache is being invalidate because project c1c447bf3c2843d4bd6d9124a9054dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:11:29.456332 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.456994 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.458632 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4405/8836] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:11:29 2021] DELETE /identity/v3/projects/c1c447bf3c2843d4bd6d9124a9054dc0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:29.462632 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:29.464070 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:29.477999 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc9e-b98e-4b1e-b378-0eb632a42946 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:29.532099 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:29.532979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:29.533255 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:29.533527 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] PATH_INFO: `/v3/users/618c202caaef46c491a831aef27a53e4` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:29.534711 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=618c202caaef46c491a831aef27a53e4)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:29.536583 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:29.581284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618c202caaef46c491a831aef27a53e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.589355 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618c202caaef46c491a831aef27a53e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.590143 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618c202caaef46c491a831aef27a53e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.602820 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618c202caaef46c491a831aef27a53e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.609852 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-4d2014b5-86e2-4a03-9086-35985d4268cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618c202caaef46c491a831aef27a53e4'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.615754 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4432/8837] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:11:29 2021] DELETE /identity/v3/users/618c202caaef46c491a831aef27a53e4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:29.785011 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:29.786531 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:29.804236 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b003-4947-4447-97a8-75e505983674 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:29.863681 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:29.864869 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:29.865338 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:29.865814 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] PATH_INFO: `/v3/projects/939946051c8e44e198cee86012c7b20f` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:29.867278 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939946051c8e44e198cee86012c7b20f)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:29.869465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:29.919750 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939946051c8e44e198cee86012c7b20f', 'request_id': 'req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.925165 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939946051c8e44e198cee86012c7b20f', 'request_id': 'req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.931484 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939946051c8e44e198cee86012c7b20f', 'request_id': 'req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.944171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] The token cache is being invalidate because project 939946051c8e44e198cee86012c7b20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:11:29.944597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.945219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-24946f9e-0258-4c8c-a92f-bbfd64aa5fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:11:29.946995 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4406/8838] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:11:29 2021] DELETE /identity/v3/projects/939946051c8e44e198cee86012c7b20f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:29.952574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:29.952881 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:29.953189 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:29.971119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:29.972643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:30.029287 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4433/8839] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:30.037051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.037352 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.037610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.056382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:30.057602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:30.065427 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4407/8840] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:30.069626 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.079222 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49122bf4-1afe-4fa6-bb57-e0b5415c2a85 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.083872 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.084453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.084770 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.085047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.086284 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 05:11:30.086587 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.088161 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.099758 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4434/8841] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Nov 10 05:11:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 05:11:30.104448 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.113585 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c4455-b623-49e3-8f79-d7c2aaaaefff None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.118219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.118840 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.119120 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.119396 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.120109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.121997 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.150321 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4408/8842] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 05:11:30 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:11:30.151432 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.161148 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ed47-7125-44de-a3d3-d0a558c4cc4e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.215987 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.216676 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.217001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.217278 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.217979 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.219866 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.242213 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4435/8843] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 05:11:30 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 05:11:30.243356 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.253599 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a28aa0-b12f-4c0e-b933-16708b2496d1 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.258657 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.259304 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.259586 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.259861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.260590 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.262182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.272507 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4409/8844] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:11:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 05:11:30.276888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.286696 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79009-8dca-4adc-a0aa-4bdd82c25e87 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.291376 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.292026 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.292337 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.292643 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] PATH_INFO: `/v3/roles` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.293368 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.294965 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa52bed-5958-4026-8fac-d6c5c84a7bec admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.304827 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4436/8845] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:11:30 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:11:30.308689 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.318547 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334997-802f-43df-bad5-c7194d0db28b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.323609 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.324470 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] REQUEST_METHOD: `PUT` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.324790 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.325061 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] PATH_INFO: `/v3/projects/9bc6181d284740609d36a6c2468d1e69/users/6563e4f3f9674f91b6a1f944f9e7ad23/roles/4aa20354184f48969579623c64fd58fc` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.341019 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc6181d284740609d36a6c2468d1e69, user_id=6563e4f3f9674f91b6a1f944f9e7ad23, role_id=4aa20354184f48969579623c64fd58fc)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.343510 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.355842 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4410/8846] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:11:30 2021] PUT /identity/v3/projects/9bc6181d284740609d36a6c2468d1e69/users/6563e4f3f9674f91b6a1f944f9e7ad23/roles/4aa20354184f48969579623c64fd58fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:30.360888 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e03d-f31d-4fe3-9e32-dd1f60ba58b4 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.361180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e03d-f31d-4fe3-9e32-dd1f60ba58b4 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.361465 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e03d-f31d-4fe3-9e32-dd1f60ba58b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.378896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-d8e4e03d-f31d-4fe3-9e32-dd1f60ba58b4 None None] MFA Rules not processed for user `68e2062e0f2c4721be375c86224003a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:30.380093 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-d8e4e03d-f31d-4fe3-9e32-dd1f60ba58b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:30.438159 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4437/8847] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:30.450243 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:30.451935 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:30.505624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8fed-9ee5-4dab-a8ac-8649dbba48fb admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:30.509766 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:30.510397 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:30.510679 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:30.510952 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:30.519721 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:30.521162 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:30.530970 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4411/8848] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:34.638510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:34.639072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:34.639072 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:34.669777 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] MFA Rules not processed for user `6563e4f3f9674f91b6a1f944f9e7ad23`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:34.673242 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:34.739330 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4438/8849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:34 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:34.744491 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:34.754372 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f7333-4ae4-4639-a467-de1bb67cc38d service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:34.760199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:34.761048 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:34.761330 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:34.761607 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:34.762327 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:34.764405 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:34.789948 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4412/8850] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Nov 10 05:11:34 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:11:34.794014 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:34.805580 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cdc58-a156-464a-9b1c-982acd3ad7c5 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:34.860036 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:34.860725 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:34.861001 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:34.861270 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] PATH_INFO: `/v3/users` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:34.861978 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:34.863854 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:34.883918 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4439/8851] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Nov 10 05:11:34 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 05:11:34.887861 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:34.898009 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce3d9-d609-48b8-bae6-e8d89be84c55 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:34.902502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:34.903171 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:34.903447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:34.903717 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:34.904480 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:34.906096 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:34.917028 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4413/8852] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:11:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:11:34.921264 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:34.932517 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddac6f5-0de0-446a-9197-a05255a7fb4a admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:34.937399 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:34.938291 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:34.938575 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:34.938846 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] PATH_INFO: `/v3/projects/c76b4eca4eca4425b4479351cef70900/users/2834b0a1338e43fc9741163a5bedcedd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:34.954224 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76b4eca4eca4425b4479351cef70900, user_id=2834b0a1338e43fc9741163a5bedcedd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:34.956869 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:34.970816 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4440/8853] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:11:34 2021] PUT /identity/v3/projects/c76b4eca4eca4425b4479351cef70900/users/2834b0a1338e43fc9741163a5bedcedd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:34.975232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:34.985796 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51721e0-a1b7-4a1c-a9d7-1491a79b6172 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:35.039610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:35.040260 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:35.040538 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:35.040833 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] PATH_INFO: `/v3/roles` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:35.041557 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:35.043118 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39619a78-581e-4e76-9c37-75ff5f90d18a admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:35.054681 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4414/8854] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Nov 10 05:11:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 05:11:35.058928 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:35.068962 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb23b4-064c-40b2-ac83-1297ad48349e admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:35.074395 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:35.075449 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:35.075731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:35.076003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] PATH_INFO: `/v3/projects/c76b4eca4eca4425b4479351cef70900/users/2834b0a1338e43fc9741163a5bedcedd/roles/a31f542edf7f4f97b0d346bcaa39858b` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:35.078105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76b4eca4eca4425b4479351cef70900, user_id=2834b0a1338e43fc9741163a5bedcedd, role_id=a31f542edf7f4f97b0d346bcaa39858b)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:35.080718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:35.090691 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4441/8855] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Nov 10 05:11:35 2021] PUT /identity/v3/projects/c76b4eca4eca4425b4479351cef70900/users/2834b0a1338e43fc9741163a5bedcedd/roles/a31f542edf7f4f97b0d346bcaa39858b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:11:39.759308 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764da7-01c0-4189-9d06-a09dd236d3b1 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:39.760263 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764da7-01c0-4189-9d06-a09dd236d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:39.760550 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764da7-01c0-4189-9d06-a09dd236d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:39.796382 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-d2764da7-01c0-4189-9d06-a09dd236d3b1 None None] MFA Rules not processed for user `2834b0a1338e43fc9741163a5bedcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:39.798089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d2764da7-01c0-4189-9d06-a09dd236d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:39.946597 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4415/8856] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:39 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:39.972986 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:39.975037 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:40.110119 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88f13-7442-4f5c-8889-f577e8c0cfd5 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:40.116294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:40.117558 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:40.117841 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:40.118116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:40.179763 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:40.181439 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:40.192001 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4442/8857] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:41.598667 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:41.599169 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:41.599290 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:41.616748 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] MFA Rules not processed for user `6563e4f3f9674f91b6a1f944f9e7ad23`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:11:41.617917 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:41.624565 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4416/8858] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:11:41 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:11:41.954079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:41.955565 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:42.014691 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b316-e1f6-4352-a4cb-5c75d9acc5b7 service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:42.018393 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:42.019059 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:42.019338 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:42.019610 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:42.021471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:11:42.033127 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:42.034559 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:42.044043 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4443/8859] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:11:50.785495 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:11:50.794671 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa7ba-e993-4309-91eb-abe8d9a103d6 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:11:50.798253 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:11:50.798875 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:11:50.799152 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:11:50.799421 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:11:50.808849 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:11:50.810252 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:11:50.819966 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4417/8860] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:11:50 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:13:05.705879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:13:05.714328 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40773-032e-47b7-8c7d-ef06d5621ca1 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:13:05.718591 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:13:05.719218 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:13:05.719499 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:13:05.719775 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:13:05.721539 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:05.760247 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:13:05.762213 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e0e58-cd5e-4cb2-b45b-c4a823f386c8 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:13:05.769980 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4444/8861] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:13:05 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:13:22.315051 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:13:22.316416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:22.392602 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9c42-e564-4dbb-b7b6-90cfc3216c77 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:13:22.397502 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:13:22.398125 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:13:22.398400 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:13:22.398669 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:13:22.400371 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:22.411212 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:13:22.412779 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:13:22.423144 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4418/8862] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:13:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:13:51.765970 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:13:51.766551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:13:51.766551 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:13:51.794492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:13:51.795731 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:51.853106 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4445/8863] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:13:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:13:51.910660 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:13:51.912128 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:51.980225 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39601c2e-3f5e-4296-a6ee-7be7f04e4274 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:13:51.985351 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:13:51.986530 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:13:51.986811 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:13:51.987085 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:13:51.995309 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:13:51.996945 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a332b-9d46-43ba-a29a-6095a0f56de5 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:13:52.006051 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4419/8864] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:13:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:13:53.764275 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:13:53.780403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbe816-8c76-4822-85c6-90e0a2997290 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:13:53.789298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:13:53.789960 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:13:53.790239 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:13:53.790510 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:13:53.792403 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:13:53.812011 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:13:53.815205 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:13:53.829678 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4446/8865] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:13:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:14:01.567892 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:01.568440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:01.568440 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:01.585089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] MFA Rules not processed for user `6563e4f3f9674f91b6a1f944f9e7ad23`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:14:01.586267 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:01.592991 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4420/8866] 10.222.0.13 () {58 vars in 957 bytes} [Wed Nov 10 05:14:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:14:02.258766 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:14:02.260203 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:02.280599 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9780-9950-4fcb-b0ec-167489a5ee6e service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:14:02.285884 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:14:02.286522 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:02.286801 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:02.287074 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:02.289129 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:02.300879 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:14:02.302468 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8d742-8136-479a-bfb9-ae3a8600731b service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:14:02.312668 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4447/8867] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:14:02 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:14:02.967089 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:14:02.979159 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e91c-e3db-4556-a329-3febc3c883eb None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:14:02.984103 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:14:02.984888 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:02.985178 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:02.985453 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:02.987195 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:02.998232 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:14:02.999776 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:14:03.009870 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4421/8868] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:14:02 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:14:03.391804 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] REQUEST_METHOD: `POST` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:03.392323 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:03.392453 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:03.410003 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.auth.core [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:14:03.411273 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:03.418873 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4448/8869] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:14:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:14:03.432864 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:14:03.453757 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839483-d071-49e4-bdb5-defd420d4dc1 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:14:03.458824 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:14:03.459472 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:03.459753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:03.460029 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:03.468778 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:14:03.470391 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16d177-9912-4653-b126-dcc17e0fbf94 service swift] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:14:03.479320 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4422/8870] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:14:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:14:14.554079 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:14:14.560581 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:14.590120 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405ed25-31fb-4a2d-a03e-c09d1719a408 None None] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:14:14.598017 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d98a52e85d40a5b77f40d833837869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:14:14.599086 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:14:14.599521 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:14:14.599914 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:14:14.602083 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:14:14.618290 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:14:14.620077 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:14:14.632261 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4449/8871] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:14:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:16:05.421496 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe7dd-2798-4f29-a52f-2c86722657b3 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:05.422104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe7dd-2798-4f29-a52f-2c86722657b3 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:05.422104 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe7dd-2798-4f29-a52f-2c86722657b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:05.470244 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-8e6fe7dd-2798-4f29-a52f-2c86722657b3 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:16:05.471427 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-8e6fe7dd-2798-4f29-a52f-2c86722657b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:05.489246 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4423/8872] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 10 05:16:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:16:05.529471 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:05.550089 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe06c73-f6f2-49b6-8757-b1b6e21c399b service nova] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:05.555194 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:05.555824 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:05.556105 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:05.556380 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:05.564674 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:05.566298 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:05.574839 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4450/8873] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:16:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:16:14.916447 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:14.917025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:14.917025 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:14.934564 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:16:14.935728 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:14.942672 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4424/8874] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 05:16:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 05:16:14.955311 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:14.965574 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6acde0-6531-49ed-8e56-ef9ae67c641d service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:14.970746 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:14.971903 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:14.972180 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:14.972450 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:14.980637 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:14.982206 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:14.990372 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4451/8875] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:16:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:16:16.486182 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:16.507805 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1adee6-0d7f-41ef-b54a-77d2303e4352 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:16.511705 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:16.512364 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:16.512664 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:16.513175 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:16.515042 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:16.527344 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:16.528835 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0d89-2fb7-4f49-95bc-25f61bd6036b service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:16.551142 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4425/8876] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:16:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:16:18.991482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:19.001430 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8b37-88d1-4b38-8e8c-d11f198d66aa service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:19.006416 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:19.007444 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:19.007829 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:19.008201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:19.010294 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:19.037631 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:19.039160 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:19.059180 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4452/8877] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:16:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:16:20.173503 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] REQUEST_METHOD: `POST` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:20.173987 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:20.174109 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:20.191553 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.auth.core [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] MFA Rules not processed for user `c7a31642b9b94735b7a1d6614f041347`. Rule list: `[]` (Enabled: `True`). {{(pid=96284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 05:16:20.192755 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:20.199612 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4426/8878] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 10 05:16:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 05:16:20.212729 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:20.223690 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958500-70f9-42e3-a37e-7290208caa53 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:20.228896 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c6651aaa6451cbe1dd9f91e1c68ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:20.229516 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:20.229794 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:20.230067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:20.237828 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:20.239383 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:20.247174 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4453/8879] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 10 05:16:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 05:16:21.656398 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:21.666119 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f27e0-590f-4d47-948e-9cd2a896b085 None None] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:21.670028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:21.670900 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:21.671555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:21.671555 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:21.673438 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:21.688479 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:21.691713 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:21.704159 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4427/8880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:16:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:16:30.035486 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:30.045066 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39729c-76ad-4332-914f-68208013fa3b service swift] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:30.048773 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d487008cbef426790f5b2e475643ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:30.049379 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:30.049653 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:30.049944 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:30.121716 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:30.123492 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:30.145654 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4454/8881] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:16:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:16:30.958635 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:30.969808 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242fe3c-665c-471a-afb2-a6df7410e571 service neutron] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:30.974810 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:30.975668 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:30.975946 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:30.976219 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] PATH_INFO: `/v3/users/6563e4f3f9674f91b6a1f944f9e7ad23` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:30.977442 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6563e4f3f9674f91b6a1f944f9e7ad23)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:30.979342 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:31.026319 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6563e4f3f9674f91b6a1f944f9e7ad23'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.032926 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6563e4f3f9674f91b6a1f944f9e7ad23'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.034147 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6563e4f3f9674f91b6a1f944f9e7ad23'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.034753 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6563e4f3f9674f91b6a1f944f9e7ad23'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.041416 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6563e4f3f9674f91b6a1f944f9e7ad23'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.057860 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4428/8882] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:16:30 2021] DELETE /identity/v3/users/6563e4f3f9674f91b6a1f944f9e7ad23 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:16:31.222765 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:31.233244 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539222a0-50c7-440d-bf43-bd8eaaac3470 service neutron] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:31.289817 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:31.291178 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:31.291462 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:31.291741 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] PATH_INFO: `/v3/projects/9bc6181d284740609d36a6c2468d1e69` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:31.292985 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc6181d284740609d36a6c2468d1e69)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:31.294855 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:31.338250 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc6181d284740609d36a6c2468d1e69', 'request_id': 'req-e72e5e53-d339-4736-ab37-40acb08f5375'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.343389 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc6181d284740609d36a6c2468d1e69', 'request_id': 'req-e72e5e53-d339-4736-ab37-40acb08f5375'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.350107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc6181d284740609d36a6c2468d1e69', 'request_id': 'req-e72e5e53-d339-4736-ab37-40acb08f5375'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.373988 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] The token cache is being invalidate because project 9bc6181d284740609d36a6c2468d1e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:16:31.374272 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.374890 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.376411 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4455/8883] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:16:31 2021] DELETE /identity/v3/projects/9bc6181d284740609d36a6c2468d1e69 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:16:31.380465 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:31.381918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:31.394661 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce6fe-99d0-42d1-9ca4-13cc6c66b45b admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:31.448466 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:31.449354 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:31.449637 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:31.449915 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] PATH_INFO: `/v3/users/2834b0a1338e43fc9741163a5bedcedd` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:31.451116 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2834b0a1338e43fc9741163a5bedcedd)` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:31.453050 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:31.497724 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2834b0a1338e43fc9741163a5bedcedd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.504966 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2834b0a1338e43fc9741163a5bedcedd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.505629 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2834b0a1338e43fc9741163a5bedcedd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.506258 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2834b0a1338e43fc9741163a5bedcedd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.513194 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.notifications [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2834b0a1338e43fc9741163a5bedcedd'} {{(pid=96284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.530747 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4429/8884] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Nov 10 05:16:31 2021] DELETE /identity/v3/users/2834b0a1338e43fc9741163a5bedcedd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:16:31.703638 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:16:31.705231 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:16:31.718047 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5e53-d339-4736-ab37-40acb08f5375 admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:16:31.774285 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e2062e0f2c4721be375c86224003a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e759a896dad443d0938f7cb7473bd222', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:16:31.775050 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:16:31.775327 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:16:31.775597 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] PATH_INFO: `/v3/projects/c76b4eca4eca4425b4479351cef70900` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:16:31.776803 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76b4eca4eca4425b4479351cef70900)` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:16:31.778684 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:16:31.824629 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76b4eca4eca4425b4479351cef70900', 'request_id': 'req-6f07fac6-66f8-4178-a983-b0e55ad89eff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.830122 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76b4eca4eca4425b4479351cef70900', 'request_id': 'req-6f07fac6-66f8-4178-a983-b0e55ad89eff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.836107 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76b4eca4eca4425b4479351cef70900', 'request_id': 'req-6f07fac6-66f8-4178-a983-b0e55ad89eff'} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.847835 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] The token cache is being invalidate because project c76b4eca4eca4425b4479351cef70900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 05:16:31.848116 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.848834 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.notifications [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 05:16:31.850684 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4456/8885] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Nov 10 05:16:31 2021] DELETE /identity/v3/projects/c76b4eca4eca4425b4479351cef70900 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 05:18:28.291207 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:18:28.292624 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:18:28.369598 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20768b-959e-425d-babb-2243d9c96005 admin admin] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:18:28.432238 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:18:28.432918 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:18:28.433199 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:18:28.433471 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:18:28.435216 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:18:28.446062 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:18:28.447610 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:18:28.457631 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4430/8886] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:18:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:19:05.915520 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:19:05.916992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:19:05.932102 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fac6-66f8-4178-a983-b0e55ad89eff admin admin] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:19:05.937557 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:19:05.938201 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:19:05.938482 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:19:05.938755 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:19:05.940483 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.fernet_utils [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:19:05.952422 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:19:05.954067 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:19:05.964339 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4457/8887] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:19:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:23:31.300197 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] Authenticating user token {{(pid=96284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:23:31.301597 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.fernet_utils [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 05:23:31.372285 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5145-666c-4f92-8f9d-dbe1d59fbe11 service placement] Validating token access rules against request {{(pid=96284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:23:31.377394 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711842-dd42-4087-89df-31863452153d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:23:31.378028 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711842-dd42-4087-89df-31863452153d service placement] REQUEST_METHOD: `GET` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:23:31.378305 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711842-dd42-4087-89df-31863452153d service placement] SCRIPT_NAME: `/identity` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:23:31.378580 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711842-dd42-4087-89df-31863452153d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:23:31.386758 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d711842-dd42-4087-89df-31863452153d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:23:31.388829 ncdv-817176-1 devstack@keystone.service[96284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d711842-dd42-4087-89df-31863452153d service placement] RBAC: Authorization granted {{(pid=96284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:23:31.398350 ncdv-817176-1 devstack@keystone.service[96284]: [pid: 96284|app: 0|req: 4431/8888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:23:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 05:24:09.952667 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] Authenticating user token {{(pid=96285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 05:24:09.992259 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df1d6-edb2-4c4a-9f51-3bf09c87f762 service placement] Validating token access rules against request {{(pid=96285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 05:24:09.997806 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4345bdda5c3489084a72f2bb5f18707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 05:24:09.998442 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] REQUEST_METHOD: `GET` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 05:24:09.998718 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] SCRIPT_NAME: `/identity` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 05:24:09.998992 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 05:24:10.007547 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 05:24:10.009165 ncdv-817176-1 devstack@keystone.service[96285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7aa96-98c4-45c8-a228-17cb5fd84cd4 service placement] RBAC: Authorization granted {{(pid=96285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 05:24:10.019633 ncdv-817176-1 devstack@keystone.service[96285]: [pid: 96285|app: 0|req: 4458/8889] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 10 05:24:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)